Fibroadenoma is a benign tumor. In most cases it remains non cancerous throughout life. Surgery is required if it's causing pain/ pressure symp/ heaviness..or if it is large (>3 cm) or complex type. You should go for one FNAC if it's large, and the report will tell you if it's complex or u need a surgery. Incision during surgery must be given as small and as lateral as possible so that it's not visible easily.

Best is to remove  if it's bothering... Take expert opinion from a breast surgeon

If you  really want to know  the root cause of your problem and heal, please  read my blogs on www.truhealing.com or practo health  feeds. Hope that helps....