Anything that undercuts your Estrogen to progesterone ratio can have effects on breast size.
Here is a passage from one of my blogs called Brain Gut 9 that illustrates how this happens and how the brain and gut are wired together to allow your boobs to change:
How might the brain account for these things? Well, the brain looks at micronutrients coming in through the gut and translates these chemical signals into neurotransmitters that the brain circuits can understand and decipher. For example, when we eat a diet high in fructose (found at the equator) the gut and body respond in kind by causing an increase in absorption of iron, while causing a relative copper deficiency in cells. A copper deficiency is handled differently in both sexes. Women need more copper than men do. The reason is simple. Copper is required for the production of the enzymes which convert progesterone into estrogen. However, in men, more zinc is required to form the enzymatic machinery needed to convert progesterone into testosterone.
When we eat a diet high in fructose, this will also lower zinc levels in cells. This lowers testosterone in men. Higher fructose levels also cause a transient magnesium deficiency in all cells in both sexes when this occurs chronically. Acutely, it changes it at the intestinal brush border. I mentioned here in this blog that is precisely how diabetes actually begins. This lowers the magnesium available to make ATP(energy) if it goes on too long. This is why magnesium deficiency is so common in people who eat carbohydrates in a mismatched environment (T2D). This is also why most diabetics suffer from low magnesium stores and over time this will destroy their sleep and cause peripheral neuropathy too
When you know better you do better.