It comes down to individualized goals. But as a general rule of thumb, stick to seasonal fruits and vegetables. You're right, and there has been a lot of study (especially some outstanding talks at the AHS) about the body's natural fructose absorption around harvest and then fat storage for winter. If you stick to the seasonal produce from a local farmer's market or CSA, you should be fine. Otherwise, if you don't already have a metabolic condition, there's not going to be a huge fluctuation in healthy body composition because you're still eating bananas in the middle of winter.

All of that being said, consider the higher fat intake of the Inuits and other arctic cultures. It seems that natural body warmth and the intake of fats tend to coincide for some.