I know the Neanderthin author cautioned people about fruit if they are also trying to lose weight. (I really like the concept, but I'm hanging on to my coffee & yogurt!)
He also makes the point that modern fruits are bred to be both larger and sweeter than their wild counterparts. And in most climates, fruit is only available seasonally, not year round.
I was thrilled to find my favorite fruits, berries and melons, are pretty low carb, and I have them several times a week now that I'm maintaining. But small portions, and usually with a meal, as LadyBelle suggested.