The book says to add them back as a 5g carbs worth serving once a day.

I don't eat fruit, other than some berries in the summer. If I do eat it, it's a small amount, no more than 5g carbs worth.