as long as they are good carbs, I don't think that hurts. What are good carbs? well, that's not an easy answer! for most people fruits and veggies, even higher-carb veggies like winter squash. For many people, lentils and garbazos are safe. For some people, gluten-free grains like quinoa and millet and brown rice. Flour and sugar are not good carbs for anyone, imo. And carbs shouldn't be eaten alone, but in combination with protein and fat.
In a way, you sound as if you're reinventing the Zone--you might want to read that and follow his advice regarding the sorts of carbs to eat, but UP the calories from what he says!
Also, keep reading on insulin and its effects (the Rosedale article, which is reprinted here under articles is particularly good)--you may realize that the control of insulin is really what you want to accomplish for the sake of not only fat loss but improved health.
The thing with bad carbs is, it's hard to stay honest with ourselves about them. If we crave, if we
really look forward to them, if we keep going back for just one more bite...it's probably a food best avoided, even if it's a veggie or fruit or nut or supposedly healthy food. HTH