I don't think this is a bad idea at all. I find that I stay away from fatty meat (except for special occasions) because it makes my calories skyrocket, anyway.

This WOE is really flexible. If you truly feel in your gut that the way that you are eating is "bad," then change it--even if it is only for your peace of mind. Eat more fish, cut out cheese and red meats, double your veggies and exercise, exercise, exercise. But don't ditch it because some people have health problems that may or may not be related to the WOE. It seems to me that, if anything, this WOE makes people healthier--and acknowledgement of that fact by the larger medical community doesn't seem to be far off...