I think other people really don't notice what we eat or don't eat. If you don't talk about your food choices, I doubt if anyone else will.

And if someone should happen to comment, just say you're stuffed and can't eat another bite. That couldn't possibly offend anybody.