Tell your family firmly that you are not going to eat any cake or ice cream, you do not want the 'sugar headache' that usually follows after LC'ing for a while. Why not take along a nice LC snack for yourself, or you could make something like the cheesecake that I've seen on this site and hand it around for anyone that doesn't want sugar.

Be strong, stand your ground and enjoy yourself.