I think most people who have blamed the cheese for the slower weight lose or none at all, have over done it with the daily amounts.
Stick close to the 4 oz and you'll be fine, it's good calcuim.

Kathy