You are only supposed to compare weekly averages. Weight fluctuates on a daily basis. Don't compare your daily weights to your weekly average. You'd go crazy.

Also, if you're a woman, you can gain weight due to TOM. So you have to learn your body rhythm to know when that gain will happen and by how much so you don't get upset.