I never read Atkins for Life, but on DANDR, I believe milk is listed together with "very once in a while" foods, such as sugar, white rice, and white flour, not with the foods you can regularly consume during maintenance, like potatoes.

If you ever read DADR, he literally rants about milk... it is a fun read.