It's possible that you heard incorrectly. There is an entire chapter in Dr. Atkins' book title, "Exercise, it's not optional".
What Dr. Atkins does recommend is that you go easy on the exercise until your body has had enough time to completely switch from a carb burning metabolism to a fat burning one which will take a few weeks. After that, you should be exercising regularly.