Are you eating more nuts of any kind? My DH found out he is allergic to peanuts - they cause terrible mouth ulcers, but he gets none if he does not eat them or any food containing them.
The Vit C answer is also very likely a key to the problem - make sure you take a very good multi-vitamin daily.