Yes, it's quite normal for your tolerance to go down. The hangovers could be due to B vitamin deficiency or lack of water, both of which are required to metabolize alcohol. Taking a B vitamin supplement and drinking more water next time you indulge might help.