I know it's too much when I dread it (I usually look forward to it)

Another way is when you start getting lots of injuries, or sick, or really drained.
Or when you do more and more, but stall anyway.