I've been avoiding tuna because of this, and only my cat suffers, because he loves it.
Mercury is no joke, and it does accumulate. "Mad as a hatter" came about because hats were prepared with mercury solutions.
You might want to add garlic to your diet, since that helps the body get rid of toxic metals.