I mean, you’d have to be right near a neutron star or black hole for it to add up to much AFAIK.

Even being on the moon is enough to mess up clocks, though.