Well letters have a definite bottom. It probably helps brains to not just flip things like p and b easily.

Letters aren’t just mirrors either. q and p are actually different. Letters like d and b have different directional flairs instead of just being a mirror.