I find that if I just pick a direction, keep walking in that direction, and crucially look away from the person (stillkeeping them in peripheral, but not obviously looking where I’m going) it almost always works out.

It’s when both people start correcting for the other that the problem arises.