The hard part is that jackasses will view even valid reasons as excuses

This is because ‘socially justifiable’ is socially constructed, i.e. there is no literal right or wrong answer, it is based on perspective. And someone can adopt a different perspective with different people based on the desire to discriminate.