Hair loss is far more common among men, so using the term is “inherently related to sex” — and equivalent to commenting on the size of a woman’s breasts.
Calling men ‘bald’ at work now considered sexual harassment in the UK

Hair loss is far more common among men, so using the term is “inherently related to sex” — and equivalent to commenting on the size of a woman’s breasts.