How do you tell if a man is gay or a rapist? How do you tell if a Black man is a rapist and who is he raping in the men's room? Those herrings aren't even pink.
Nobody's saying go shit in the woods, public restrooms are for everyone as they have been... except in the south. However the question remains, is it worth allowing the perverts to double their territory, to make a very small group more comfortable in the rest room? Should anyone be comfortable in a public restroom?
I can see pros and cons, and because it doesn't affect me, I don't have personal bias to sway me. That makes it difficult to decide whether noble or practical is more important.
Personally, my prostate wouldn't wait in line at the ladies room.