An incomplete list of people whose safety and privacy matters more than any "sex segregated" toilet on planet earth:
Transgender women and girls
Parents with small children
Fathers who need to change their child's diapers
Disabled people who need someone to help them use the toilet
People who aren't even GNC and still get accused of being transgender because of some bullshit about jawlines
People who's "correct" bathroom is occupied or out of order
"Sex segregated" toilets have always posed difficulty and danger for many people- even if they use the "correct" bathrooms for their sex at birth. Not being able to reliably use public toilets restricts people's access to public spaces. The idealised version of history people want to return to where they didn't cause these problems does not exist and never has existed.
What we CAN do is make sure that public toilets are safer for everyone, regardless of their sex, gender, sexual/romantic orientation, disability status, sense of fashion, age etc.
We can make changing rooms have stalls so that children don't have to see adult strangers in the nude, or strip in front of adult strangers. This is a problem regardless of the sex of the adults and child, no child should have to strip in front multiple adults just to go to the pool.
We can make urinals more private, so that adults can't pull out their penises in front of children.
We can reduce the number of urinals or put them in separate rooms, so that there is more space for stalls, which are much more multi purpose and safe and accessible for disabled people, children, and anyone who wants privacy.
We can increase sizes of stalls so that people with claustrophobia can use them easily.
There are hundreds of ways we can improve public bathrooms that make all their users more safe.
"Sex segregated" bathrooms are not safe. They are bathrooms that put many people at risk of being kicked out, harassed, assaulted, or even beaten.
A transgender 17 year old girl was hospitalised after being assaulted for using the men's bathroom.
A transgender man was beaten and arrested for using the women's bathroom, despite being instructed to
A cisgender woman was harassed in the bathroom because someone thought she was transgender.
A transgender woman was arrested for using the women's bathroom.
A disabled woman was left unable to use the gym because the owner forbid her father from helping her shower in the mens.
A cis woman and her girlfriend, also cis, were asked to leave after one was accused of being a man.
A 15 year old Autistic boy who needed accompanyment from parents in the restroom, who's mother was accompanying him in the women's restroom for her safety, was harrassed and ultimately thrown out of the theater.
Sex segregated bathrooms are not "safer" and they never have been. They've only become more dangerous with the increase in anti LGBT+ rhetoric, which has encouraged increased harrassment of anyone who doesn't fit the "correct" idea of what a woman or man should be like.
Everyone should be able to poo, wee, throw up, change their pads etc in peace. Being able to perform basic bodily functions shouldn't be dependant on gender conformity.