Hmm, interesting question in the current climate. I think it would depend on your audience obviously. But I tihnk the problem with being labelled a transphobe is that the criteria are so broad (although the label of racist is pretty broad too lately).

Do you understand why some women find it offensive to be referred to as menstruators? You're a transphobe. Do you think males have significant physical advantages over females? You're a transphobe. Do you think that the incredibly new and unfamiliar idea that men can get pregnant should at least be open to discussion given that it's been considered impossible for the entirety of human history? You're a transphobe.

As you say, the problem is the effective censorship around the conversation (I wouldn't even say debate). It's either, you affirm everything we say, even the stuff that is clearly factually wrong, or you hate us and want us dead.