This is preposterous. At most, you're making the case that every single male with a DSD who has been mistaken for a female might, at some point, be discovered to be a male.
"Every single woman on Earth" is not in this position. In fact, vanishingly few people (less that 0.02%) are in this position. And even those who are will still be referred to as women by any reasonable person. I'd never dream of referring to Caster as a man.