I agree with you that men shouldn't have a say on abortion law, but I wouldn't dismiss women who are "pro-life" as "brainwashed by men." Not only does this rob women of agency if they disagree with you, it sucks the nuance out of a conversation that deserves it.
I don't think it's hard to understand and even sympathise with the "pro-life" position. As I said, I think most people agree that abortion should be as rare as possible. So the question is, what is the safest, most flexible way to treat abortion with the seriousness it deserves and protect the rights and freedoms of women.
This is an enormous question that, as we probably agree, men have no real part in deciding. But given that the question is, once again, up in the air, it'll be hard to make progress if you dismiss everybody who thinks differently as brainwashed.