My dress sense is often described as androgynous and even effeminate actually.

But yes, obviously I realise that there are societal expectations on men/women. My point is that this is a bad thing. And embracing the idea that "men dress a certain way" and so on the occasions when I don't, I must be in 'girl mode' or at the very least not a man" is incredibly regressive and actually upholds this same stereotypes.

A man who likes to wear dresses isn't something other than a man. He's a man who like to wear dresses. It's astonishing to me that more people can't see that the former argument precisely upholds ideas about gender from the 1950s.