I guess tone and context might count for something here, but there's nothing inherently wrong with referring to someone with brown skin as "brown skinned." Just as there's nothing wrong with referring to somebody who's tall as "tall" or somebody who's blond as "blond."

I have brown skin. I like it a lot. It's actually kind of weird if you pretend you aren't aware of that.