Absolutely. This is especially interesting when a very young child says it. What does a child know about being a boy or a girl? The color pink and dolls? The colour blue and playing in mud? The idea that a child has any meaningful concept of being a boy or a girl is bizarre to me.
And, as you say, this is true even in adulthood. I don't "feel" like a man. I just am one. I don't "feel" black either. As far as I can see, things like this aren't feelings, they're just realities. The sooner we learn to stop claiming that these things define us the better.