Exactly this. 90% of the reason I started writing about race was that I was tired of seeing angry, bitter, dishonest people "speaking on my behalf."
Experience is meaningful, I'd never deny that, but it's only one of many ways of getting at the truth. And given that it is based entirely on the biases and character of the person doing the experiencing, it's crazy that we're expected to view it as some kind of unquestionable fact.