There's definitely a degree to which this is true. But the idea that being white is some kind of all powerful advantage is not. There are plenty of poor, disenfranchised white people out there who could do with help far more than I could, for example.

A system that allows people to simply hit a particular number of non-white faces within a company or university and call the job good. inevitably fails people of colour who are poorest. We see this over and over again. Not just in the typically wealthy minorities who benefit most often from affirmative action, but the fact that the unemployment gap and wealth gap between black and white Americans has remained pretty much unchanged in decades.

As I said, efforts that focus on need will still disproportionately help people of colour. As they should. But given that white women have benefited more from affirmative action than any other demographic, even if your concern is white privilege, simply going by immutable characteristics ib obviously not cutting it.