Actually, I'll say that the system doesn't feel rigged against me. Black people's fortunes vary wildly. White people's too of course. Privilege takes many forms and skin colour is only one of them. Overlooking this is one of the biggest flaws of the typical "white privilige" framing.
So I'm not trying to make the case that life is always better for white people than for black people. Absolutely not.
What I'm saying is that up until sixty years ago, the system was rigged against black people in a way that no white person experienced. And some are still living with the hangover from that. It takes many forms like access to education, the neighbourhood they grow up in, the lack of generational wealth in their families and more.
Some white people today absolutely live with some of those same issues too, but they aren't dealing with them because the government passed laws that were specifically designed to prevent them from succeeding. That's the key difference.
Looking at the system fresh from the point of view of today only, your point largely holds. There is still racism that affects black people today, but the effects are reasonably small (automated systems can still be biased, it's just that they'll not be biased by race but by economic status. The problem is, as black people are more likely to be poor for the aforementioned reasons, the system still doesn't work as well for them. A lack of generational wealth is a particularly big problem).
I was looking at some statistics recently but don't have them to hand. I think it said that many ordinary aspects of life wrere around 10% harder for a black person than a white person. Still a problem, but a huge improvement.