If you object to the way you've seen some black people generalise Jews, I'd suggest you think about how this same instinct manifests in your own mind.
As for Jewish victimhood, I've discovered that it's constantly conflated with Zionism by Zionists. I presume this is because Zionism would be almost impossible to defend morally without it. But this conflation is a disservice both to Jewish victimhood and the concept of victimhood in general.
Baldwin had a few things to say about Israel as I remember. But as far as I'm aware, he had very little to say about Jews. Because despite this constant conflation, they are not, in fact, the same thing. Only the stupidest of people, which Baldwin certainly wasn't, would blame the Jewish citizens of Israel, never mind the millions of Jews around the world who don't live in Israel, for the actions of the various Israeli governments over the years.
We might agree on intersectionality and CRT and the concept of "white Jews." I'm very much against collectivisation and shared victimhood. But again, I'd invite you to consider how these instincts manifest in your own mind.