If race wasn't an issue , you wouldn't need to state what race they are , hating a person because they are White is indeed racist .
If you just hated rich people , that would be another matter.
Do you also hate rich Black people, or is it just rich White people you hate ?
Poor people hating rich people is no different to rich people hating poor people