My grandparents were from Poland and Italy. They also were called names and discriminated against. They also had a very difficult time.
This mean behavior isn’t ever right but it’s not only something that happens to those of color. And ignorance and meanness doesn’t only flow in one direction as you imply. Folks of all colors demonstrate mean behavior.