I doubt he’s more racist than other pimp daddies on average. Anyone who’s Ho was tramping around with a bunch of black guys would probably say the same thing. He was probably worried she was doing more than photo ops with them.
A black guy would have said “quit going around with all those niggers”.
The thing about the apartments isn’t right but it’s very common “business ethics” for lots of rental areas. It is hard to screen tenants so he probably felt like going with the averages.