Cynical view here — the “lender” ain’t lending his own money. He wants to lend you more money (posher area) in order to get a bigger kickback (commission). Go with what fits your price range and where you like to live, not what a lender’s gofer tells you to do.
BTW – “better police services” aren’t always a good thing. This can mean “cops called by prissy neighbors because you’re BBQing in your back yard at 9pm, or because your kids are outside.”