I think your fundamental mis-conception is how these people think of affordable housing. To them its an affordable housing ATM. Cheap for them to get into, easy for them to extract wealth from to subsidize those stagnant wages. Easy to dump on someone else so they can retire early! Now thats affordable.
You just need to liberate yourself from those stuffy ideas of sacrifice to help your fellow man and the common good, you’ll get it!