” Now if the house goes down in value it is on the banks books not yours”

I’m not sure if I follow this line of logic? You still carry the note. You are just plain stuck with a property worth substantially less than the loan and potentially unable to pay if interest drops at some point – The very same vice that many others will get squeezed by to the breaking point (BK). Take a riskier path with the $$$$$ and it may disappear.

Sell it to some sucker that can prompty ride it down and file BK. You can buy it back from the lenders if you are so fond of it. Otherwise, take your cash and buy somethng for 1/2 the $$$$ in another state like the smart ones are doing.