Given what you’ve already said, I’d say run, don’t walk away.
That said, I wouldn’t walk away without my money, because frankly, the LL sounds like an ___hat that is going to be a big you know what on getting your security deposit back.
Sad to say it, but lawyer up. Or at least, start with LegalZoom and craft a Formal Demand letter.