Back in the 90’s my brother also rented a home La Jolla from an elderly couple who had moved to Del Mar. They rented for about 4 years until the owners finally sold to them at a good price.
Hang in there and be patient. I think you’ll be rewarded. No one knows how far down the market will go but, since you live in that area, and follow the market, you’ll know it when the time is right.