I lived in crown point for years and loved it. My wife and I hit the path from Crown Point Park all the way around the bay down to the boardwalk to the jetty and back. It was really nice even though the summertime brought in all the zonies.
I kind of agree with you that getting a home in PB maybe tough. Others feel that north PB will fall substantially but I do not. Just an opinion.
Unfortunately there is no real boardwalk anywhere along the north county coast but that does not mean the beaches are not nice and the lifestyle is good as well. I think that your best bet may be Encinitas. I don’t know your price range but getting something east of El Camino Real may become more affordable in the next few years. You will also get more home/lot for the money up there. Of course that is not anywhere close to walking or biking distance to the beach. Moonlight is a nice beach, no boardwalk but nice.
Our decision while living in PB was to enjoy the lifestyle in the condo we were in and that worked well for us for many years. Once kids came along the lifestyle and priorities changed. So if kids are not in your future, maybe you should consider a condo in north PB or Crown Point as those are DEFINITELY coming down in price. Be patient…