The points you raise are valid, and, hopefully, the OP will take those issues into consideration.
Living in RSF is definitely a choice that comes with a few caveats, even when you’re younger, but most people who buy here are well-prepared to deal with them in order to enjoy their preferred lifestyle.
We live in Malibu about 50% of the time now, but since we got such a great steal on the house in RSF 20+ years ago when we were in our 30’s, we really enjoyed raising our kids there, and it will always be home base, so I completely understand why the OP is exploring this option in retirement.