We did the opposite thing a couple years ago – moved from the Westlake area to San Diego (and then out of SD before the crash *whew*).
Westlake Village is expensive – and just that imho.
Take a look at Moorpark or Simi Valley for some decent priced homes, you may also find nice ones in Newbury Park.
I would not recommend going down the hill to Oxnard or Camarillo, simply because
a) they are gang-ridden communities
b) lots of cookie-cutter developments (eg Rose Avenue) plus a)
c) the weather downhill is different – a lot of fog throughout the year, cooler temps than in the uphill cities
d) the 101 grade is a horrible drive – esp for commuting
BTW: Good luck with your job – if it’s at in-phy or similar do yourself a favor and don’t buy !