If you have young kids, and family is in San Diego (you didn’t say they were or not, so I am just guesing they might be), I would try to stay here or somewhere close (Southern California if you don’t want to stay in San Diego). This way the kids will get to see them frequently and feel like a part of a bigger family. If you have family in CO or grandparents will move there too, then go for it.