To be fair, I was also attracted to Cog Sci because it seemed focused on solving problems that traditional computer science fails at. Knowledge representation, pattern recognition, NP-complete problems, etc. In the end I found that the only jobs in the field seemed to be in the defense industry. I had paid for college with an internship at a defense contractor, so I knew enough to know I didn’t want to work in that field any longer. In the end it all worked out, and as Rich noted, your academic credentials become less meaningful as your gain work experience. In the end I’m happy with the outcome; that said I wish I’d worked harder in the calculus class, as FFTs and DFTs have crossed my path many times and a better intuitive sense for them would have served me well.
I stacked my major with a lot of CS classes also, including Compiler Construction which I really enjoyed, even though it was one of the tougher classes I took. The instructor (L. Bradley I believe was her name) was awesome. In fact I think I only took two mainline psych classes – one of which was an experimental statistics class for psych students. The other was an awful intro to cognitive psychology class, which had all the hallmarks of what Richard Feynman called a Cargo Cult Science.