BullionDirect.com is cool… you can buy and sell coins/bullion there. They will hold them in there vault insured… but if you ever feel paranoid, just go online and with a few clicks, your gold will be overnighted to you.
If you are worried about storing gold in the US, the Perth mint does something similar to bullion direct, ie, storing your gold, but i’m not sure if they offer physical delivery.