The potential of human error already greatly exceeds that for software/hardware error. Tell me which is more dangerous:

Of course. But right now, the driver generally has responsibility for a crash. With self-driving cars, any accident will basically open the manufacturer (with multi-billion dollar deep pockets) to huge liability. The legal issues need to to be sorted first.