I drive a Prius so I am aware of how small my car compared to other vehicles on the road. All I can do is drive defensively. I think a safe driver in a Prius is probably more safe than a maniac in an SUV going 80+ MPH.
One thing that skewed the safety data toward the big SUVs is that 90% of drivers under 22 drive small/compact vehicles and obviously these young and distracted kids have much higher accident rate compared to soccer moms in SUVs.