Looks like Rick Santorum made the same argument that I just floated:

http://www.slate.com/id/2081904/