Depends on how much you need it. Are you dumping the 401k, the kids college fund, and selling grandmas wedding ring to raise the 140k? If so, keep the 40k. Something will come up and you need some padding for the fall.
If you are sitting on 200k plus, pony up the money and save yourself some cash in the long run.