I think this is where a lot of realtors representing the seller fail the seller, that is they should get the buyer to sign a removal (or waiver) of “ALL” contingencies at the end of the contingency period.
I am not sure the deposit becomes hard until that is signed by the buyer.