You are a borrower that paid for a supposedly “useless” drive-by appraisal. By chance did you compare the rate you obtained to lenders that did not require the drive-by?
Fannie/Freddie allowed a 2055 in lieu of a full appraisal. That is to your benefit. In my eyes you obtained a conventional rate with a discount appraisal fee. What’s the problem? Had you gone to a non-convetional product you would have paid a higher rate. The increased rate would cost you more than the drive-by appraisal fee.