I talked with “home loan Sheldon” recommended by piggs here and borrowing from my 401k is exactly what he told me to do if I moved ahead (last year). Would not hurt to look him up and chat with him. He was insightful and not pushy. http://www.homeloansheldon.com/401kforDownpayment