Russell posted a very good calculator (in a thread started by flu). It takes into account the costs of refi, your current rate and how many years left on your loan, inflation, cost of money, etc… It spits out what rate (or lower) it makes sense to refi.