Yes, you got it perfectly right: all other things being equal, a weak currency fans inflation, through higher import prices. This leads to higher long-term interest rates, as people buying bonds want to be compensated for the higher inflation. That’s it.

Then how come rates are so low today? In a nutshell, it’s very simple, really: you may not believe inflation is low, but the bond market clearly does.