where does the loan payoff go?
Nowhere. The principle loan balance is not deductible. Only the interest for the loan reported to you on the 1098-Mortgage Interest Statement is deductible.
