A pay off is a return of your money and is not taxed.
Be careful here. Understand that may not be true for a seller financed loan. For example, if the seller originally purchased the property for $150K and then sold it $300K as a seller financed loan, I seriously doubt the seller of a property gave the buyer $300K of their money they already paid taxes on, so the buyer could pay it back in installments.
