No, you don't have to limit the mortgage interest deduction on a second home, even if you have two mortgages. As long as the second home is considered a residence and not being rented out, interest on the mortgage is deductible within the same limits as the interest on the mortgage on your first home. Here is a Turbo Tax article that discusses this topic.
@pwillsey4
