No, you don't need to indicate the change of your primary residence.
The Mortgage Interest Limitation applies to the total of your mortgages on first and second homes.
Even if your deduction is limited, you didn't pay much Mortgage Interest on the second home you purchased in November 2019, so it shouldn't affect your return greatly.
Click this link for more info on Deducting Mortgage Interest.
You can review the calculations on the Mortgage Interest Limitation Worksheet.
**Say "Thanks" by clicking the thumb icon in a post
**Mark the post that answers your question by clicking on "Mark as Best Answer"
