Is there a limit to the number of times that I can claim refi points as a tax deduction?

In 2020 I refinanced the mortgage on my home and paid points.

 

I am now in the process of refinancing my mortgage again in 2021 since I am now able to obtain a much lower interest rate.

 

I plan to deduct the amount that I will be paying in points on my 2021 tax return & will also be deducting the amount that I paid in points when I amend my 2020 tax return.

 

Before I do this I need to be sure that I will be able to claim this points paid tax deduction in both my 2020 & 2021 tax returns based upon the amount that I paid in points both years.

 

Will I be able to claim this deduction for both years?