How do I reconcile points I paid on my original rental property mortgage when I refinance? Do I keep them as an amortorized entity or convert it to a rental expense?

Original loan was 3 years ago. I refinanced with a different lender.  Do I keep the remaining amortorized points in place to be deducted over time, or do I stop the amortorization of these points and include the remaining amount this year as a rental expense?