If box #6 of your mortgage interest statement says 0, then the question doesn't apply to you.

This, from IRS Tax Topic 504, Home mortgage points:

You can deduct points paid for refinancing generally only over the life of the new mortgage.

If you refinanced, then you would spread the points over the life of the new loan.

Here is the entire topic for  your perusal:

Home Mortgage Points