Yes, Box 6 on Form 1098 does reflect the amount of Points paid on the purchase of your residence.
After you enter the information from Box 1 and 5 (if applicable) and Real Estate Taxes if on your Form 1098, click Continue.
You will be asked if you took out the loan in 2017. Answering Yes will trigger the Points Paid questions.
You will see a screen that looks like the screenshot below.
You will then be asked if the Points are reported on your Form 1098.
If you indicate they were, you will get a box to enter the amount.