Box 6 reports points paid on the purchase of your home, so yes, you go through the interview for mortgage interest, and check the correct choices for paying points on the loan and then enter the amount.
You'll find the interview by typing the words mortgage interest into the Find box on the upper right,
hit enter,
then select the Jump To below.