You can only deduct the amount that they mortgage company actually dispersed (paid on your behalf).
You can also deduct any interest from the settlement statement that are not already reported on the Form 1098 and not "pre-paid" and held in escrow. This would be pro-rated amounts from the date you closed escrow until your first payment was due.
Additionally, you can deduct qualified points paid on a mortgage and qualified mortgage insurance premiums. (Points can also be called loan origination fees, maximum loan charges, discount points, or loan discount.)