Unfortunately, the cash that was NOT used for the home is not deductible. No matter when the indebtedness was incurred, you can not deduct the interest from a loan secured by your home to the extent the loan proceeds weren't used to buy, build, or substantially improve your home.
https://www.irs.gov/publications/p936
Closing costs for the refinance
Unfortunately, the closing costs for the refinance cannot be claimed. They are not tax deductible but may increase the cost basis of your home, which can benefit you in the future if you sell your home.
However, you can deduct the below even if rolled into the loan:
For a new loan or refinance, mortgage interest paid (including origination fee or "points"), real estate taxes, and private mortgage insurance (subject to limits) are deductible.
On a refinance, you may need to amortize an origination fee (if paid) over the life of the loan. TurboTax will walk you through this process.
Enter the above expenses in the following areas:
1. Mortgage interest paid: Federal Taxes>Deductions &Credits> Your Home, select Mortgage Interest, Refinancing, and Insurance
2. Points (or Loan Origination Fee): Federal Taxes>Deductions &Credits> Your Home, select Mortgage Interest and Refinancing, and Insurance- (See Did you pay points in 2016 when you took out the loan?) page
3. Real Estate Taxes: Federal Taxes>Deductions &Credits> Your Home>Property Taxes
4. Mortgage Insurance: Federal Taxes>Deductions &Credits> Your Home> Mortgage Interest, Refinancing, and Insurance
