Deductions & credits

If the contributions were made via payroll deduction, I'm sure they were tax-free because they were not included in your taxable income on your W-2.  And if you contributed after-tax (out of pocket) to an HSA and did not take the tax deduction, that's your fault.  Any money is an HSA is taxable when you withdraw it plus a 20% penalty unless spent on qualified medical expenses.