How do I prevent my total annual employer HSA contributions from being counted as taxable income on my CA non-resident tax returns? I only worked in CA for 3 days.

I worked in CA for 3 days this year, and my annual total for employer HSA contributions is being automatically applied as taxable income for CA.