Tennessee & NYS

I am very new to all of this tax stuff.  I live in Tennessee but the company for whom I work issued my W-2 from New York State.  Will I always have to pay taxes to New York State even though I do not live there? If so, how can I reduce my tax liability in New York when I incur no expenses there?