W2 shows state income for a state that I didn't work or live in

I received a W2 that is showing NJ and NY income.  I lived and worked in NY all year long.  There is $4 of NJ tax withheld showing on my W2.   Do I have to file a non-resident NJ return to show that or can I just forego the $4 refund?