State tax filing

I don't have a home in NY - haven't been there longer than a few days since Dec 2019. Not going to pay $3k+ yearly to a city I don't live in... I have protested the refund - just spent an hour on the phone with NY - they didn't seem to know I protested - now they see it and say they have 120 days from the day I protested to respond...