Non Resident filing?

I live in Vermont. I received unemployment from NY state. Taxes were withheld from my weekly benefits. I have filed both my Fed and VT state returns. Was I supposed to file something for NY state??? Thank You