Yes you do.
There is no provision under New York tax rules to file Married Filing Jointly when the Federal filing status is Married Filing Separately.
Changing the filing status on your New York return would required other changes as well.
New York State Filing Status
