Make sure you indicated in your Federal return when entering your 1099-R, that it was a 'New York State Pension'.
Click this link for more info on entering a New York State Pension.