To get the exclusion to work correctly, try selecting US Government (Including Military) instead of New York State and Local Retirement System (NYSLRS).
Other users have encountered this issue and found that their NYS pension was correctly treated (tax-exempt for BY) selecting US Government (Including Military) as the answer to "Where did this distribution come from?"
