State tax filing

Yes. 

Based on what you're saying, the employer's W-2C isn't correct.

Contact them again and explain the issue.  They need to issue another W-2C with no state income but with state tax withholding.