Tax on retirement account

I receive income from VA Retirement system and they deduct VA taxes BUT I have moved to S.C. 

they advised me to send letter telling them to stop VA taxes being withheld. However, they will not deduct S.C. taxes. 
what do I do to get back the taxes already withheld and start the deduction for S.C.?