Should I file a Virginia tax return if I did not live in the state in 2020, however, they took taxes from my military retirement?

Yes. If they took taxes, either they:

• should not have and you get a refund or
• should have and your resident state will give you a credit.