This would be correct. DC and VA have a reciprocal agreement, meaning you only need to file a VA state tax return and pay VA state taxes on your DC income.
(The only time you would have to file a DC return is to get a refund of any DC tax mistakenly withheld; since your employer is not withholding DC tax, everything is OK!)