If you took him off and got your return Accepted then when the IRS is done processing it you can file an Amended return.
How to amend a 2020 return
https://ttlc.intuit.com/community/amending/help/how-do-i-amend-my-return/00/27439
