@dmertz
@HarleyandJen
Wait a second, let's back up and clarify something.
For 2019 and 2020, did you file a joint return, and did YOU have compensation from working? If you had compensation from working (a job or self-employment) then your spouse can make a spousal IRA contribution from your earned income even if she did not have her own earned income. It would not have been necessary to withdraw the excess, and the way you handle it now will be different (the withdrawal is a done deal, but the tax consequences are different).
If neither you nor your wife had compensation from working, then @dmertz is correct as to your next steps.
HOWEVER, I believe you can just file a form 5329 for 2019 and 2020, reporting the excess and paying the penalty, without actually having to file a full amended return. Is that not the case?
