Update: from when I originally posted this thread to now I never received the penalty from then IRS. All I did was attach a letter to my tax returns explaining the situation and evidence I that I took them immediately when the mistake was realized and I have never heard from them since.
