I have a letter from IRS removing a failure to pay penalty after I paid the penalty. Do I take a credit for penalty paid?

No, but the IRS will either send you a check for the penalty removed or refund it when they process the next tax return that you file.