i would think it's best to pay the penalty on or before the due date - make sure the postmark is on or before the due date and I would even suggest using a tracking method. if you pay and the IRS rejects your explanation then additional penalties and interest tack on. If the IRS accepts it, they should refund the payment.
