The penalty is calculated on your return, nothing additional is done by the IRS or you. You may look at Form 1040, line 59... it will show penalty./ since you are getting a refund, it simply means that your tax withheld and your deductions/credits covered the penalty...
