The underpayment penalty is calculated by quarter, so even if you make your overall minimum required payment for the year you may still be assessed an underpayment penalty if you didn't make the payments by the quarterly due dates.
Since you made a big payment in the fourth quarter, you were likely underpaid in the first three, which could result in your underpayment penalty.