You just pay the difference. Your only penalty would be if you did not have sufficient withholding and estimated payments to cover your tax liability.
