It depends. Normally the penalty is 25% of the shortfall (the difference between what you should have taken and what you actually took).
If you correct the error within two years (or before the IRS sends you a bill), the penalty is 10%. However, if you can show reasonable cause like a serious illness, a death in the family, or a bank error, the IRS may waive the penalty.