You would be penalized if you don't fall under one of the three exceptions I stated above. It is a "pay as you earn" system. The easiest way to prevent this is by paying at least the amount of tax liability for the prior year (which would be this year's taxes) as I stated above.
