That depends on your income and your tax owed. You will generally owe a penalty if you owe more than $1000 when you file your tax return, unless the amount you pay into the system (from withholding and estimated payments) is equal to or more than your tax liability from last year.