Fed Penalty withholding only?

Is Fed tax return Penalty determined only by paycheck tax withholding, ignoring Estimated Tax payments although having a net refund?