If I'm head of household with one child & yearly income is around $32,000, how should my W4 be filled out? They aren't taking out Federal and I don't want to owe IRS.

I currently have $2,500 for my claim dependents, but for some reason they aren't taking out Federal Taxes at my new job.  I want to have a tax return next year, not end up owing the IRS.