One of my employers did not withhold my federal taxes. Is that something I can challenge to keep from paying them myself?

I was employed with a school district for one month. They made me repay their part of my benefits and now I have the W2 showing no federal taxes were withheld.