I had federal tax withheld from my unemployment, so why am I paying even more taxes when filing?

Every time I submitted my unemployment I had federal taxes withheld. I went to file my taxes for last year and they took away even more money. What's going on?