That can happen. You owe tax on all your income. Did they take out any withholding from your unemployment?
