If i owe the IRS for unemployment can i still get my whole refund?

I need to dispute a claim against me from the IRS for about 700. I was unemployed and took a job for a single day at Dominos pizza as a driver. I never received a check from Dominos and i still took my unemployment. The IRS sent me a letter in the mail saying i owed them the unemployment money and i never got around to calling them to dispute it. Are they going to take it out of the tax return i filed or will i get my full refund? the amount is just enough to cover the whole thing but i need to dispute this because i needed the money and was not working but for a day. im just wondering if anyone else has had this happen to them before. its not for previous years i owed taxes its just for an unemployment thing.