After adding the W2 for my side job where I made about $1300 and didn't have most of the taxes withheld, my return decreased by $700. That is huge. What gives?

Can someone help me understand why the return decreased so much, even considering that I didn't pay most of my taxes on the side job.