Did you have an amount on line 30 of the form 1040? That is the most common issue ... you say you did not get the stimulus payment in advance and the IRS says you did and reduces the refund accordingly.
