did you get a closing statement for the refi? that should show the new loan amount and the old loan balance paid off.
Were all loan proceeds used to purchase, build, or improve the home secured by this loan?
I don't know what to answer if you didn't take cash out then you didn't do any of the items mentioned so answer "NO"