After you file

Not exactly.  Yes you do owe it back.  Your original refund was too big.  Right, neither one of you overpaid into SS but you got a refund for it by mistake.