Are you sure he didn't file a Joint return with you listed as a spouse? They can't keep your refund for him. Something else is going on or wrong. Like your name and ssn must have been added to that debt at the beginning.
