You did not owe only half the debt. You and your ex-husband jointly owed the entire amount. The IRS can collect it from either of you in whatever amounts they are able to get.
Responsibility for the outstanding tax debt should have been addressed in the divorce agreement. You might want to discuss the situation with your divorce lawyer.
