The innocent spouse procedure only applies if the debts were incurred by your spouse before your marriage. If the debts were incurred during your marriage, you are stuck with them by law. If you file a joint return, or filed joint returns before while you were married, you agreed to be jointly responsible for all tax matters.
There are only two ways to get out of tax debts that your spouse owes from during the marriage. One is to file as married filing separately. (This may have other negative consequences, of course.) The other is to get a divorce, and then file an injured spouse form, in which you claim that you should not be responsible for marriage debts because your spouse did something behind your back. You can't file the injured spouse form until you've been divorced at least a year.
If the debts are from before the marriage, you should qualify. Run the interview again and check your answers.
