Get your taxes done using TurboTax

A debt that was only his from before the marriage should not become your debt after his death.  If he owed money to the state for unemployment, the state will just have to do without.