After you file

Are you just married in 2023?  If not, how have you filed in the past when your husband didn't file?

 

You should speak with the attorney.  In general, if you file a joint 2023 return, you will be equally liable for any income, tax, errors or omissions on that return (2023).  It doesn't automatically make you responsible for past problems, but your "share" of any 2023 refund could be taken by the IRS to offset a previous tax debt.  Whether you might already be responsible for past problems requires more details.