No, the amount owed is paid only once. The IRS sends letters to both to make sure both spouses know about the liability because, on a joint return, each of you is liable for the full amount. If they only send a letter to one spouse, it's possible that spouse would not pay the tax and would also not tell the other spouse about owing the money.
