Each IRA only has one owner, there are no joint IRA accounts, and the rules apply individually to each owner. Sorry, you owe the penalty on the other $10,000, and it's too late to make a correction to your accounts.
