I don't understand why you have a penalty? Is it a bank penalty or IRS penalty? If you took it all out that would have been more than the RMD. You don't pay a penalty for closing an IRA if you are over 59 1/2. Or do you just mean the regular tax on it was a big increase? @dmertz
