You can choose to pay the income tax on the amount refunded instead of doing a return of mistaken contribution, and even if you were under age 65 in the year of the distribution that amount will not be subject to a 20% additional tax that would normally apply to taxable distributions. [Corrected]
