Yes, if you have contributed more than your annual limit to all your IRAs, you need to have the custodian return the money to you, and any earnings associated with it.
The IRS charges taxpayers an over-contribution penalty if they contribute more than the annual maximum.
