The distributions of the excess contributions for 2017 through 2019 must be made by making a regular distribution of the total excess. As macuser_22 said, since these are not being removed before the due dates of your 2017 through 2019 tax returns, any earnings attributable to the 2017 through 2019 contributions remain in the Roth IRA. The regular distribution will be from the contribution basis added by your 2017 through 2019 contributions, so it will not be taxable.
