After you file

To avoid tax on this conversion, you need to file or had already filed a Form 8606 showing a non-deductible contribution.  See Form 8606 Lines 1,2.

 

OR

 

If you took a deduction for the traditional IRA contribution, that offsets the tax, so it all balances out and there is no reason to amend.

--

Amend with a properly filled out Form 8606 attached and some or all of your tax on that conversion will be refunded.

 

NOTE: Generally, if you already had a balance in IRAs before attempting this, you cannot do it  completely tax-free.

@neekycliffe