"Have I been doing it wrong all these years?"
Not if you noticed that you are paying tax on the taxable part of those conversions. (Form 1040 Line 4b)
@himanshu983
