No. You will just have less income to be taxed on when you take a distribution. Or maybe it will go back up.
