You don't pay taxes on the value of the redeemed bond.
In the year you redeem the bond, you only report the interest income to the extent you didn't include the interest in income in a prior taxable year.
See this IRS document.