As you add taxable income (in your case, interest income), your federal taxes will increase. You are reporting more taxable income.
When you add your Federal Income Tax withheld on that interest (box 4 on the 1099-INT), that amount will be subtracted from your tax to come up with the tax on your total income.
