I finally figured this out. You need to take your total tax exempt interest as reflected on line 8 of your 1099-INT, subtract the amortized bond perium on line 13 of your 1099-INT and then add to this any tax exempt dividends as reflected on on line 11 of your 1099-DIV. The IRS 1040 instructions explain this well.
