If you are a non-resident you still pay income tax on all US-source taxable income, including bank interest.
