Sorry the tax is based on all your income. If you take a Withdrawal it is taxable on your return and may push you into a higher tax bracket and more income can reduce or eliminate some credits you may qualify for and may make more of any Social Security or SSDI taxable.
