Inherited money does not get any special tax treatment. The full amount that you took out of the annuity is taxable income, the same as if you made that much money at a job. Apparently the amount that you had withheld for taxes was not enough to cover the tax on what seems to be a fairly large amount of additional income.
