Assuming your "medical annuity" (structured settlement?) is indeed nontaxable, it does NOT go towards income for Social Security taxation. The thresholds for SS taxation are based on your AGI without SS, plus one-half of your SS; nontaxable, non-SS "income" is excluded from AGI.
