Or does this mean the annuity is taxed by both countries? (which would be immoral to say the least)

That's not how I read the treaty with South Africa. Perhaps if you can comment on that?

In terms of the tax treaty with South Africa (which was specified in the original question)https://www.irs.gov/pub/irs-trty/safrica.pdfTAX CONVENTION WITH SOUTH...