The taxable amount of you Social Security income is determined by how much other taxable income you have. Above a certain threshold, as you increase the other income more of your Social Security income becomes taxable until it reached the maximum of 85% of your Social Security income being taxable.