You may be thinking of something different: If you start taking your social security benefit before full retirement age, having too much earned income may reduce the amount of social security benefit you receive in the next year. This reduction goes away when you reach your full retirement age, and does not apply to unearned income.
This is completely separate from the calculation of how much of your benefit is taxable.
