Do I have to pay tax on social security benefits?

If social security is my only income, do I have to pay tax on it?