If I decrease the Federal tax on my social security payments, how will that affect my total tax bill?

Current federal tax withholding on my social security is 10%. I'd like to eliminate that amount to zero. Will that affect my end of year tax summary?