Federal tax withholding is separate from withholding for Social Security and Medicare taxes. The Federal tax withheld is the payment you make towards the tax due on your return. Social Security and Medicare taxes are payments made towards your retirement benefits.