Just the federal tax withholding. Not the SS & Medicare. In fact you can even increase your withholding to cover his self employment taxes and not send it the quarterly estimates. But you probably should keep paying the estimates.
