it's more complicated than that. it depends on your withholding in relation to your total taxes for 2020.
if you use the standard deduction for 2020, your taxable income would be $82,600 and the federal taxes on that would be less than $10,000
this assumes that your wife's earnings are wages and not Self Employment income and you have no additional taxes or credits. without her $10K the joint tax would be about $8500. so yes your refund will be less because of the taxes on her income without withholding.
what's your philosophy about letting the government hold your money interest free over the course of a year or more?
