W-4 and Box for Spouse working

[Thain1]

Hello,

My wife and I both work and I make slightly more than she does.  I'm realizing an error on the W-4 where we have never checked the box that we both work.

Will checking this box increase the taxes taken out of each other's paychecks?

I'm finding, since 2020, after paying off mortgage and taking the standard deduction we have owed money since. 

[MaryK4]

Maybe, checking the box will adjust the calculation for the withholding, but it not always (but usually) an increase in withholding.