Changing W4 withholding for both parents w/ newborn

Hello,

 

My wife and I just welcomed our child into the world 1/11, this question is not about filing taxes as she won't count for the upcoming tax return, its about what my wife and I should do on updating our W4's for work. We both work for the same company so I'm unsure if that changes anything, my wife has always claimed 1 and I have always claimed 0. With our new addition to the family should we both add 1 to our W4 for our work or only one of us? I know on taxes only 1 parent can claim the child but I am unsure if it is the same for the W4 withholdings on our paychecks.