Yes. Changing your W-4 will change the amount of tax that is withheld with the updates for 2020.
If you have state withholding, you can adjust that, too. Click here for the link to state Department of Revenue contact numbers. You would want to tell them you wanted to update your state tax withholding and needed the proper form to report that change.
Your employer should have these forms for you, too.
