Yes, you can complete a new Form W-4 and change the number of withholding allowances you are claiming. I suggest you use the IRS Withholding Calculator to determine exactly what you should be claiming. To do so, go to:
https://www.irs.gov/payments/tax-withholding