How many exemptions should a working couple claim on a W-4

Our taxes jumped by $4k this year - we suspect that when one of us started a new job we put in withholding wrong. What should a married filing jointly couple enter for exemptions on a W-4?