Why am I owing each year

Hello, my husband and I both work. I make more than him. We have no children and no deductions. Ever since we were married 4 years ago, we end up having to pay about $4k in taxes each year. What do I need to do to prevent this? We live in North Carolina