Filling Out W-4

My husband and I just got married in October and I just got my new SSA card in the mail with my name change. We haven't filled out new W-4s yet. Should I fill one out with my new name, but keep my withholding at single since we are already so far into the year? Or should we both complete married filing status W-4s for the remainder of the year?