Yes, you can file jointly if you are "considered married".
You are considered married for the whole year if, on the last day of your tax year, you and your spouse are living together in a common law marriage recognized in the state where you now live or in the state where the common law marriage began.