Married Joint Roth

Got married last year and my spouse contributed to a Roth IRA.  If we file jointly, the contribution is excess as we exceed the cap.  Do we have to report the Roth contribution as there is no deduction anyway?  Short of paying the penalty would we be a candidate to file Married but Separate.