You may qualify for Innocent Spouse Relief even if you have knowledge of errors. The IRS has exceptions to the knowledge limitation for certain situations that can be found in this IRS resource. It will give you all of the information you need regarding Innocent Spouse Relief.