Because one of you (spouses) has Family coverage, then the IRS considers that both of you have family coverage.
To quote the IRS: "In the case of individuals who are married to each other, if either spouse has family coverage, both are treated as having family coverage." (IRS Notice 2004-2).
This sets the contribution limit to the family limit.