No, don't include your housing allowance.
According to Housing Allowance on the IRS's Topic No. 417 Earnings for Clergy page, excludible housing expenses include rent, mortgage interest, utilities, and other expenses directly relating to providing a home. The amount excluded can't be more than reasonable compensation for the minister's services.
A clergy member receiving a housing allowance is allowed to exclude the allowance from gross income, to the extent it's used to pay expenses in providing a home.