Can I "give back" a housing allowance to my church employer. By that I mean I wish to be treated as a standard employee and receive no pastoral benefits

With a housing allowance and paying 100% of my FICA and not 50% I actually make LESS money with the housing allowance.