Are trustee fees I received as a non professional subject to Self Employment Tax

IRS has sent me a letter requesting why my Trustee Commissions listed on line 21 of my 1040 tax return should not be subject to self-employment tax.  I am not a professional trustee and have only one trust from which a receive an annual commission. How do I respond to the letter and am I responsible for the tax?