Assuming your brother's trust is an Irrevocable Trust, then the trust should have its own Federal ID # that it is reported on, not your ssn and name. You should get that changed.
Yes, you can manually enter the ones that are applicable to your individual income tax return instead of automatically downloading all of them.
You really should have his trust accounts in their own EIN