I think I finally found it, under self-employment Business Summary, under Other Situations it asks Actively participated in this work which was set to no. I don't think I ever looked at or checked that box. Now that it is checked, it no longer tried to use it with my K-1.
I still don't know why it would select this option and I would not select it unless I misunderstood what it was asking.
