the family members of the deceased bought out the other party meaning home was sold at a loss but purchase price was split so the party broke even in reality
So, if I understand you correctly, family members inherited the other party's half and bought your half.
Your basis is your half of the entire cost, plus your half of any improvements the two of you made. This amount is subtracted from the sale price (your half of the property). The difference is a gain or loss. Gain is reported on Sale of Home and a loss is not deductible.
The Sec. 121 exclusion of gain on the sale of a residence is available to unmarried joint owners.