Assuming that the house is sold soon after his death all of the proceeds are tax free since the cost basis of the home is its value at the time of his death and inheritance is not taxed. The IRS would impute interest to you if it were a non interest loan but that income to you would be considered a gift since it was a family loan. The amount of the gift would be less than the $16,000 annual gift exemption since the imputed interest rate wound less than 2%. So there are no tax implications for the loan.
The loan would be a liability for his estate so you would receive your $95,000 from his total estate and then you would receive your share of the home sale.
Your purchase of the home is an issue between your and your siblings.
