This sounds like you lost money on the sale of the house so would not owe taxes whether primary or second home.
