You should increase the cost basis of your house by the costs of improvements, but also reduce the cost basis by all insurance reimbursements.
If you have the insurance company pay costs directly, then those amounts are simply excluded from your cost basis calculation. While the improvement increases your value, the reimbursement decreases it.
