I abandonned my home under construction as it did not turn out as expected. Can I claim the down payment as a financial loss?

I paid a down payment to the contractor to build my new primary residence.  There were some major disagreements relevant to how the construction was turning out and I refused to continue making payments. The contractor refused to reimburse me  the funds already paid out.  Can I claim those funds as a loss?