Check your Contract to see if you both cecked/signed the ARBITRATION/MEDIATION clause:
You have two choices at this point:
Give in, do the work and keep the sale, or,
Let him walk and keep the Deposit if you can.
It is as simple as that:
How badly do you want to keep this deal?
Good luck and may God bless