If you used the CAR purchase agreement, there is a provision there for your buyer walk through where in you would determine the property's condition --- is it the same as when you first saw it? Were the expected repairs done? From waht you're saying, it doesn't sound like it.
And...you said you did not remove the loan contingency --- but the loan funded?
If you didn't release your loan contingency and your buyer walk through indicates that said repairs/replacement were not done, and if you want to back out, you may still be able to do so on the basis of non-performance on the seller's part.
First thing you shoud do: review the provisions of your contract, with your realtor, his broker, and possibly a real estate attorney to cover all your bases.