We are getting call after call from people that have had their bank pull out of a construction loan, and we have been able to help. It almost seems like banks want these loans off their books, and will do about anything to get them off! There are lots of legal questions, and you do need a lawyer to help with them. You are more than welcome to give me a call, we have people that are lending their own money out on good deals, and if your deal is good, we can get you back on track with your builder within weeks.
You can talk to your broker and see if he has anyone looking to make interest on your deal or if they have a hard money lender that will step in and help you out. This type of loan will get your home done so you can get it refinanced into a more conventional loan, and get moved it.