Even the high end shouldn't be more than $350-$400 a Sq ft. Contractors have slowed down and are happy to have the work. Some I'm sure would do it for less.
Dave Tap Tapper
If you decide to go this route, you really need to thoroughly vet your plans with the town prior to closing on your lot.