I can relate to your frustration, but unfortunately, unless you can prove damages, you have no grounds to sue. You would have to prove that your home was on the market and you lost a sale or have been offered less money solely as a result of the eyesore nextdoor. As you can imagine, it's tough to prove.
As far as the town is concerned, unless there is a violation of the permit, not likely they will do anything. Sometimes permits have deadlines, but it's usually simple to get an extension, especially in the current economic environment.
You can try appealing to the builder (very politely) and maybe he will install the doors sooner than planned and remove the excess dirt piles. Try bringing him coffee and donuts when you make the appeal.
As far as long term goes, I would agree with my colleagues. Chances are the new home will actually enhance the value of yours when you're ready to sell. And with any luck, you'll have a really nice new neighbor.