Is he your Buyer's agent, or is he a dual agent. By this, I mean: Is your REALTOR the one who listed the builder's house and is now helping you. He could get 6% in that situation. That building fee is a weird one too.
I tend to agree with the previous answers. It does sound a little funny.
I hope this information helps! Best Wishes to you!