Alot would depend on how large your lot is. If you have enough buildable land (outside wetlands) to provide for your home, an adequately sized yard - comparable to your neighbors for entertaining, etc. I don't see wetlands as a big negative. You, of course need to make sure that the area that the house would be built on is not in a floodplain, as that can have a huge effect on your insurance costs.
We purchased 4 acres of land 3 of which were DNR protected wetland., several years ago and built a home on it. 1 Acre was outside the wetlands, and provided a wonderful yard. When a job transfer required us to sell- we litterly had an offer for more than asking the 1st day. The Buyer told us it was because of the privacy of the wetland that they purchased the home.
So, some people may see it as a positive factor, but others may not. Good Luck!