One thing you need to take into consideration is that there is not one rate for all. Rates and fees are often based on your credit score; the higher the score the better the interest rate.
For example-- Hudson Valley Federal Credit Union is offering 4.25% for a 15 year fixed rate loan--but to qualify you must put 20% down and have a FICO score of 740 or better.
Traditionally local banks and credit unions seem to give better rates as they keep the money in the community.
If you want to talk/email one on one on my experiences with banks let me know:
He is offering new contruction in the $340,000 range in a very nice area close to 9W. If you are looking for a buyer's agent to represent you in your quest for a home in the Hudson Valley than you may want to check out my record and call me. At the very least google my name.
Broker at Exit To Green Realty
3584 US Hwy 9W-Highland, NY
Hope that helps.