I am not a mortgage professional but your scenario sounds similar to a couple of transactions I have closed recently. If in doubt, shop around. Two things I want to point out/suggest, however:
1.) Only certain towns are eligible for the rural housing program so make sure your buyer's agent knows that is the program you would like to use.
2.) When you do find you dream house, you could always ask the seller to contribute to the closing costs which will reduce your out-of-pocket expense.
Just a few things to think about! Good luck!