well, with FHA you may have little or no closing costs vs a conventional.
How long will you be in the home?
There's quite a few side-by-side comparisons for FHA and Conventional loans.
6.125% is pretty good. to effectively pay it down, see if you can pay in bi-weekly payment and the lender apply it right away to reduce the nominal interest.