Then go find a lender to get pre-approved. Pre-approval will (1) tell you how much you can buy and (2) it will make it more likely a seller will accept your offer and (3) the closing is much quicker. There are lots of programs out there for first home buyers. Your lender can help you weigh each of these. Make sure that you calculate the long-term costs of each (including your mortgage insurance if you put down less than 20%).
Once you have this, make sure you create an honest budget to see what you can really afford including taxes, insurance, repairs, utilities. Try to purchase below your budget.
Best of Luck!