You seem to be answering your own question. You have made several reasons why you should not buy at this time. You also indicate that it is NOT your dream house. "People" may say it is a good investment but are any of them ready to jump in and buy if you don't? You really have to listen to your accountant and your immediate needs rather than the "people."
Now, if you do want to buy the property is the property being offered to you at a fair market value? Is the seller offering financing or do you have to go to a bank? If so, what does the bank say? Do you have the 20% or 30% down payment required for a lender? Does the property qualify for an FHA loan? Do you or your partner qualify for a VA loan? Interest rates are changing so you should talk to the bank right away. Then be sure to hire an attorney to prepare any purchase contract.
Remember it is your life and only you can decide if it is a good investment. Good luck.... more