653 is not great but it is not bad.
FHA financing will go as low as 580 with 3.5% down. Conventional will go down to as low as 620 with 5% down.
What I suggest is you reach out to a loan officer and go over your credit and options for financing and see if a rapid re-score is an option. This way you can see what you would need to do to improve and you can decide what is the best course of action for you.
I would be happy to chat if you have any additional questions. Feel free to email me at firstname.lastname@example.org