Hello, I'm a mortgage professional.
You will need at least a 580 score to qualify.
Many times going from a 500 to a 580 doesn't take a lot of effort. I can take a look at your credit if you would like me to. We have aced it score simulator that shows me how to get your score up quickly in most cases. This costs nothing.
Then once your score is above 580 you would qualify for an FHA loan that only requires 3.5% down payment and allows you to roll closing costs into the loan.
If you have any questions or would like help with this you are welcome to get in touch with me.