Good evening Deandra.
Even though there are a lender or two that may deal with a 580 fico, it would be a great help to have that score brought up to the 620 mark if possible. I would suggest checking your credit report on all three bureaus and see what you can do to bring it up.
Even with a lender who would do an FHA loan with 3.5% down and a 580 fico, the offers would probably scare off most banks from accepting your offer. An example would be that if you had several identical offer amounts, all fha at 3.5% down, the bank would probably consider the highest credit scores above those offers whose buyers were lower due to a lower perceived risk factor.
However, check to see what is out there and what might work best for your situation.
If i can help you in any way, please feel free to call or email me.
Axiom Real Estate / Axiom Lending