I answered a similiar question earlier so I thought I would repost for you.
You should look for a homeowners insurance company that has an A rating or better. The rating is a reflection of the companies solvency or ability to pay claims. Your neighbors are also usually a good place to start if you are new to the area. They have probably already been through the struggle of finding an agent and since most agents are always looking for new clients it shouldn't be hard for your neighbor to give you a referral. You can also check with your states enforcement actions to see if your potential new agent has had any problems in the past.