This is a great question, and no you should not avoid stucco homes. I am a certified stucco inspector and tester. I see stucco homes every day, and stucco is a cladding that can have a much longer life than products like siding. The thing to know, is that the stucco needs some maintenance. If the stucco is well maintained it will last and not have issues. I would say though, that you should not buy a stucco house without stucco inspection and testing.
Generally, what I see with stucco inspections, is that if the stucco has not been maintained for a long time, problems can occur. The problems tend to be with failure of the substrate and framing rotting, and are not generally identifiable with just a visual inspection. These problems can be very expensive. The good news for you is that typically its an item that once identified, is paid for by the seller. In some cases buyers end up with a brand new exterior of the home, courtesy of the seller.
SO in summary, as long as you get a stucco inspection, and stucco test then problems with stucco homes won't be able to affect your wallet.