Technically there has not been a direct hit on Merritt Island ever. North Merritt Island (north of 528) has not had a evac order ever. That does not mean you dont get hit by the storms generated by hurricanes but so far I've seen non-hurricane storms that are equally as bad.
We had none for 20-30 yrs since I have been here, and then zap, 10 yrs ago we had 4. No damage to my house. It's quite an experience, no electricity and lots of media coverage and sensational drama. We have been very lucky. Tales are told this is a safe area and that is why Space Center was located