Getting "freaked out" is normal. Almost every first time buyer we work with freaks out at some point. It's such a big endeavor that nervousness is normal. Make sure you are working with an agent you trust who will give you some sound advice.
As far as diversity is concerned, drive through the neighborhood during school bus pick or drop off time. Then you can decide if you are comfortable with the make-up of the neighborhood. And we agree with what Sandy said, check the local enforcement agency to answer any questions about the crime rate.
It is a fabulous time to buy. There are many homes going into foreclosure, rates are great and inventory is plenty.
Good luck Laura!
As Realtors we are not in a position to discuss diversity within neighborhoods.
As far as crime rate, you may want to contact your local law enforcement agency for any questions you may have regarding a specific area.
Good luck to you,
Sandy Shores, Realtor
M & M Real Estate Inc
Residential, Investment & Relocations
Florida's Space Coast
If you are interested in receiving reports on the area that will assist you please contact me.