Absolutely, there are a bunch of us locals out there! Have lived here for 35 years and have loved every minute of it. It is a fabulous community with an excellent school system. There are lots of things to do, with programs for the children, ranging from the arts, to music to sports. It is a so much healthier place to raise children in! Our community just completely the most amazing project - building a huge playground from scratch with all volunteer help. It took five days and went from seven in the morning until eight at night, with three meals a day provided, and a free glass of wine at the local wine tasting place for anyone who had a name tag from that day. I particularly enjoyed that :-)!
As far as the weather goes, the seasons are absolutely beautiful, but if one has not lived in snow before it might take a few winters to learn how to live in it. Having the proper vehicle and clothing makes all the difference in the world. But the good news is that the snow never last for a long period of time. Having been born and raised in PA, this type of winter is easy and totally enjoyable! Summers are beautiful, with temps going into perhpas the high 80's, but cooling down to the high 50's at night. Considering the surrounding HOT communities - it's heaven!
Hope this helped and please know that i'll be glad to help in any way that I can should you need any more information. It just so happens that I'm a realtor in town, and would be glad to help if it happens that you turn out wanting to evaluate Idyllwild more from a home perspective, but know that I will be glad to answer any questions that might come up for you.
Best of luck to you and your family!