As far as the weather goes, the seasons are absolutely beautiful, but if one has not lived in snow before it might take a few winters to learn how to live in it. Having the proper vehicle and clothing makes all the difference in the world. But the good news is that the snow never last for a long period of time. Having been born and raised in PA, this type of winter is easy and totally enjoyable! Summers are beautiful, with temps going into perhpas the high 80's, but cooling down to the high 50's at night. Considering the surrounding HOT communities - it's heaven!
Hope this helped and please know that i'll be glad to help in any way that I can should you need any more information. It just so happens that I'm a realtor in town, and would be glad to help if it happens that you turn out wanting to evaluate Idyllwild more from a home perspective, but know that I will be glad to answer any questions that might come up for you.
Best of luck to you and your family!