That's really up to you and the location and lifestyle that you want for your second home. I have several clients who own a single family home as their primary residence-- they love the "lock and go" lifestyle of owning a condo--that way they're only responsible for maintenance, yard work,etc. on one home! Of course, the trade off is the monthly homeowner's dues. But especially if you won't be there that often, I would pick a complex that has a concierge, etc., so that your investment will be secure when you're not there.
Another question to ask is whether you'll be renting this home when you're not using it. Many condo associations have strict rules about rentals (only a certain percetage of rentals are allowed--if the complex is already at their "cap", the only way you'd be allowed to rent is to get on a list for a "hardship rental.) If you buy in a newer building, they will not be at their "cap" yet, but you'll generally have to notify them that you plan to rent the unit.
Best of luck on your purchase--for those with the funds, there's never been a better time to make an investment in another home!