I wouldn't say that you can't rent it at all the rest of the year. Vacation rentals are tricky and the best months are Jan-April. Oct-Dec are the second best months but won't garner as much rent as Jan-April. Summer months are difficult for vacation rentals - too hot for anyone but us natives.
Interview a few management companies that specialize in vacation rentals, see what they have to say.