When you have them! (just kidding!)
It really depends on whether you want the offer, if you have multiple offers, whether the offers are strong or weak, etc.
Generally, I try to respond to offers promptly - I think it shows respect for the effort made by the buyer and agent. I do know many listing agents collect offers over time and try to cherry pick the best offer to work with.