Any time after the days required to respond has expired by either party you can decide to walk away or continue with the purchase of the property.
It is clearly explained on the Home Inspection and Radon Testing Addendum
Out of curiousity, isn't the five day inspection period contingency the timeline for both you and the seller to agree about the home inspection? That is how it works in my market. The time period agreed to for the inspection/remedy is outlined in writing and applies to both the buyer and seller.
Diane Wheatley, Broker
Move Up Properties Real Estate Brokerage
I wish you well.
Inspection Specialists for 24 years