It only matters to the buyer because they are paying for the inspection. If you as a seller decided to cancel the contract before the end of attorney review, the buyer is out the inspection $$.
Read your contract...buyer has a time frame to perform an inspection. I usually don't think it's a good idea to until AR is completed for the above reason, , BUT buyer or seller can void contract after inspection even after AR is concluded if certain contractual stipulations regarding inspections aren't met. .
If the closing is a fast closing (30 -45 days or so), then sometimes it's smarter to just get everything done ASAP.
If yu are selling the house AS IS, then it's smart for the buyer to to the inspection ASAP also, so they can see if there are problems so bad that they might want to cancel the contract.
Speak to your agent too, to have him/her explain the process and the various scenarios to you.