What is Wait Before Execution in Octoparse?
The updated version of this tutorial (based on the latest webpage) is available now. Go to have a check here!
"Wait Before Execution" is a function that allows users to set up a waiting before Octoparse executes some action.
All the actions in Octoparse except "Go To The Web Page" have that option in Advanced Options.
When do I need to set up Wait Before Execution?
1. When Octoparse extracts data or executes the next action when a page opens slowly or does not load completely
In some cases, a page opens slowly but Octoparse executes extracting data as usual. As a result, it extracts no data and finishes the extraction or extracts duplicates before the next page comes out. Setting up waiting time before for action helps the extraction process go well in such a situation.
2. When Octoparse extracts data before the data shows on the page
3. When the website blocks IP that visits it too frequently
Setting up waiting time would slow down the extraction process so as to lower the risk of IP being blocked by a website, which is sensitive to frequent visits.
Note: Please remember to click "Save" after any of setting.