What is Wait Before Execution in Octoparse?
The updated version of this tutorial (based on the latest webpage) is available now. Go to have a check here!
"Wait Before Execution" is a function that allows users to set up a waiting before Octoparse executes some action.
All the actions in Octoparse except "Go To The Web Page" have that option in Advanced Options.
Click Item
Loop Item
Extract Data
Enter Text
Switch Dropdown
Branch Judgment
Cursor Over
When do I need to set up Wait Before Execution?
1. When Octoparse extracts data or executes the next action when a page opens slowly or does not load completely
In some cases, a page opens slowly but Octoparse executes extracting data as usual. As a result, it extracts no data and finishes the extraction or extracts duplicates before the next page comes out. Setting up waiting time before for action helps the extraction process go well in such a situation.
2. When Octoparse extracts data before the data shows on the page
Sometimes the pages are designed not to show the data directly but load the data with JavaScript after the page opens. Octoparse may report extraction failure in such a case as it will start extracting right after the page opens. Some waiting time before extracting action would help load the data completely and extract them successfully.
3. When the website blocks IP that visits it too frequently
Setting up waiting time would slow down the extraction process so as to lower the risk of IP being blocked by a website, which is sensitive to frequent visits.
Note: Please remember to click "Save" after any of setting.