Google Search Scraper

📌 What Is Google Search Scraper?

Google Search Scraper collects public Google Search result pages for the queries and filters you enter. Run it as a no-code template in the Octoparse app, or call it as a SERP API through the Octoparse API or MCP server. It returns structured rows with result titles, descriptions, destination and displayed URLs, page and position information, sitelinks, rating fields when shown, and the returned HTML for SEO research, competitor monitoring, content research, and market analysis.

💰 Pricing

Google Search Scraper costs $0.60 per 1,000 output lines. Your total usage depends on the number of result rows produced by the task. This is template-level usage; see Octoparse plan pricing for account-level plans if you are calling this template through the API.

Aperçu de données

📝 Input

These fields map directly to Google's advanced search operators, also known as Google dorks.

• All these words: Enter the main search query. Use one query per line when the task accepts multiple keyword inputs.
• This exact word or phrase: Add an exact phrase in quotation marks.
• Any of these words: Add alternatives with OR.
• None of these words: Exclude terms with a leading minus sign.
• Numbers ranging from: Enter a numeric range with two periods and a unit when needed.
• Search Language: Choose the language of pages to find.
• Interface Language: Set the language of Google's interface.
• Region: Choose the region for the search.
• Pagination times: Set how many result pages to process. The public page states a range of 1 to 30 and a default of 30.
• Last update: Filter pages by the available update period.
• Site or domain: Restrict results to a site or domain.
• Terms appearing: Choose where the terms should appear, such as the whole page, title, URL, or links.
• File type: Filter for formats such as PDF, DOC, PPT, XLS, RTF, or SWF.
• Usage rights: Apply the available usage-rights filter.

📦 Output

Google Search Scraper returns these fields:

• Query and result content: input_params, Title, Descriptipn, HTML.
• URLs: Detail_URL, Source_URL, Displayed_URL.
• Position and pagination: Current_Page, Has_Next_Page, Position.
• Sitelinks: Site_Link_Title1, Site_Link_URL1, Site_Link_Title2, Site_Link_URL2, Site_Link_Title3, Site_Link_URL3, Site_Link_Title4, Site_Link_URL4.
• Ratings when present: Average_Rating, Rating_Count.

Ready to Start Scraping?

Paste your input, hit run, get structured data.

Try It Now - Free Trial

🎯 Use Cases

SEO, marketing, and research teams use Google Search Scraper for any keyword, for example "CRM tools" or "best running shoes 2026", and apply the exported rows to:

• Rank tracking: Compare Position, Current_Page, Title, and Detail_URL across repeated runs.
• Competitor monitoring: Use Displayed_URL, Source_URL, Position, and Site_Link_URL to see which pages appear for a target query.
• Content research: Review result titles and descriptions to understand the pages visible for a topic.
• Site and file discovery: Combine Site or domain, File type, Terms appearing, and Last update to build focused public search datasets.
• Regional search research: Repeat the same query with a selected Region and Search Language to compare public result sets.

🐙 Why Octoparse

• Ready-to-run SERP workflow: Use labelled advanced-search inputs instead of building a browser workflow from scratch.
• Cloud or Local Runs: Run on your device or schedule 24/7 cloud tasks.
• Multiple ways to trigger it: Click Try it! in the Octoparse app, schedule a recurring cloud run, or call the same template as a SERP API through the Octoparse API or MCP server for agent and automation workflows.
• Automatic multi-page scraping: The template pages through results on its own and tracks progress with Current_Page and Has_Next_Page, so you do not need to scroll or click Next by hand.
• Flexible query controls: Combine exact phrases, OR terms, exclusions, site or domain filters, file types, date filters, languages, regions, and result-page depth.
• Structured result rows: Keep result content, URLs, positions, pagination state, sitelinks, ratings, and HTML together for analysis.
• Exportable research data: Review the results in Data Preview and export them to CSV, Excel, or JSON for reporting and downstream work.

🚀 How to Use

1. Create a free Octoparse account, or sign in with email, Google, Microsoft, Apple, or GitHub.
2. Open Google Search Scraper and select Try it!
3. Enter the main query in All these words and add any advanced filters you need.
4. Set Search Language, Interface Language, Region, and Pagination times when they are relevant to your research.
5. Start the task in a supported Octoparse run mode.
6. Review the structured rows in Data Preview and export them as CSV, Excel, or JSON.

⚠️ Limitations

• Google Search results can vary by query, language, region, device, time, personalization, and available SERP modules.
• Pagination times is limited to 1 to 30 pages according to the public page, and deeper coverage may not be available for every query.
• The template collects public result-page data. It does not provide Google Search Console performance data.
• High request volume or repeated queries may trigger CAPTCHA or other access interruptions, so a run can slow down or require a retry.

💡 Tips

• Keep the query, language, region, and Pagination times consistent when comparing runs over time.
• Start with a small query batch and review the first export before increasing page depth.
• Use Detail_URL and Source_URL to distinguish the result destination from the displayed or source domain in downstream analysis.
• Deduplicate repeated exports using the query, URL, page, and position together rather than relying on title alone.
• For a comparison of no-code, Python, and SERP-API approaches to this task, see 3 Ways to Scrape Google Search Results.

❓ FAQ

Can Google Search Scraper process multiple keywords?

Yes. Enter one keyword per line when using the multiple-keyword input flow. Add the advanced search fields to each task according to the input interface.

What types of Google results can I scrape?

Organic results: titles, descriptions, URLs, position and pagination data, sitelinks, and ratings when shown. The template does not extract AI Overview panels, AI Mode answers, or Google Ads Transparency Center listings. Use the Google AIO Scraper, Google AI Mode Scraper, or Google Ads Scraper (by Urls) for those. People Also Ask boxes and Google's own Related Searches suggestions are not available through this template, because it reads Google's basic search page, which does not render those modules. If you want broader topic coverage, enter your own related keyword variations using the All these words/None of these words advanced-search fields as separate runs. For adjacent needs such as Bing results or a lower-cost top-5-only run, see the Related Templates section on this page.

Is there a free version of Google Search Scraper?

Yes. See the related template Google Search Scraper (Free) in the Related Templates section below if you want the advanced-search workflow at no extra cost.

How many result pages can I scrape for one keyword?

You can set Pagination times from 1 to 30 according to the public template description. The page states that the default is 30.

Does Google Search Scraper need a Google API key?

No. The template is designed to simulate browser-based Google searching and the public page says that a Google API key is not required. If you want to trigger this template programmatically instead of through the Octoparse app, you can run it as a SERP API through the Octoparse API or MCP server, which still does not need your own Google API key. For a full comparison of no-code, MCP, and API routes to Google search data, see the SERP API guide.

Is Google Search Scraper the same as Google Search Console?

No. Google Search Scraper collects public SERP snapshots for entered queries. Google Search Console reports performance data for sites you manage.

Can I track rankings for a specific region?

Yes. Set the Region and Search Language inputs to see results as they appear to users searching from that area, useful for local SEO and geo-targeted campaigns.

Can I track ranking changes over time?

Yes. Run the same queries with the same language, region, and page depth, then compare exported Position, Current_Page, Detail_URL, and Title values.

How do I avoid getting blocked while scraping?

Space out requests, limit pages per keyword, use cloud mode for IP rotation, and avoid scraping the same queries repeatedly in a short timeframe. The template includes built-in rate limiting and retry logic.

🔗 Related Templates

See all of Octoparse's search-engine scraper and SERP API templates, or these specific related templates:

• Search Engine Aggregator - combine Google and Bing search-result records in one dataset.
• Google AIO Scraper (AI Overview) - use this when you need Google AI Overview content and cited sources, not organic result rows.
• Google AI Mode Scraper - use this to collect Google AI Mode conversational answers and cited sources.
• Google Ads Scraper (by Urls) - use this to pull advertiser and creative data from Google Ads Transparency Center pages.
• Google Trends Scraper - use this for keyword interest-over-time, regional interest, and related queries.