Search Engine Scraper

Search Engine Scraper


The Search Engine Scraper allows you to scrape the search results for a given search query, and has as output a list of results the search engine returned for the query. You can choose which search engine you want to scrape; this allows comparison between search engines and what results they return for the same query. In this there is some overlap with the Lippmannian Device, which also scrapes search results, but has the additional feature of offering a comparison of results within a particular site. If the per-site search is not required for your analysis, this tool - the Search Engine Scraper - will likely be easier to use.

Other projects using this tool

Things Internet Researchers Should Know About Google
Things Internet Researchers Should know About Search Engines This page lists useful tips for doing research with search engines, particularly in combination with ...
Tool Google Scraper How To
The Google Scraper has been deprecated and replaced by two new tools: * The Search Engine Scraper, if you want to scrape and analyze overall search results for...
Tool Lippmannian Device How To
The Lippmannian Device queries a search engine of your choice and makes the results available for further analysis. In the top text box, place the source set, in ...

Topic revision: r1 - 24 Sep 2018, StijnPeeters
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback