You are here: Foswiki>Dmi Web>ToolDatabase>ToolGoogleNewsScraper (24 Feb 2015, ErikBorra)Edit Attach
Google News Scraper
Scrapes Google News.
Instructions
The scraper batch queries news.google.com, outputting a table of returns including URL, title, source, date, teaser text, and thumbnail image, .
Enter sources to be queried (optional, one per line, e.g. www.nyt.com), a set of key words (one per line) and a project name for the results file. Select desired number of results per query (default is 100, as greater numbers require multiple scrapes). In the advanced options you can also set a date range for your query, amongst other things.
Optionally, the scraper retrieves thumbnail images attached to each search return.
Enter sources to be queried (optional, one per line, e.g. www.nyt.com), a set of key words (one per line) and a project name for the results file. Select desired number of results per query (default is 100, as greater numbers require multiple scrapes). In the advanced options you can also set a date range for your query, amongst other things.
Optionally, the scraper retrieves thumbnail images attached to each search return.
Sample project
Discover uses of
The Spheres Spheres as way of thinking about the Web Thinking of the Web in terms of spheres refers initially to the name of one of the most well known, the bl...
Issue Animals Research With climate change, animals become endangered. Global warming as well as global cooling threatens the habitat of species, as animals migr...
Course units using this tool
The SpheresThe Spheres Spheres as way of thinking about the Web Thinking of the Web in terms of spheres refers initially to the name of one of the most well known, the bl...
Other projects using this tool
Issue Image AnalysisIssue Animals Research With climate change, animals become endangered. Global warming as well as global cooling threatens the habitat of species, as animals migr...
| I | Attachment | Action | Size | Date | Who | Comment |
|---|---|---|---|---|---|---|
 png |
Apartheid_Wall_and_Security_Barrier_visualization.png | manage | 602 K | 12 Dec 2008 - 12:13 | MichaelStevenson | R. Rogers and A. Ben-David "Coming To Terms" Figure One |
| png |
googlenews_scraper.png | manage | 8 K | 05 Dec 2008 - 14:54 | AnneHelmond |
Edit | Attach | Print version | History: r12 < r11 < r10 < r9 | Backlinks | View wiki text | Edit wiki text | More topic actions
Topic revision: r12 - 24 Feb 2015, ErikBorra
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors. Ideas, requests, problems regarding Foswiki? Send feedback