Comments on: An introduction to data scraping with Scraperwiki http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/ A conversation. Sat, 11 Feb 2012 08:45:01 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Make the Most of Free Data – How to Be a Data Journalist « PC’s Pixels and Posts http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/#comment-15841 Make the Most of Free Data – How to Be a Data Journalist « PC’s Pixels and Posts Fri, 11 Mar 2011 23:44:05 +0000 http://onlinejournalismblog.com/?p=8870#comment-15841 [...] 4. Mashing the Data. It also introduces you to some useful tools like Freebase Gridworks and ScraperWiki. The Guardian also has a very neat Blog where it features Data Journalism [...] [...] 4. Mashing the Data. It also introduces you to some useful tools like Freebase Gridworks and ScraperWiki. The Guardian also has a very neat Blog where it features Data Journalism [...]

]]> By: Competitività e crescita con i dati liberati http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/#comment-15840 Competitività e crescita con i dati liberati Sun, 13 Feb 2011 13:35:15 +0000 http://onlinejournalismblog.com/?p=8870#comment-15840 [...] per un contesto un po’ diverso, ma utile per la comprensione del tema, come quello dell’Open Journalism (link che suggerisco agli appassionati Pier e [...] [...] per un contesto un po’ diverso, ma utile per la comprensione del tema, come quello dell’Open Journalism (link che suggerisco agli appassionati Pier e [...]

]]> By: Competitività e crescita con i dati liberati | Webeconoscenza http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/#comment-15839 Competitività e crescita con i dati liberati | Webeconoscenza Sun, 13 Feb 2011 13:30:39 +0000 http://onlinejournalismblog.com/?p=8870#comment-15839 [...] per un contesto un po’ diverso, ma utile per la comprensione del tema, come quello dell’Open Journalism (link che suggerisco agli appassionati Pier e [...] [...] per un contesto un po’ diverso, ma utile per la comprensione del tema, come quello dell’Open Journalism (link che suggerisco agli appassionati Pier e [...]

]]> By: How to scrape webpages with Scraperwiki | Online Journalism Blog http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/#comment-15838 How to scrape webpages with Scraperwiki | Online Journalism Blog Sun, 19 Dec 2010 08:13:24 +0000 http://onlinejournalismblog.com/?p=8870#comment-15838 [...] Watts on An introduction to data scraping with ScraperwikiFitzroyalty on Hyperlocal voices: Brian Ward, Indolent Dandy (Fitzroy, Melbourne)Horace Major on [...] [...] Watts on An introduction to data scraping with ScraperwikiFitzroyalty on Hyperlocal voices: Brian Ward, Indolent Dandy (Fitzroy, Melbourne)Horace Major on [...]

]]> By: Matthew Watts http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/#comment-15837 Matthew Watts Sun, 19 Dec 2010 04:20:33 +0000 http://onlinejournalismblog.com/?p=8870#comment-15837 I agree, scraping data has so many uses. It's especially useful if you know of a few places you want to keep a watch on, but only want pieces of the data. You can then merge the data from multiple places and store in a database to output later. Like you said - this type of sorting is especially useful for journalism. - @csharpp: XPath is hardly useless and actually speeds up scraping data while also allowing you many more options. If you aren't the programing type, then maybe it isn't "useful" to you, but it is far from "useless". I wrote a tutorial for <a href="http://www.matthewwatts.net/tutorials/php-tutorial-2-advanced-data-scraping-using-curl-and-xpath/" rel="nofollow">Advanced Data Scraping Using cURL and XPATH</a>, you'll see that it's quite simple to sort multiple bits of information that can be stored in a database. I agree, scraping data has so many uses. It’s especially useful if you know of a few places you want to keep a watch on, but only want pieces of the data. You can then merge the data from multiple places and store in a database to output later. Like you said – this type of sorting is especially useful for journalism.

-

@csharpp: XPath is hardly useless and actually speeds up scraping data while also allowing you many more options. If you aren’t the programing type, then maybe it isn’t “useful” to you, but it is far from “useless”.

I wrote a tutorial for Advanced Data Scraping Using cURL and XPATH, you’ll see that it’s quite simple to sort multiple bits of information that can be stored in a database.

]]> By: csharpp http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/#comment-15836 csharpp Wed, 22 Sep 2010 21:16:56 +0000 http://onlinejournalismblog.com/?p=8870#comment-15836 Try <a href="http://www.scrapepro.com" rel="nofollow">ScrapePro Web Scraper Designer</a> instead of the useless XPath method. Try ScrapePro Web Scraper Designer instead of the useless XPath method.

]]> By: ScraperWiki, Hacks and Hackers - fromCONCENTRATE http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/#comment-15835 ScraperWiki, Hacks and Hackers - fromCONCENTRATE Thu, 22 Jul 2010 23:06:05 +0000 http://onlinejournalismblog.com/?p=8870#comment-15835 [...] running, storing and sharing web screen-scrapers and their resulting bounties of data.  (Here is a handy introduction to ScraperWiki by Paul Bradshaw.)  I was lucky enough to encounter ScraperWiki right at the very beginning when Julian Todd and [...] [...] running, storing and sharing web screen-scrapers and their resulting bounties of data.  (Here is a handy introduction to ScraperWiki by Paul Bradshaw.)  I was lucky enough to encounter ScraperWiki right at the very beginning when Julian Todd and [...]

]]> By: What could a journalist do with ScraperWiki? A quick guide | Scraperwiki Data Blog http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/#comment-15834 What could a journalist do with ScraperWiki? A quick guide | Scraperwiki Data Blog Fri, 16 Jul 2010 11:17:35 +0000 http://onlinejournalismblog.com/?p=8870#comment-15834 [...] Anna Powell-Smith took ScraperWiki to the Midlands, and taught Paul Bradshaw’s MA students at Birmingham City University the basics. Paul has written up some notes at this link. [...] [...] Anna Powell-Smith took ScraperWiki to the Midlands, and taught Paul Bradshaw’s MA students at Birmingham City University the basics. Paul has written up some notes at this link. [...]

]]> By: L’opendata dans tous ses états – Juillet II « http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/#comment-15833 L’opendata dans tous ses états – Juillet II « Mon, 12 Jul 2010 12:48:08 +0000 http://onlinejournalismblog.com/?p=8870#comment-15833 [...] An introduction to data scraping with Scraperwiki [...] [...] An introduction to data scraping with Scraperwiki [...]

]]> By: Ed Walker http://onlinejournalismblog.com/2010/07/07/an-introduction-to-data-scraping-with-scraperwiki/#comment-15832 Ed Walker Wed, 07 Jul 2010 21:39:11 +0000 http://onlinejournalismblog.com/?p=8870#comment-15832 This was a really useful post, thanks Paul. I'm going to the ScraperWiki event in Liverpool next week and really looking forward to learning lots. This was a really useful post, thanks Paul. I’m going to the ScraperWiki event in Liverpool next week and really looking forward to learning lots.

]]>