Something for the Weekend #4: scraping the web with iMacro

This week’s Something for the Weekend is a little different, as it’s a tool for newsgathering rather than publishing. But what a tool.

iMacro is a plugin for Firefox, with paid versions for Internet Explorer or standalone use.

There’s a lot of corporate/technical jargon on the website (“create solutions for web automation”), because, like some of the best web tools (e.g. Twitter), this can be used for so many things it’s hard to describe in a single sentence. But here are some of the headlines:

That doesn’t tell us much, so how about some concrete examples from the imacros’ bookmarks page:

  1. View SF Bay Area traffic incidents

  2. Search iMacros User Forum, Wiki and Google

  3. Search in 3 Blog Search Engines Simultaneously

  4. Search Yahoo, Google and MSN at the same time

  5. Replay Zillow.com real estate search

  6. Automate the United States TESS Trademark Search

  7. Update Facebook status without visiting the site.

Now you’re getting the idea.

  • Imagine you have to plough through a number of government database searches to gather the information for a story.
  • Imagine you need to post an appeal for information on a number of forums or blogs.
  • Imagine you need to upload something quickly – or to more than one site – or both.
  • Imagine you create a macro for your readers to conduct their own personalised search – based on a postcode, for instance.

This is one step closer to the semantic web that’s often talked about.

And I imagine the more you use this the more ideas would spring to mind – while the social sharing element of the software means you can benefit from others’ experiences and ideas.

Also worth browsing is the iMacros forum pages, where users talk about what they’re doing.

Have a play with it this weekend and let me know what you think.

Advertisements

5 thoughts on “Something for the Weekend #4: scraping the web with iMacro

  1. Aron Pilhofer

    Hey Paul,

    Another tool you might want to look at is Kapow. This is a very high-end software designed specifically to make scraping drag-and-drop simple. The paid version is extremely expensive, but they released a free version here that anyone can use. The only requirement is you have to publish your “scraper” robots to the world, and make it available for anyone to use.

    I don’t use Kapow myself, but I have heard great things about it from colleagues in Denmark, who used it to great effect for their recent investigation of EU farm subsidies.

    Reply
  2. Pingback: Something for the Weekend #4: scraping the web with iMacro | Web Scraping Monitor

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.