Online Journalism Blog

Avatar

This is a conversation.

adobe photoshop cs2 tryout for mac Buy Premiere Pro CS4 MAC adobe premiere elements forums adobe photoshop cs2 prefences Buy Acrobat 9 Pro Extended adobe premiere elements 2.0 torrent adobe photoshop instructions Buy After Effects CS4 MAC adobe photoshop cs2 serial adobe illustrator serial code Buy After Effects CS4 caterpillar symbol adobe illustrator install adobe creative suite Buy Creative Suite 4 Design Standard adobe photoshop tutorials free adobe illustrator turorial Buy Creative Suite 4 Master Collection for Mac adobe photoshop cs crack mac adobe illustrator graphic styles download Buy Creative Suite 4 Master Collection adobe flash driver adobe photoshop 6 brushes Buy Creative Suite 4 Web Premium basics of adobe illustrator convert adobe illustrator ia jpg Buy Creative Suite 4 Web Standard adobe technote dreamweaver emerging issues mp3 in adobe premiere Buy Dreamweaver CS4 adobe indesign mac student album adobe photoshop product Buy Fireworks CS4 adobe photoshop font adobe photoshop vs corel Buy Flash CS4 Professional academic student adobe illustrator adobe illustrator cs3 crop marks Buy Illustrator CS4 adobe after effects 8.0 system requirements flash lite authoring adobe labs Buy InDesign CS3 adobe fireworks cs3 help on adobe indesign glyph count Buy InDesign CS4 MAC adobe illustrator cs2 crack adobe photoshop cs2 photomerge tutorial panorama Buy InDesign CS4 adobe after effects warez adobe creative suite 3 family pack Buy Photoshop CS3 Extended adobe illustrator cs3 crack serial number adobe premiere with crack Buy Photoshop CS4 Extended MAC adobe fireworks 8 cdkey adobe illustrator cs trial Buy Photoshop Elements 8 free download adobe after effects full free adobe flash player download install Buy Premiere Pro CS3 adobe photoshop cs3 oem

Paul Bradshaw
Something for the Weekend #4: scraping the web with iMacro

March 28th, 2008 by Paul Bradshaw

This week’s Something for the Weekend is a little different, as it’s a tool for newsgathering rather than publishing. But what a tool.

iMacro is a plugin for Firefox, with paid versions for Internet Explorer or standalone use.

There’s a lot of corporate/technical jargon on the website (“create solutions for web automation”), because, like some of the best web tools (e.g. Twitter), this can be used for so many things it’s hard to describe in a single sentence. But here are some of the headlines:

That doesn’t tell us much, so how about some concrete examples from the imacros’ bookmarks page:

  1. View SF Bay Area traffic incidents

  2. Search iMacros User Forum, Wiki and Google

  3. Search in 3 Blog Search Engines Simultaneously

  4. Search Yahoo, Google and MSN at the same time

  5. Replay Zillow.com real estate search

  6. Automate the United States TESS Trademark Search

  7. Update Facebook status without visiting the site.

Now you’re getting the idea.

  • Imagine you have to plough through a number of government database searches to gather the information for a story.
  • Imagine you need to post an appeal for information on a number of forums or blogs.
  • Imagine you need to upload something quickly – or to more than one site – or both.
  • Imagine you create a macro for your readers to conduct their own personalised search – based on a postcode, for instance.

This is one step closer to the semantic web that’s often talked about.

And I imagine the more you use this the more ideas would spring to mind – while the social sharing element of the software means you can benefit from others’ experiences and ideas.

Also worth browsing is the iMacros forum pages, where users talk about what they’re doing.

Have a play with it this weekend and let me know what you think.

5 Comments, Comment or Ping

  1. Aron Pilhofer

    Hey Paul,

    Another tool you might want to look at is Kapow. This is a very high-end software designed specifically to make scraping drag-and-drop simple. The paid version is extremely expensive, but they released a free version here that anyone can use. The only requirement is you have to publish your “scraper” robots to the world, and make it available for anyone to use.

    I don’t use Kapow myself, but I have heard great things about it from colleagues in Denmark, who used it to great effect for their recent investigation of EU farm subsidies.

  2. Love it!!! Great handy tool.

  3. There is also a very useful Wiki page, especially for iMacros for Firefox:
    http://wiki.imacros.net/iMacros_for_Firefox

  4. Tim

    Although I’ve only used iMacros a little bit so-far it looks _really_ cool.

Reply to “Something for the Weekend #4: scraping the web with iMacro”