Monthly Archives: February 2013

Hyperlocal Voices: Paul Smith, HU17.net

https://i0.wp.com/humbernews.co.uk/wp-content/uploads/2011/03/hu17.pngThe latest in our Hyperlocal Voices series features the work of Paul Smith at HU17.net.

Over the past five years Paul has built an online presence which enjoys 140k visitors a month, as well as a weekly printing offering which has been running for some years. Continue reading

A sample dirty dataset for trying out Google Refine

I’ve created this spreadsheet of ‘dirty data‘ to demonstrate some typical problems that data cleaning tools and techniques can be used for:

  • Subheadings that are only used once (and you need them in each row where they apply)
  • Odd characters that stand for something else (e.g. a space or ampersand)
  • Different entries that mean the same thing, either because they are lacking pieces of information, or have been mistyped, or inconsistently formatted

It’s best used alongside this post introducing basic features of Google Refine. But you can also use it to explore more simple techniques in spreadsheets like Find and replace; the TRIM function (and alternative solutions); and the functions UPPER, LOWER, and PROPER (which convert text into all upper case, lower case, and titlecase respectively).

Thanks to Eva Constantaras for suggesting the idea.

UPDATE: Peter Verweij has put together an introduction to some other cleaning techniques here.

Online video and audio – a multimedia introduction

Here are a series of videos, audio slideshows and podcasts that demonstrate some key lessons in producing audio and video for the web – and how that is different from broadcast.

Here are a series of videos, audio slideshows and podcasts that demonstrate some key lessons in producing audio and video for the web – and how that is different from broadcast.

http://storify.com/paulbradshaw/online-video-and-audio-a-multimedia-introduction/

2 how-tos: researching people and mapping planning applications

Mapping planning applications

Sid Ryan’s planning applications map

Sid Ryan wanted to see if planning applications near planning committee members were more or less likely to be accepted. In two guest posts on Help Me Investigate he shows how to research people online (in this case the councillors), and how to map planning applications to identify potential relationships.

The posts take in a range of techniques including:

  • Scraping using Scraperwiki and the Google Drive spreadsheet function importXML
  • Mapping in Google Fusion Tables
  • Registers of interests
  • Using advanced search techniques
  • Using Land Registry enquiries
  • Using Companies House and Duedil
  • Other ways to find information on individuals, such as Hansard, LinkedIn, 192.com, Lexis Nexis, whois and FriendsReunited

If you find it useful, please let me know – and if you can add anything… please do.

Motion graphic video workflow – a video tutorial

Motion graphics has become an increasingly popular way to present data in a compelling visual form. In a series of videos guest contributor Sihlangu Tshuma outlines his workflow process for managing a motion graphics video project, the results of which are shown at the end. All 13 videos are also available in this playlist.

1: Motion graphics introduction

2: Researching the project

3: Motion graphics treatments Continue reading

Notes on setting up a regional newspaper datablog

Behind the Numbers - Birmingham's regional datablog

I’ve been working recently with the Birmingham Mail to launch Behind The Numbersa new datablog project with Birmingham City University supported by Help Me Investigate. I’m told that it is probably the UK’s first regional newspaper datablog, although whether that’s a meaningful claim is debatable*.

The first story generated by the project – what is the worst time to be seen at A&E – was published in the newspaper a week ago. But it’s what happens next that’s going to be interesting. Continue reading

Online security for journalists: never assume you’re secure

image from xkcd

image from xkcd

With news last week of the New York Times and Washington Post being hacked recently, The Muckraker‘s Lyra McKee looks at internet security.

“They were able to hack into the computer and remotely access my Facebook account, printing out a transcript of a private conversation. Then they told me who I’d been talking to over the past week and who was on my contacts list. They’d hacked into my phone. When they first told me they could hack into computers and phones, I didn’t believe them. So they showed me.”

I was sitting at the kitchen table of one of Northern Ireland’s few investigative journalists. He was shaken.

In thirty years of reporting, Colin (not his real name) has seen things that would leave the average person traumatized. A confidante of IRA terrorists, he has shaken hands with assassins and invited them into his home for a chat over a cup of tea – as he had done with me that night.

A few weeks previous, during one visit from a source, the subject of hacking had come up. Continue reading

Is this an Excel killer? QueryTree app lowers the bar on data journalism

QueryTree

Sometimes the most impressive tools solve a problem you never knew you had. In the case of QueryTree, a new data analysis tool, that problem is something most people never question: spreadsheets.

For all the shiny-shiny copy-and-paste-click-and-drag-ness in new journalism tools, most data digging comes back to at least some simple spreadsheet work, and that represents a significant hurdle for many journalists used to working with simpler tools.

While interface design has undergone generations of improvement on the web, spreadsheet software interfaces have remained largely unchanged for decades.

So why did no one think to do this before?

QueryTree - how the drag and drop interface works

You only need 10 choices

Continue reading