Tag Archives: Dan Wainwright

2018 has been a good year for UK local data journalism — here’s the story so far

Local data journalism in the UK has been undergoing a quiet revolution in the last 12 months, but 2018 in particular has seen a number of landmarks already in its first few months. Here’s some of the highlights in just its first 12 and a half weeks…

January: BBC Shared Data Unit publishes its first secondee-led investigation

The BBC Shared Data Unit had already been producing stories before in late 2017 it took on its first three-month secondees from the news industry. Over the next 12 weeks they received training in data journalism and work on a joint investigation. Continue reading

How the BBC England data unit scraped airport noise complaints

heathrow-noise-story

This news story used scraping to gather data on noise complaints

BBC England Data Unit’s Daniel Wainwright tried to explain basic web scraping at this year’s Data Journalism Conference but technical problems got in the way. This is what should have happened:

I’d wondered for a while why no-one who had talked about scraping at conferences had actually demonstrated the procedure. It seemed to me to be one of the most sought-after skills for any investigative journalist.

Then I tried to do so myself in an impromptu session at the first Data Journalism Conference in Birmingham (#DJUK16) and found out why: it’s not as easy as it’s supposed to look.

To anyone new to data journalism, a scraper is as close to magic as you get with a spreadsheet and no wand. Continue reading