Here’s a well-produced (even in rough-cut form) documentary on Wikileaks by Swedish network SVT, published on YouTube in 4 parts. It covers quite a bit of the history of the organisation, the lessons it learned and the partnerships it made along the way – all of which provide valuable insights for any student of journalism as a practice or a cultural form, not to mention a more complex understanding than most coverage of the current situation provides. It really is essential viewing.
Few things illustrate the challenges facing journalism in the age of ‘Big Data’ better than Cable Gate – and specifically, how you engage people with stories that involve large sets of data.
The Cable Gate leaks have been of a different order to the Afghanistan and Iraq war logs. Not in number (there were 90,000 documents in the Afghanistan war logs and over 390,000 in the Iraq logs; the Cable Gate documents number around 250,000) – but in subject matter.
I once heard a journalist trying to put the number ‘£13 billion’ into context by saying: “imagine 13 million people paying £1,000 more per year” – as if imagining 13 million people was somehow easier than imagining £13bn. Comparing numbers to the size of Wales or the prime minister’s salary is hardly any better.
Generally misattributed to Stalin, the quote “The death of one man is a tragedy, the death of millions is a statistic” illustrates the problem particularly well: when you move beyond scales we can deal with on a human level, you struggle to engage people in the issue you are covering.
Research suggests this is a problem that not only affects journalism, but justice as well. In October Ben Goldacre wrote about a study that suggested “People who harm larger numbers of people get significantly lower punitive damages than people who harm a smaller number. Courts punish people less harshly when they harm more people.”
“Out of a maximum sentence of 10 years, people who read the three-victim story recommended an average prison term one year longer than the 30-victim readers. Another study, in which a food processing company knowingly poisoned customers to avoid bankruptcy, gave similar results.”
“”As long as we have reporting that gives the impression to everyone that poor, black folks in these communities don’t value life, it just adds to their sense of isolation,” says Stephen Franklin, the community media project director at the McCormick Foundation-funded Community Media Workshop, where he led the “We Are Not Alone” campaign to promote stories about solution-based anti-violence efforts.
“Natalie Moore, the South Side Bureau reporter for the Chicago Public Radio, asks: “What do we want people to know? Are we just trying to tell them to avoid the neighborhoods with many homicides?” Moore asks. “I’m personally struggling with it. I don’t know what the purpose is.””
“Whistleblowing that lacks salience does nothing to serve the public interest – if we mean capturing the public’s attention to nurture its discourse in a way that has the potential to change something material. “
He is right. But Charlie Beckett, in the comments to that post, points out that Wikileaks is not operating in isolation:
“Wikileaks is now part of a networked journalism where they are in effect, a kind of news-wire for traditional newsrooms like the New York Times, Guardian and El Pais. I think that delivers a high degree of what you call salience.”
This is because last year Wikileaks realised that they would have much more impact working in partnership with news organisations than releasing leaked documents to the world en masse. It was a massive move for Wikileaks, because it meant re-assessing a core principle of openness to all, and taking on a more editorial role. But it was an intelligent move – and undoubtedly effective. The Guardian, Der Spiegel, New York Times and now El Pais and Le Monde have all added salience to the leaks. But could they have done more?
Visualisation through personalisation and humanisation
In my series of posts on data journalism I identified visualisation as one of four interrelated stages in its production. I think that this concept needs to be broadened to include visualisation through case studies: or humanisation, to put it more succinctly.
There are dangers here, of course. Firstly, that humanising a story makes it appear to be an exception (one person’s tragedy) rather than the rule (thousands suffering) – or simply emotive rather than also informative; and secondly, that your selection of case studies does not reflect the more complex reality.
“Avastin extends survival from 19.9 months to 21.3 months, which is about 6 weeks. Some people might benefit more, some less. For some, Avastin might even shorten their life, and they would have been better off without it (and without its additional side effects, on top of their other chemotherapy). But overall, on average, when added to all the other treatments, Avastin extends survival from 19.9 months to 21.3 months.
“The Daily Mail, the Express, Sky News, the Press Association and the Guardian all described these figures, and then illustrated their stories about Avastin with an anecdote: the case of Barbara Moss. She was diagnosed with bowel cancer in 2006, had all the normal treatment, but also paid out of her own pocket to have Avastin on top of that. She is alive today, four years later.
“Barbara Moss is very lucky indeed, but her anecdote is in no sense whatsoever representative of what happens when you take Avastin, nor is it informative. She is useful journalistically, in the sense that people help to tell stories, but her anecdotal experience is actively misleading, because it doesn’t tell the story of what happens to people on Avastin: instead, it tells a completely different story, and arguably a more memorable one – now embedded in the minds of millions of people – that Roche’s £21,000 product Avastin makes you survive for half a decade.”
Broadcast journalism – with its regulatory requirement for impartiality, often interpreted in practical terms as ‘balance’ – is particularly vulnerable to this. Here’s one example of how the homeopathy debate is given over to one person’s experience for the sake of balance:
Journalism on an industrial scale
The Wikileaks stories are journalism on an industrial scale. The closest equivalent I can think of was the MPs’ expenses story which dominated the news agenda for 6 weeks. Cable Gate is already on Day 9 and the wealth of stories has even justified a live blog.
With this scale comes a further problem: cynicism and passivity; Cable Gate fatigue. In this context online journalism has a unique role to play which was barely possible previously: empowerment.
3 years ago I wrote about 5 Ws and a H that should come after every news story. The ‘How’ and ‘Why’ of that are possibilities that many news organisations have still barely explored. ‘Why should I care?’ is about a further dimension of visualisation: personalisation – relating information directly to me. The Guardian moves closer to this with its searchable database, but I wonder at what point processing power, tools, and user data will allow us to do this sort of thing more effectively.
‘How can I make a difference?’ is about pointing users to tools – or creating them ourselves – where they can move the story on by communicating with others, campaigning, voting, and so on. This is a role many journalists may be uncomfortable with because it raises advocacy issues, but then choosing to report on these stories, and how to report them, raises the same issues; linking to a range of online tools need not be any different. These are issues we should be exploring, ethically.
All the above in one sentence
Somehow I’ve ended up writing over a thousand words on this issue, so it’s worth summing it all up in a sentence.
Industrial scale journalism using ‘big data’ in a networked age raises new problems and new opportunities: we need to humanise and personalise big datasets in a way that does not detract from the complexity or scale of the issues being addressed; and we need to think about what happens after someone reads a story online and whether online publishers have a role in that.
A few days ago status updates like this were doing the rounds on Facebook:
“Change your facebook profile picture to a cartoon from your childhood and invite your friends to do the same. Until Monday (December 6), there should be no human faces on facebook, but a stash of memories. This is for eliminating violence against children.”
“This cartoon thing has been set up by paedos using A registered charities name to entice kids. apparently on the 6th dec you will be kicked off fb if u have cartoon pics. The more folk that… put up cartoon pics the harder it is fo…r the police to catch these sickos!!”
In both cases the mainstream media was slow to react to the rumours. A Google search – which would be a typical reaction of anyone receiving such a message – would bring up nothing to counter those rumours. (Notably, perhaps because of its public and real-time nature, Twitter seems better at quashing hoaxes).
Search engine optimisation (SEO) is much derided for a perception that it leads news organisations to write for machines, or to aim for the lowest common denominator. But SEO has a very valuable role in serving the public: if searches on a particular rumour shoot up, or mentions of it increase on social networks, it’s worth verifying and getting up the facts quickly.
This is another reason why journalists should be on social networks, and why publishers should be monitoring them more broadly. Whether your motivations are civic, or commercial, it makes sense both ways.
Her experiences of local government here – and of local journalism – have left her incredulous. Since arriving Hedy has attended every council meeting – she notes that reporters from the BBC and ITV regional news do not attend. Her attempts to get responses to stories from elected officials have been met with stonewalling and silence.
This week – after 7 weeks of frustration – she discovered that the council had called a news briefing about their business plan for consultation with the public on how to cut £300 million in spending – and failed to tell her about it, despite the fact that she had repeatedly requested to be kept informed, and was even stood outside the council offices while it was taking place (and asked directly why TV crews were being waved in):
“At first, [the head of news] told me that it wasn’t a news conference but “a small briefing of regional journalists that we know”. [She] described them as five people, “local, traditional journalists” who were on her “automatic invite list”. She said they were journalists that the press office has been talking to about all aspects of the budget cuts and have “an understanding of the threads of these stories”.
“She also said they were journalists who have talked to Stephen Hughes before and “know where he is coming from”.”
On the other side are press offices like Walsall’s, which appear to recognise that the way that blogs use social media allow the council to communicate with larger, more distributed, and different audiences than their print counterparts.
The issues for balanced reporting and public accountability are well illustrated by Hedy’s experience of calling the press office seeking a quote for a story:
“[I] was told that Birmingham councillors are “important people” (I don’t know what that implies about “the public’s right to know”) and was told to simply write no comment. The refusal by the press office to deal with us has made it exceedingly difficult to cover all sides of the story on our website.”
In contrast Hedy details her experiences in Canada:
“City Council meetings are considered a valuable source of news and attended by most of the local media and not just two print reporters, as they are in Birmingham. Interested citizens show up in the gallery to watch. Council meetings are broadcast live and journalists who can’t attend can watch the proceedings on television along with the general public.
“It is acceptable behaviour to walk up to a politician with your camera rolling and start asking questions which the politician will then answer. If politicians are reluctant to answer questions they are often “scrummed” and wind up answering anyway.
“When major budget announcements are made by the federal government, politicians at every other level of government, as well as interest groups, hold news conferences to provide reaction. Quite often, they go to the legislative chamber where the announcement is being made to make themselves more readily available to journalists (and, of course, to spin).”
Have you experienced similar problems as a journalist? Which local authorities deal well with the online media? I’d welcome your comments.
UPDATE: A response from Birmingham City Council comes via email:
“A Birmingham City Council spokesperson said: “We have proven that Birmingham City Council takes blogging and citizen journalism seriously through the launch of the award-winning http://www.birminghamnewsroom.com online press office.””
UPDATE 2 (Dec 16 2010): Sarah Hartley writes on the same problem, quoting some of the above incidents and others, and suggesting press offices confuse size with reach:
“Let the recently published London Online Neighbourhood Networks study enter the debate. It asked users of the citizen-run websites to identify what they regarded as their main source of local news. The result: 63% of respondents identified their local site as their main source.”
The owner of the shop – DecorMyEyes.com – had boasted on consumer complaint forum GetSatisfaction that:
“The more replies you people post, the more business and the more hits and sales I get. My goal is NEGATIVE advertisement.”
A lengthy New York Times article piece on the issue continues:
“It’s all part of a sales strategy, he said. Online chatter about DecorMyEyes, even furious online chatter, pushed the site higher in Google search results, which led to greater sales.
“… Not only has this heap of grievances failed to deter DecorMyEyes, but as [one consumer’s] all-too-cursory Google search demonstrated, the company can show up in the most coveted place on the Internet’s most powerful site.”
The NYT spoke to the owner, Vitaly Borker, who openly admits “I’ve exploited this opportunity because it works.”
“No matter where they post their negative comments, it helps my return on investment. So I decided, why not use that negativity to my advantage?”
Later in the article, after the reporter has doorstepped Borker, he says he ‘stumbled upon the upside of rudeness by accident’:
“”I stopped caring,” he says, and for that he blames customers. They lied and changed their minds in ways that cost him money, he says, and at some point he started telling them off in the bluntest of terms. To his amazement, this seemed to better his standing in certain Google searches, which brought in more sales.
“Before this discovery, he’d hired a search optimization company to burnish his site’s reputation by writing positive things about DecorMyEyes online. Odious behavior, he realized, worked much better, and it didn’t cost him a penny.”
“We developed an algorithmic solution which detects the merchant … along with hundreds of other merchants that, in our opinion, provide an extremely poor user experience.”
For obvious reasons they don’t give details of the solution.
As an industry, online publishing has gone through a series of obsessions. From ‘Content is King’ to information architecture (IA), SEO (search engine optimisation) to SMO (social media optimisation).
Most people’s view of online publishing is skewed towards one of these areas. For journalists, it’s likely to be SEO; for designers or developers, it’s probably user experience (UX). As a result, we’re highly influenced by fashion when things aren’t going smoothly, and we tend to ignore potential solutions outside of our area.
Content agency Contentini are blogging about the way they use analytics to look at websites and identify which of the various elements above might be worth focusing on. It’s a useful distillation of problems around sites and equally useful as a prompt for jolting yourself out of falling into the wrong ways to solve them.
The post is worth reading in full, and probably pinning to a wall. But here are the bullet points:
If you have a high bounce rate and people spend little time on your site, it might be an information architecture problem.
If people start things but don’t finish them on your site, it’s probably a UX problem.
If people aren’t sharing your content, it may be a content issue. (Image above. This part of their framework could do with fleshing out)
If you’re getting less than a third of your traffic from search engines, you need to look at SEO
News organisations across the country will today be running stories based on a report by Big Brother Watch into the amount spent on CCTV surveillance by local authorities (PDF). The treatment of this report is a lesson in how journalists approach figures, and why context is more important than raw figures.
BBC Radio WM, for example, led this morning on the fact that Birmingham topped the table of spending on CCTV. But Birmingham is the biggest local authority in the UK by some distance, so this fact alone is not particularly newsworthy – unless, of course, you omit this fact or allow anyone from the council to point it out (ahem).
Much more interesting was the fact that the second biggest spender was Sandwell – also in the Radio WM region. Sandwell spent half as much as Birmingham – but its population is less than a third the size of its neighbour. Put another way, Sandwell spent 80% more per head of population than Birmingham on CCTV (£18 compared to Birmingham’s £10 per head).
Being on a deadline wasn’t an issue here: that information took me only a few minutes to find and work out.
The Press Association’s release on the story focused on the Birmingham angle too – taking the Big Brother Watch statements and fleshing them out with old quotes from those involved in the last big Birmingham surveillance story – the Project Champion scheme – before ending with a top ten list of CCTV spenders.
The Daily Mail, which followed a similar line, at least managed to mention that some smaller authorities (Woking and Breckland) had spent rather a lot of money considering their small populations.
A few outlets also repeated the assertions on how many nurses or police officers the money spent on surveillance would have paid for.
The Daily Mail quoted the report as saying that “The price of providing street CCTV since 2007 would have paid for more than 13,500 police constables on starting salaries of just over £23,000”. The Birmingham Mail, among others, noted that it would have paid the salaries of more than 15,000 nurses.
And here we hit a second problem.
The £314m spent on CCTV since 2007 would indeed pay for 13,500 police officers on £23,000 – but only for one year. On an ongoing basis, it would have paid the wages of 4,500 police officers (it should also be pointed out that the £314m figure only covered 336 local authorities – the CCTV spend of those who failed to respond would increase this number).
Secondly, wages are not the only cost of employment, just as installation is not the only cost of CCTV. The FOI request submitted by Big Brother Watch is a good example of this: not only do they ask for installation costs, but operation and maintenance costs, and staffing costs – including pension liabilities and benefits.
There’s a great ‘Employee True Cost Calculator‘ on the IT Centa website which illustrates this neatly: you have to factor in national insurance, pension contributions, overheads and other costs to get a truer picture.
Don’t blame Big Brother Watch
Big Brother Watch’s report is a much more illuminating, and statistically aware, read than the media coverage. Indeed, there’s a lot more information about Sandwell Council’s history in this area which would have made for a better lead story on Radio WM, juiced up the Birmingham Mail report, or just made for a decent story in the Express and Star (which instead simply ran the PA release UPDATE: they led the print edition with a more in-depth story, which was then published online later – see comments).
There’s also more about spending per head, comparisons between councils of different sizes, and between spending on other things*, and spending on maintenance, staffing (where Sandwell comes top) and new cameras – but it seems most reporters didn’t look beyond the first page, and the first name on the leaderboard.
It’s frustrating to see news organisations pass over important stories such as that in Sandwell for the sake of filling column inches and broadcast time with the easiest possible story to write. The result is a homogenous and superficial product: a perfect example of commodified news.
I bet the people at Big Brother Watch are banging their heads on their desks to see their digging reported with so little depth. And I think they could learn something from Wikileaks on why that might be: they gave it to all the media at the same time.
Wikileaks learned a year ago that this free-to-all approach reduced the value of the story, and consequently the depth with which it was reported. But by partnering with one news organisation in each country Wikileaks not only had stories treated more seriously, but other news organisations chasing new angles jealously.
*While we’re at it, the report also points out that the UK spends more on CCTV per head than 38 countries do on defence, and 5 times more in total than Uganda spends on health. “UK spends more on CCTV than Bangladesh does on defence” has a nice ring to me. That said, those defence spending figures turn out to be from 2004 and earlier, and so are not exactly ideal (Wolfram Alpha is a good place to get quick stats like this – and suggests a much higher per capita spend)
“Last year, electoral reform opened the door for politics 2.0 by authorizing parties to use social networks to raise campaign donations and participate in streamlined debates”, claims Manuella Ribeiro about the recent Brazilian election that made Dilma Rousseff the new president.
Ribeiro made a compilation of the best online projects that worked on transparency, civic engagement and public policies monitors. Here are my personal favorites:
Eu lembro: “Be a voter with an elephant’s memory. Vote and remember everything that happens to politicians”.
VotenaWeb: “A site where you can approach the decisions of National Congress that directly affect your life. Vote and be heard”. Citizens can compare, with an easy interface, their votes on bills and the votes of politicians. The congressional bills are translated into simple language and you can monitor the voting records of different candidates.
Quanto vale seu candidato?: in English “How much is your candidate worth?” is a nice piece of data journalism with information about the patrimony of candidates.
Eleitor 2010: developed with Ushahidi to monitor the elections, receive and map complaints about electoral crimes through Twitter, SMS, email and social networks.
Adote um Vereador: encourages citizens to “adopt” a city councilman and open blog about their work to keep an eye on them and their parliamentary activities.
“Let the crowd have the middle of the diamond. Just let it go, our time there is ending. There’s too many of them, they are too fast, they will out man and out maneuver you every time that it matters to them–and if it doesn’t matter to them, I bet there’s not much of a market for it. Just walk away… and watch.”
He finishes by arguing that commercial journalism needs to raise the bar:
“The future of Journalism is not to become public service with the hopes of gratuity, but a professional service with professional expectations and results. If people are going to blogs and the crowd instead of your publications, it’s because your publication is not meeting the expectations of your audience. As a publication you have the choice to evolve to meet those expectations, find a new audience, or leave.”