Tag Archives: crowdsourcing

Combating the digital divide in the developing world with mobile phones

1 Reply

Last week, the Guardian reported on a few promising citizen journalism projects in Africa that use mobile phone technology effectively to not only communicate with people but to also allow the audience to contribute to newsgathering. As opposed to the excessive – and even frivolous – growth of smart phone applications in the Western world, mobile phones in developing countries, which are nowhere near as sophisticated as ones in America and Europe, are being used as a reliable proxy for high-speed Internet access to perform basic functions, such as paying grocery bills and delivering medicines. Cell phone companies have bought into this as well, developing cheap, reliable phones with ease of use and practical functionality.

The Ushahidi crowdsourcing project that the Guardian article elaborates, is perhaps one of the best known and most successful mobile journalism exercises in Kenya. Ushahidi–which means “testimony” in Swahili–attempts to gather as much information from the public as possible and then verify this collected data with the help of computer and human confirmation. Launched during the post-election violence in Kenya in 2008, Ushahidi has since been implemented worldwide — from monitoring unrest in the Congo, tracking violence in Ghaza, to reporting on the Indian elections earlier this year.

The project allows people to contribute in the form of simple text messages, photos and video delivered through smartphones, or reports submitted online; this is posted in real time to an interactive map, accessible directly through smart phone technology. This information can also be converted to formats that are readable in various communities by news organizations in developing countries. The technology itself is open source, so anyone can help enhance and develop it. In order to verify the accuracy of information obtained in the case of breaking news events, Ushahidi has also launched the Swift River Project, which helps voluntary participants worldwide to separate good information from ‘noise,’ or in the team’s own words, in “crowdsourcing the filter.”

Basically, the way it works is that once the aggregated data comes in through multiple streams, be it Flickr, Twitter, or Ushahidi, people can go in and rate the data – the information is thus verified by the sheer power of numbers, as in any crowdsourcing project. In addition, the information is filtered through machine-based algorithms to confirm accuracy. Ushahidi used a similar method to track the Indian elections earlier this year through VoteReport.in. In India, “moblogging” or microblogging, made possible through the explosive popularity of cell phones, has been growing for the past few years. Sites like smsgupshup.com and Vakow.com – Indian versions of Twitter – allow people to disseminate 160-character messages to groups, enabling amateurs to deliver personalized, customized news through sms messages. This makes up for the relative lack of interactivity from mainstream Indian news organizations.

Cell phones as tools for information dissemination are particularly valuable in countries like Zimbabwe where radio transmission is often blocked. Text messages can allow an uninterrupted flow of information in such cases. The Guardian‘s Activate 09 project sends out headlines to tens of thousands of citizens in the Southern African country through sms messaging. In addition, the paper has been crowdsourcing ideas from its global audience on the different methods available to reach thousands of people during breaking news events.

The Grameen Foundation, a global nonprofit, has partnered with Google and a Uganda-based telecommunications provider MTN, to answer important queries sent in by residents via text messages; questions range from clarifications about deadly diseases to agricultural problems. In Kenya, RSS feeds from the Internet are fed into mobile phones to educate and inform people, and text-to-speech tools that convert sms messages into audio files are helping the visually impaired. Some Western companies are encouraging Kenyans to take part in crowdsourcing projects in return for micropayments. Citizens perform small tasks such as transcribing audio and tagging photos for small sums of money. The BBC is now providing English language learning capabilities in Bangladesh through cheap audio and SMS lessons through a partnership with mobile service providers.

Despite the availability of hi-speed Internet access in Western countries, the versatility of the cell phone as a vehicle for citizen journalism is very special indeed. The ability of a phone to provide real-time, on-the-ground coverage is undisputed, whether you see an unusual occurrence on the street on your way to a mall in Los Angeles or witness a riot in a displaced community in Darfur.

How much local council coverage is there in your local newspaper? – help crowdsource the answer

1 Reply

Are local newspapers really wimping out on council coverage? Sarah Hartley would like you to help her investigate council coverage in local newspapers:

“After responses to the debate about council “newspapers” prompted so many comments … about local papers dumbing down and failing to cover civic issues at the expense of celebrity trivia, I suggested on this blog carrying out some sort of a survey to see whether that was truly the case.

“This alleged withdrawal of bread-and-butter reporting hasn’t been my experience of working on regional papers in northern England and Scotland, but, maybe times have changed or other regions have different stories to tell?”

Sarah’s investigation began on her blog with the Darlington & Stockton Times (of 7 eligible pages, the equivalent of 2 are concerned with local council stories) before I suggested she use Help Me Investigate to crowdsource the research.

If you’d like to help and need an invite contact Sarah, leave a comment here, or request an invite on Help Me Investigate itself.

Taking cues from Citizen Science

1 Reply

One rap against citizen journalism is that there is always a possibility that it isn’t accurate or credible. Unmonitored, unmoderated blogs can get it wrong. Well, so can traditional journalists, but with blogs, it’s harder to hold someone accountable, and erroneous information is that much trickier to retract.

Would it help then, to look for ideas in a field where inaccuracy is barely tolerated, if at all? The media should be able to tap into crowd wisdom for credible content if, as Dan Schultz notes, “members of the scientific community, a professional group that arguably maintains higher standards for verification than journalism, are trying to harness the crowd in the same way that we are.”

Citizen science has been effectively used in one main way – collection of data, which is then used by scientists for contextualization, analysis and consolidation with experiments and previous scientific literature.

Be it recording the dates of Spring’s first lilac blossoms, or counting the number of eggs in bird nests, citizens are contributing in meaningful ways, so scientists can then then use this for more specialized tasks, like assessing the information thus obtained to study the impact of global warming or the influence of human activity on wildlife.

Perhaps, the closest counterpart to this use in journalism is something akin to WNYC’s crowdsourced project to track price gouging in New York City or the Shropshire Star’s map of fuel prices. In both these exercises, citizens were not expected to do much more than report their daily observations.

Since scientific research usually requires a high level of education and training, the tasks get divided neatly between professionals and dabblers. As Schultz points out, in the case of science, “professionals have bigger and better things to do; it doesn’t make sense for a PhD to use a million-dollar telescope to look at something that a hobbyist could view using a thousand-dollar one, especially when there is so much of the universe left to unlock.”

This is not to say that such a clear definition would not work for journalism. In fact, citizen journalism pioneer Jay Rosen has often said that division of labor is essential for crowdsourced journalism projects. In WNYC’s case, citizens were responsible for collecting information that was put together in a story. In more complex investigative projects, the public is given the task of perusing documents, as is happening with The Guardian’s investigation of the MP’s expenses scandal.

Another idea would be to outsource so-called “fluff” journalism to the public (self plug warning). Many sites are already implementing this, by allowing citizens to post blogs and articles on lifestyle and recreational topics. Schulz suggests hyperlocal content as one such department where citizens can often do a good, if not better, job than reporters.

One of the main problems is that unlike scientists, journalists–irrationally or not–are in constant fear of being replaced by amateurs. Hence, they seem more hesitant to solicit citizen help. The fact that journalists are losing jobs, however, has more to do with the lack of revenue-generating mechanisms on the Internet than it has to do with bloggers posting content online. In fact, by recruiting audiences to act as eyes and ears for news organizations, the latter would actually save costs and be able to divert resources toward more specialized reporting.

Secondly, in the case of scientific crowdsourcing or citizen science, there is a distinct classification of contributors and their scope of contribution–as identified by what professionals, amateurs and citizens can do. This leads to a clear division of labor, which is not quite possible in journalism, at least in the way it is being practiced right now. While there is no doubt that journalism needs a special set of skills and training, it’s not rocket science, quite literally.

Amateurs contribute toward citizen science in significant ways by performing unspecialized tasks. In the case of bloggers, on the other hand, short of traveling to a war zone (with some exceptions) they are pretty much doing–or attempting to do–what professional journalists routinely do.

The solution is not to curb bloggers and independent journalists, however. It is to produce the sort of in-depth, high-quality journalism that makes newsroom journalism “special.” In order to have clear-cut division of labor, professionals merely have to offer a product that makes use of the creativity and resources that are available to them. And in the process, they can implement projects that involve the lay public so the latter can do what they do best.

Add context to news online with a wiki feature

2 Replies

In journalism school you’re told to find the way that best relates a story to your readers. Make it easy to read and understand. But don’t just give the plain facts, also find the context of the story to help the reader fully understand what has happened and what that means.

What better way to do that than having a Wikipedia-like feature on your newspaper’s web site? Since the web is the greatest causer of serendipity, says Telegraph Communities Editor Shane Richmond, reading a story online will often send a reader elsewhere in search of more context wherever they can find it.

Why can’t that search start and end on your web site?

What happens today

Instead of writing this out, I’ll try to explain this with a situation:

While scanning the news on your newspaper’s web site, one story catches your eye. You click through and begin to read. It’s about a new shop opening downtown.

As you read, you begin to remember things about what once stood where the new shop now is. You’re half-way through the story and decide you need to know what was there, so you turn to your search engine of choice and begin hunting for clues.

By now you’ve closed out the window of the story you were reading and are instead looking for context. You don’t return to the web site because once you find the information you were looking for, you have landed on a different news story on a different news web site.

Here’s what the newspaper has lost as a result of the above scenario: Lower site stickiness, fewer page views, fewer uniques (reader could have forwarded the story onto a friend), and a loss of reader interaction through potential story comments. Monetarily, this all translates into lower ad rates that you can charge. That’s where it hurts the most.

How it could be

Now here’s how it could be if a newspaper web site had a wiki-like feature:

The story about the new shop opening downtown intrigues you because, if memory serves, something else used to be there years ago. On the story there’s a link to another page (additional page views!) that shows all of the information about that site that is available in public records.

You find the approximate year you’re looking for, click on it, and you see that before the new shop appeared downtown, many years ago it was a restaurant you visited as a child.

It was owned by a friend of your father’s and it opened when you were six years old. Since you’re still on the newspaper web site (better site stickiness!), you decide to leave a comment on the story about what was once there and why it was relevant to you (reader interaction!). Then you remember that a friend often went there with you, so you email it to them (more uniques!) to see if they too will remember.

Why it matters to readers

For consumers, news is the pursuit of truth and context. Both the news organization and the journalists it employs are obligated to give that to them. The hardest part of this is disseminating public records and putting it online.

The option of crowd-sourcing it, much like Wikipedia does with its records, could work out well. However just the act of putting public records online in a way that makes theme contextually relevant would be a big step forward. It’s time consuming, however the rewards are great.

Crowdsourcing platform Help Me Investigate is live – and generates its first story

15 Replies

View Birmingham’s parking ticket hotspots in a larger map

Today the Birmingham Post publishes the first story to come out of the crowdsourcing platform I’ve been creating – Help Me Investigate. It’s about parking ticket hotspots in Birmingham*. UPDATE: The Birmingham Mail have also published a report, from which the map above comes.

The site has only been public for a couple of weeks, and we have refrained from any launch or publicity, preferring to let it grow organically in these early stages.

But the early results have been extremely encouraging.

Although the parking ticket story is the first to appear in traditional media, it is not the first investigation to be completed on the site. One investigation was completed during the testing stage; another shortly after. Both had resolutions that might not have made traditional media, but were important to the users and, for me, resulted in the sort of engagement you want from media (more on that below). Continue reading →

More crowdsourcing from the Guardian and NYT – this time on Iran

3 Replies
http://www.guardian.co.uk/world/interactive/2009/jun/29/iran-election-dead-detained

Iran election: faces of the dead and detained | World news | guardian.co.uk via kwout

They’re at it again. Following the very domestic issue of MPs’ expenses, The Guardian’s latest experiment with crowdsourcing goes international: Iran. Continue reading →

The Guardian’s tool to crowdsource MPs’ expenses data: time to play

25 Replies
http://mps-expenses.guardian.co.uk/   

 

Investigate your MP’s expenses via kwout

So here’s The Guardian’s crowdsourcing tool for MPs’ expenses. If you’ve not already, you should have a play: it’s a dream. There are over 77,000 documents to get through – and in less than 24 hours users have gone through over 50,000 of those. You wonder how long it took The Telegraph to get that far.

Meanwhile, that process is doing much more than just finding ‘stories’. It’s generating data: the date, the amount, the type of expense, the type of document. When this stage is finished, The Guardian will have a database that will allow people to filter, mix and combine the expenses data in different ways.

It’s also about telling a ‘story’ in a different way. There’s an element of game mechanics in the site – that progress bar (shown above) compels you to bring the site to completion (it strangely reminds me of the Twitter game Spymaster). This makes it more engaging than a made-for-print exclusive – as I wrote about Help Me Investigate, this isn’t ‘citizen journalism’: it’s micro-volunteering. And when you volunteer, you tend to engage.

And when you treat news as a platform rather than a destination, then people tend to spend more time on your site, so there’s an advertising win there.

Finally, we may see more stories, we may see interesting mashups, and this will give The Guardian an edge over the newspaper that bought the unredacted data – The Telegraph. When – or if – they release their data online, you can only hope the two sets of data will be easy to merge. 

http://mps-expenses.guardian.co.uk/page/31256/   

 

page 71 of Alan Duncan’s Incidental Expenses Provision 2006/07 via kwout

What’s been happening with Help Me Investigate

12 Replies

It’s finally been announced that my project Help Me Investigate is being funded by 4iP and Screen West Midlands.

Help Me Investigate (HMI) is a platform for crowdsourcing investigative journalism. It allows anyone to submit a question they want to investigate – “How much does my hospital make from parking charges?” “What happened to the money that was allocated to my local area?” “Why was that supermarket allowed to be built opposite another supermarket?” …

But more importantly, it then enables users to mobilise support behind that question; and to pursue it.

HMI attempts to address the biggest issue facing journalism: how do we save the good stuff? The persistent slow-brewed journalism that was previously subsidised (if you were lucky) by more commercially friendly instant journalism, but which stands to lose most as commercial content becomes disaggregated and reaggregated, and audiences and their activity measurable.

How do you support Slow Journalism?

Help Me Investigate is an attempt to use the qualities of the web to pursue investigative journalism. There are various aspects to this (which I’ll be exploring, along with others, in the Help Me Investigate blog), but fundamentally it comes down to this:

  • The web allows you to ‘atomise’ processes – break them down into their constituent parts. The site breaks apart investigative – often campaigning – journalism allowing users to contribute in specific and different ways. This is not citizen journalism – it is micro-volunteering.
  • Investigative journalism is about more than just ‘telling a story’; it is about enlightening, empowering and making a positive difference. And the web offers enormous potential here – but users must be involved in the process and have ownership of the agenda.
  • The web is more tool than destination – successful business models rest on creating a platform
  • Likewise, the web is more of a communication medium than a storytelling one; therefore, we are focusing on communication and community rather than stories; process, rather than product.
  • We are also focused on making the process itself rewarding, not just the end result. Journalism is a by-product.
  • Online, failure is cheap; unlike a traditional news organisation, HMI doesn’t need the majority of investigations to ‘succeed’; in fact, failure is built into the design as a necessary ingredient of the site’s overall success. If you want to budget for it, put it under ‘training’ and ‘R&D’.
  • Do what you do best and link to the rest: the site is networked – we’re not trying to be or host all things but will be pointing elsewhere more often than not

I could go on, and I will in the blog. But I think those points are core. I don’t expect this project will have all the answers, but I think we are asking the right questions, at the right time.

Now, it’s worth pointing out that the idea of ‘investigative journalism’ covered here is a broad one – indeed, we have no idea of predicting what questions will be pursued: the agenda will be determined almost entirely by users (including journalists) and topics could range from the very personal, hyperlocal to more national questions. That alternative to a mainstream editorial agenda will be interesting in itself: how many questions will we get that newspapers would find unappealing?

So what’s happening now?

We’re building a very rough and ready frame within which users can play. How that develops depends in large part on what the users need to do – we’ll be doing much of the development as it is being used.

Already a handful of people have used the site in its closed test form, and in the following weeks quite a few more will start to go through it. Then the site will be opened in a semi-closed beta.

To begin with we’re focusing our personal efforts on Birmingham, although people elsewhere will be able to use the site.

The site is being built by Webby Award-winning developer Stef Lewandowski, while the community side of things is headed up by Nick Booth. Both have been crucial contributors to the development of HMI. Joining us behind the site are community support Paul Henderson and investigative journalist Heather Brooke, author of the wonderful guide to FOI Your Right To Know. They will be suggesting and supporting activities to users who submit or join investigations on the site.

It’s taken 18 months to get to this point, and the hard work starts now. If you want to be involved in any capacity let me know.

Citizen journalism and investigative reporting: from journalism schools to retirement communities

4 Replies

The myriad numbers of citizen journalism sites that pop up everyday seem to suggest that the media can fulfill the purposes of democracy by merely offering their audiences a forum to express themselves.

However, to tap into its full potential, participatory journalism should try to do something in addition to what mainstream reporting already does – such as expanding source diversity, shifting focus to neglected sections of the population, or pursuing different angles and perspectives on a story. If not, it is not doing much more than using its readers as a form of cheap labor, and perhaps laying off journalists while it’s at it.

Citizen journalism is hardly beneficial when it merely propagates the flaws of traditional reporting. Huffington Post’s Off the Bus produced many stories on the US Presidential campaign last year – but the one we remember most vividly is Mayhill Fowler’s reporting of Barack Obama’s “bitter” comment – the story that put gotcha journalism from mainstream reporters to shame.

The paucity of good investigative reporting through citizen journalism is not surprising, considering the amount of effort such stories require from news organizations in terms of coordination and oversight. Perhaps, most importantly, they require a huge time investment from the audience. While people might be easily persuaded to relay food-item prices from their grocery bills, they are less likely to pursue public officials or make trips to government offices to retrieve information.

Which is why magazines like The Nation are allowing their audiences simpler methods to contribute to significant news stories. With its “Ask the President” feature, the weekly is encouraging readers to pose questions for the Obama administration’s upcoming press conferences. Queries that receive the most votes will get asked by Nation journalists, pending agreement from the White House. This is perhaps the digital equivalent of newspapers inviting their readers to town hall meetings to question public officials.

News organizations are also trying to encourage investigative journalism “from the desk.” With the amount of interactive tools available online, it is perhaps easiest to get readers to contribute through their computers since they already spend several hours in front of them. National news stories especially lend themselves well to this form of reporting.

The nonprofit investigative journalism site Propublica hopes to analyze Barack Obama’s stimulus package by encouraging audience contributions. Data and documents will be available on the site, and readers will be encouraged to offer ideas for stories and topics of newsworthy content. Details of how distributed reporting will be implemented have not been worked out yet, but as Senior Editor Eric Umansky reasons, the breadth of the stimulus projects and their potential effects are so huge that there simply are not enough traditional journalists to cover the subject. But with the help of citizen reporters all around the country, Propublica can do a better job of reporting on all angles of the story. When you recall that the same idea allowed Talking Points Memo to break the news about the Bush administration’s firing of eight US attorneys in late 2007, it is easy to be optimistic about Propublica’s venture.

Another idea that is gaining popularity is the coupling of journalism school projects to citizen reporting. In this fast-changing media world where every citizen is a reporter, students of journalism should be specifically trained to tap into the vast talent available in the community, writes Elizabeth Zwerling. That is exactly what the Annenberg School for Communication in Los Angeles is attempting to do with its hyperlocal news site, Intersections.

The project is shining the spotlight on the less privileged classes that mainstream media has long ignored with its profit-centered interest in affluent communities. Online journalism often reproduces this censorship of omission because of the inherent digital divide. Students at the Annenberg School, however, are being trained to report on hyperlocal issues affecting urban LA communities. Local residents, many of whom include working class immigrants, work with students to transmit their photos, videos and stories through cell phones.

Sites such as Texas Watchdog, on the other hand, are implementing programs to train civilians to become watchdogs of the government; the program teaches citizens to access and review public documents, among other things.

Another potential goldmine for citizen journalism at the hyperlocal level appears to be populations of retired individuals, who have both the time and inclination to perform watchdogging functions for their communities, as Jack Driscoll found with Rye Reflections, a user-generated site run by retirees in a small community in New Hampshire. The drastic reduction in local news reporting by newspapers that have cut down their resources and budgets has meant that citizens are willing to take up the slack. This sort of community reporting offers people intellectual and social stimulation while fulfilling civic needs, according to Driscoll.

In addition, retired professionals can often lend their specific expertise to investigative news stories, as former engineers and lawyers in the community of Fort Myers, Florida proved during the News-Press’ investigation of a local utility company. However, Driscoll does not succumb to the rosy-eyed view that this sort of reporting can replace hardcore investigative journalism at the national or international level, or in specialized fields like science and medicine.

It’s little surprise then that the much talked-about Huffington Post Investigative Fund hopes to tap into the expertise of seasoned journalists to kick-start its investigative reporting exercise. Down the road, it will harness the power of its citizen volunteers. As Jay Rosen, who will serve as a senior advisor on the project, writes, “the best approach is to have no orthodoxy and to support very traditional investigative reporting by paid pros who are good at it, as well as teams of pros and amateurs, students working with masters of the craft, crowdsourced investigations, and perhaps other methods.”

A tall order to be sure. But news organizations need to quickly find ways to compensate for the dearth of resources and personnel in order to continue to perform in-depth investigative reporting, lest journalism may become completely irrelevant.