Monthly Archives: February 2011

Mobile journalism: Section 44 is dead – long live Section 43

One of the pictures the student was taking at the time he was stopped by plain-clothes officers

An image taken by the student when he was stopped by plain-clothes officers

Section 44 of the Terrorism Act 2000 was an ongoing problem for photographers and journalists using mobile phones who would find themselves stopped, searched, and sometimes arrested by police. After ongoing pressure and a judgement in the European Court of Human Rights, the section was finally suspended last July.

Now Amateur Photographer reports on the Metropolitan Police defending officers’ decision to stop and search a student for merely taking photographs near a school (the image above was being taken when he was approached by police). The search was done under Section 43, which “can only be enforced if a police officer ‘reasonably suspects’ a person to be a terrorist.”

Meanwhile, police are seeking new powers to replace those given under Section 44.

If you use mobile technology in your journalism, it’s worth keeping the stop and search bust card about you.

h/t Ewen Rankin

Matt Wells on The Guardian’s interactive protests Twitter map

Twitter network of Arab protests - interactive map | guardian.co.uk

Twitter network of Arab protests – interactive map | guardian.co.uk

The Guardian have published an impressive map displaying Twitter coverage of protests around the Arab world and the Middle East. I asked Matt Wells, who oversaw the project, to explain how it came about.

The initial idea, which I should credit to deputy editor Ian Katz, was to build something that showcased the tweets of our correspondents, along a broader network of vetted tweeters in different countries. We wanted to connect all of these on a map, so you could click on a country and see relevant live-updating tweets.

I was asked to oversee it. The main thing was to check out the best English-language tweeters in each country – preferably people who appeared reliable, who were involved in first-hand reporting themselves, and who did a lot of retweeting of others.

I started by asking our correspondents who they followed, then broadened it out from there. We asked everyone if they minded being included – we had one refusal from a Tweeter in a particularly authoritartian country who was worried about the exposure. Everyone else thought it was a great idea.

Meanwhile one of our developers, Garry Blight, overseen by Alastair Dant, set about building it. As with anything of this kind, it took a bit longer than orginally anticipated, but we had it ready on the day that Mubarak fell. And brilliantly, it has worked for every country since then.

It’s powered by a Google spreadsheet – so it’s really easy to add new people and to attach them to particular countries or search terms.

And it should be very easily adaptable for other news events around the world.

Help Me Investigate is now open source

I have now released the source code behind Help Me Investigate, meaning others can adapt it, install it, and add to it if they wish to create their own crowdsourcing platform or support the idea behind it.

This follows the announcement 2 weeks ago on the Help Me Investigate blog (more coverage on Journalism.co.uk and Editors Weblog),

The code is available on GitHub, here.

Collaborators wanted

I’m looking for collaborators and coders to update the code to Rails 3, write documentation to help users install it, improve the code/test, or even be the project manager for this project.

Over the past 18 months the site has surpassed my expectations. It’s engaged hundreds of people in investigations, furthered understanding and awareness of crowdsourcing, and been runner-up for Multimedia Publisher of the Year. In the process it attracted attention from around the world – people wanting to investigate everything from drug running in Mexico to corruption in South Africa.

Having the code on one site meant we couldn’t help those people: making it open source opens up the possibility, but it needs other people to help make that a reality.

If you know anyone who might be able to help, please shoot them a link. Or email me at paul(at)helpmeinvestigate.com

Many thanks to Chris Taggart and Josh Hart for their help with moving the code across.

Councils should allow public meetings to be recorded, says Pickles

A welcome window of clarity on the issue of whether bloggers can record public council meetings today: Local Government Secretary Eric Pickles has weighed in to say that public meetings should be open to bloggers and that they should “routinely allow online filming of public discussions as part of increasing their transparency”

It’s an issue that I’ve been investigating for a while on Help Me Investigate: while some councils actively stream their own meetings, and others allow members of the public to do the same, some councils explicitly forbid recording, others allow audio but require mayoral permission for video, and a few have conducted ‘investigations’ of citizens for daring to record public proceedings (and councillors), or ejected them from the room (see video above).

Pickles’ guidance – and the accompanying letter sent to all councils – provides useful material to show uncooperative councils.

The letter calls on councils to give “credible community or ‘hyper-local’ bloggers and online broadcasters the same routine access to council meetings as the traditional accredited media have”

It also reassures councils that “giving greater access will not contradict data protection law requirements”. This is a key part, as data protection is often used as an excuse to prevent filming. The Help Me Investigate investigation revealed a worrying ignorance regarding data protection laws by councils even in formal internal reports. Other areas, including privacy, copyright, defamation and “procedural matters” are covered in this blog post rounding up some of the investigation’s findings.

Other material that bloggers may find useful are mentioned in Pickles’ announcement. They include The Public Bodies (Admission to Meetings) Act 1960The Local Government Act of 1972 and The Local Government (Access to Information) Act 1985.

I’m working on producing a cribsheet for bloggers wanting to record their local council’s public meetings. If you want to help, please leave a comment or subscribe to the investigation blog.

UPDATE: Philip John is compiling a list of who’s doing what in terms of recording, streaming, tweeting and liveblogging council meetings.

Is social capital dehumanising? (comment call)

Following on from my post about teaching community-based journalism, I had an interesting correspondence with James Brooks, who found terms like “social capital” dehumanising, refused to join Facebook and many other web platforms on ethical grounds (that they conflate the professional and private), and took issue with the idea that my assignment suggested that he “should become an active member” of certain “communities”.

I wanted to explore this further, because I think this is a complex area that deserves fleshing out. So, is social capital dehumanising? Should journalists refuse to join social networks on ethical grounds? And does a journalist have to engage with communities to do their job?

PS: James is happy for me to blog about it.

Bella Hurrell on data journalism and the BBC News Specials Team

BBC_Special_ReportsBella Hurrell is the Specials Editor with BBC News Online. I asked her how data journalism was affecting their work for a forthcoming article. Here is her response in full:

The BBC news specials team produces multimedia interactives, daily graphics as well as more complex data visualisations. The team consists of journalists, designers and developers all working closely together, sitting alongside each other.

We have found that proximity really important to the success of projects. Although we have done this for a while, increasingly other organisations are reorganising along these lines after coming to realise the benefits of breaking down silos and co-locating people with different skillsets can produce more innovative solutions at a faster pace.

As data visualisation has come into the zeitgeist, and we have started using it more regularly in our story-telling, journalists and designers on the specials team have become much more proficient at using basic spreadsheet applications like Excel or Google Docs. We’ve boosted these and other skills through in house training or external summer schools and conferences.

Data as a service, data as a story

There are two interrelated elements to data journalism: firstly data as a service, often involving publicly available data.  The school league tables which the BBC news website has produced every year for over a decade are an example here. We know they are hugely popular and they provide a valuable public service for users. More recently the government has started to get better at putting data / information  online, so we have adjusted our coverage. Instead of replicating what is done by government sites (such as providing individual school pages) we try to provide value by doing something extra, such as mini charts and the ability to select and compare schools – as well as news stories and analysis.

The second element is data as a story. The simple fact that loads of data has been published is not really very interesting to most people. Data is only useful if it is personal – I want to find out about schools in my area, restaurants near me and so on – or when it reveals something remarkable. The duck pond debacle from MPs expenses data or the Iraq civilian death records kept by the US revealed by Wikileaks’ release of the Iraq war documents are both examples of individual stories from big tranches of data that really resonated.

Dealing with large numbers of documents

With data stories that involve thousands of documents we face two challenges. Firstly deciding whether we can provide a platform or tool for people to look at the documents or data. This can be valuable but might involve significant technical resources and may not be worth doing if others are already providing this service.

Secondly we need to find the stories and then report them but clearly that can be tricky when there are thousands of documents to examine. Crowdsourcing is an obvious approach but we need to use what the crowd tells us. When readers told us about potential stories they spotted in the MPs expenses data we pulled in our whole politics team off normal duties to sift users’ questions and put them directly to the relevant MPs. Then we published their answers on our site. This is a very resource heavy approach and not sustainable over a long time.

Another model for reporting stories that involve large sets of data was Panorama’s public sector pay story, where the website partnered with the investigative unit to tell the story online. The Panorama team spent months collecting data and we provided simple visualisations and  a way for users to examine the data.

Does Twitter improve your site’s search engine results?

A Tweet's Effect On Rankings - An Unexpected Case Study

Yes. Or at least according to a couple of blog posts in the SEO blogosphere.

Back in December Search Engine Land’s Danny Sullivan asked what “social signals” Google and Bing count in their algorithms. Previously, the answer would have been none, as far as Twitter is concerned, because like most social media (including blog comments, forum posts and social networks) any links posted on Twitter carry a ‘nofollow’ tag, instructing search engines to ignore it.

But now that Twitter has signed deals with the big search engines, they now get the “firehose” of data from Twitter direct – without nofollow attributes. Bing tell Sullivan:

“We take into consideration how often a link has been tweeted or retweeted, as well as the authority of the Twitter users that shared the link.

Google tells him:

“We use the data only in limited situations, not for all of general websearch.”

The post contains more information about how both search engines use the “social authority” of a user (followers, followed, etc.) to further rank links.

A case study

Yesterday, the issue gained a fascinating case study from SEOmoz (image at top), when one of their articles suddenly appeared on the first page of Google search engine results for the term “Beginner’s Guide” following a tweet from Smashing Magazine and hundreds of retweets. Continue reading

Teaching community-based journalism

Image by AndYaDontStop

Image from Flickr by AndYaDontStop

A couple weeks ago I wrote a post about ‘Universities Without Walls‘. At its heart was a belief that community is an asset for news organisations, and reputation in at least one community is an asset journalists should be actively cultivating.

I’ve recently been asking students – at both City University London and Birmingham City University – to complete assignments that ask them to do just that.

The first assignment is a Community Strategy Analysis (you can read the brief here). This was given to students across the 8 Masters degrees at City University. They are required to identify a community that they can join and contribute to, with the objective of becoming a better journalist as a result (because they will have access to a wider range of sources, and sources will have access to them, they will build a diverse distribution network, and most of all they will have built reputation and relationships that form the basis for all the above)

The other assignment was given to Birmingham City University MA Online Journalism students last week. This is a Communities of Practice assignment, where students are asked to join groups of practitioners (e.g. online video makers; data journalists and developers; podcasters; and so on) to improve their multimedia journalism, contribute to the field, and build support networks for ongoing skills development.

Here’s what I’m learning so far.

I have to explain why community matters

The vast majority of my work with the City University students has been cultural. The idea of ‘the audience’ is so persistent, so resistant, that it takes a huge amount of work to unpick.

We are so precious about ‘our’ journalism, it seems, that we will do anything but let other people into it. More worrying, we seem to see journalism as either a glamorous profession, or a paternalist one. ‘Public interest’ is ‘our interest’; the ‘public sphere’ is ‘our sphere’.

Students understand the importance of building a network of contacts; they understand why they should make themselves contactable; and they are happy to get involved with distributing content online. But many expect all this to happen without building relationships. Some, indeed, worry about this being a “waste of time”.

I’m not sure whether this is a result of news organisations increasingly becoming content factories, or whether aspiring journalists have always expected ‘being a journalist’ to mean that the hard work of building relationships had already been done for them by the newspaper and their predecessors. It might be an inherited cultural attitude that sneers at readers. It could be all of the above, or none of those reasons. Whatever the reasons, I find it rather depressing that the communities we are supposed to serve are often seen as something we cannot be bothered with.

Common misunderstandings about community

At the module’s midway point I asked students to submit a draft of their community strategy so that I could make sure they were on the right track. It was a useful exercise in what you might call ‘Agile’ teaching – it allowed me to pull out some common misunderstandings and correct them. Normally this doesn’t happen until you’ve taught a module for the first time, and adapt it for the second and third times.

One recurring problem was students being too focused on content, or community, rather than both. The content-centric strategies started with what they were going to do – write a blog, etc. – and then positioned the ‘audience’ as a compliant distributor and contributor, with little thought around why they would do that.

The strategies that were too focused on community failed to identify the journalistic objectives that should remain important. The journalist was left helping a community, but without necessarily playing to their own journalistic strengths of communication and investigation.

Two key questions to ask were illustrated by one particular student, whose draft contained a brief section titled ‘What do I have to offer them?’ and another titled ‘What do I get back?’. Addressing both questions ensures the project is balanced.

A good strategy is specific – but too many failed to specify what they were going to do to stimulate interaction. Exceptions included one student who noted that many successful blog posts ended with an open question; and another who identified the questions that she would use to stimulate debate.

Likewise, tools needed to be chosen based on where the community is, and what the tools did. There’s no point starting a blog if all of your chosen community are using Facebook. And there’s no point choosing Facebook if you want the information to be available to search engines.

Finding the community at all was a problem for some, a problem which came down to their search techniques. There’s plenty of advice on this, from the search engines you use to the phrasing, but the key issue is to imagine what your community is saying, not who they are: so don’t search for “twins”, search for “my twin sister” because that’s the sort of thing that only a twin is going to say.

How do you measure success? Many students saw volume as the key, aiming for round numbers of followers on Twitter, fans on Facebook or hits on their blogs. But engagement would be a much more relevant metric: how many comments do you want? How many @ messages, or even retweets?

Other problems including not looking at what else there was serving that community, and why it was successful, or trying to compete with it instead of working with it. If your community is mothers then best to build a reputation on Mumsnet instead of trying to beat it.

Assessment

As the assignment is inherently experimental, I’ve borrowed the marking scheme from the ‘Experimental Portfolio’ assignment on Birmingham City University’s MA Online Journalism. This is designed to allow students to ‘fail’ to meet their own objectives without necessarily failing the assignment itself. Put another way, they are assessed on process, not product (and online, of course, the process itself is often the product).

The three assessment criteria, then, are: research; creativity and viability; and analysis. So as long as the student’s community strategy is based on research, and they critically analyse the results, that is A Good Thing. This is Masters level education – they should be learning something from their work, and yes, that means being prepared to fail. The assessment of creativity is aimed at both ensuring that taking big risks is encouraged, and that creative and effective executions are also rewarded. Few things depress me more than a student who is afraid to learn anything because they might lose marks.

Communities of practice

The assignment for MA Online Journalism students is different. It is an acknowledgement that in a field like online journalism, where technology and knowledge is evolving all the time, Masters level education means having the professional contacts that allow you to remain at the forefront of the field in 2 or 5 years – not just in 6 months.

There are many similarities with the other assignment: the focus is on building relationships, and contributing something to the wider community, rather than just taking from it. The difference is that the objective is skills-based, not story-based.

One of the key features of education is what you learn from the people around you – not just the person lecturing you. That’s why e-learning has failed to take off in quite the same way as expected, and why the Open University still does it so well (they recognise that it is about more than content).

Having a ‘university without walls’ where students learn as much outside the classroom as they do in it is a key development in this respect. And as lecturers we need to help make that happen.

Tell the government what you want from the Public Data Corporation

Public Data Corporation consultation

If who are excited about the prospect of open data, but frustrated by its execution (or just one of those people who complain that data doesn’t change anything), the government are inviting comments on what shape the Public Data Corporation should take.

It’s a refreshingly simple execution: a WordPress blog with each question as a separate blog post – presumably it cost a lot less than £300,000. But of course the questions are theirs, and they are:

1.      Which public sector datasets do you currently make use of?

2.      How easy is it to find out what datasets are held by public sector organisations?

3.      How do you, or would you, decide whether a dataset has value for you or for your organisation? What affects how valuable they are, for example timeliness, granularity, format?

4.      Which datasets are of most value to you or your organisation? Why?

5.      What methods of access to datasets would most benefit you or your organisation?

6.      What gets in the way of you or your organisation accessing datasets or data products?

7.      What are the most exciting applications of datasets or data products you are aware of – here or internationally? We are, again, particularly interested in the following areas: registration activities, environmental science, critical infrastructure and the built environment.

8.      Are there any datasets or products you’d like to see generated? How would you or your organisation use them, and what social or economic benefits do you think they would deliver?

9.      From your perspective, what would success look like for the Public Data Corporation?

10.  Have we got the name for this organisation right?  Do you have any suggestions on naming that might better convey our aims?

It’s a shame that there isn’t any space for more open discussion – and that so many of the questions resemble market research. But still, the more journalists who pile in – the more justifiably we can moan later. So go ahead.

Post your responses here.

No, blogging for free is not feudalism

Image by jimmiehomeschoolmom

Image by jimmiehomeschoolmom on Flickr

The sale of the Huffington Post has sparked another raft of posts about how we’re all suckers for building up the value of these companies through giving away our content for free.

The New York Times’s David Carr is typical, describing users as “A Nation of Serfs” and quoting Reuters’ Anthony De Rosa’s similar soundbite “a world of digital feudalism”.

Carr misses the point entirely: that this is not “people working free” (sic) but an exchange. A user exchanges demographic details and content for the functionality offered by Facebook. They put their photos on Flickr because they benefit from the network, access, and tools.

This is nothing new: we do not criticise telephone companies for being built on people ‘giving away their content’ in the form of the billions of conversations that take place across those networks. Or the demographic data we hand over when we sign up. Oh, and we pay them.

It’s a symptom of journalistic egocentrism that it should seem odd that other people hand over their content ‘for free’ (and of being a little threatened?).

Another symptom is to see the likes of Twitter and Facebook as content platforms, rather than communication networks.

Even the Huffington Post is a network as well as a content platform – the interesting problem for that site in selling to AOL is that while some people will have been happy to contribute for the network benefits (access to likeminded individuals), some will not.

But here’s where feudalism is no comparison to make. Serfs didn’t have a choice. Huffpo bloggers can leave – as indeed, many left similar operations before (Anthony De Rosa‘s analysis is sophisticated enough to recognise this). One of the questions occupying my mind at the moment is whether the current domination of Facebook will turn out to be a stepping stone to other forms of blogging, or if the social network will be enough for most people.

The fundamental point is that this is a marketplace, and if the exchange does not feel fair, users will move on – as they did with MySpace, and Friendster before that.

That doesn’t mean that there isn’t a wider problem around corporatisation of the public sphere, but don’t insult millions of people by calling them serfs.