Category Archives: online journalism

Content, context and code: verifying information online

ContentContextCode_VerifyingInfo

When the telephone first entered the newsroom journalists were sceptical. “How can we be sure that the person at the other end is who they say they are?” The question seems odd now, because we have become so used to phone technology that we barely think of it as technology at all – and there are a range of techniques we use, almost unconsciously, to verify what the person on the other end of the phone is saying, from their tone of voice, to the number they are ringing from, and the information they are providing.

Dealing with online sources is no different. How do you know the source is telling the truth? You’re a journalist, for god’s sake: it’s your job to find out.

In many ways the internet gives us extra tools to verify information – certainly more than the phone ever did. The apparent ‘facelessness’ of the medium is misleading: every piece of information, and every person, leaves a trail of data that you can use to build a picture of its reliability.

The following is a three-level approach to verification: starting with the content itself, moving on to the context surrounding it; and finishing with the technical information underlying it. Most of the techniques outlined take very little time at all but the key thing is to look for warning signs and follow those up. Continue reading

Content, context and code: verifying information online

The full version of this post can be found here (this is a duplicate).

When the telephone first entered the newsroom journalists were sceptical. “How can we be sure that the person at the other end is who they say they are?” The question seems odd now, because we have become so used to phone technology that we barely think of it as technology at all – and there are a range of techniques we use, almost unconsciously, to verify what the person on the other end of the phone is saying, from their tone of voice, to the number they are ringing from, and the information they are providing.

Dealing with online sources is no different. How do you know the source is telling the truth? You’re a journalist, for god’s sake: it’s your job to find out.

In many ways the internet gives us extra tools to verify information – certainly more than the phone ever did. The apparent ‘facelessness’ of the medium is misleading: every piece of information, and every person, leaves a trail of data that you can use to build a picture of its reliability. Continue reading

Hyperlocal voices interviewed elsewhere

While I’ve been blogging my series of interviews with hyperlocal bloggers I’ve come across a few more elsewhere that may be of interest – and thought it worth linking to them here.

Talk About Local is running a ‘Ten Questions’ series of interviews along the same lines.

Nick Booth of Podnosh (which I work for) is writing a blog about hyperlocal bloggers on the BBC website. He has also  interviewed Steph Jennings and James Clark of WV11 – audio embedded below:

[audio:http://audioboo.fm/boos/194465-steph-jennings-and-james-clark-of-wv11.mp3%5D

I recently had Ventnor Blog founder Simon Perry talk to students on the MA in Online Journalism that I teach at Birmingham City University. Samuel Negredo filmed part of his visit, which can be seen on his blog post about the visit and is also embedded below:

Also interviewed elsewhere – by Philip John – is Brownhills Bob.

Lara O’Reilly interviews Dave Lee about Olympic Borough.

And in the US, Bob Yoder of the Redmond Neighborhood Blog is interviewed by Outside.in, which also gets some tips from Elllie Ashford in Annandale.

Organising your journalism: Springpad

For the last couple of weeks I’ve been playing with a new web service and mobile app called Springpad. LifeHacker describes it as a “super advanced personal assistant”. And I can see particular applications for journalists and editors. Here’s how it works:

Investigating on the move, and online

In Springpad you create a ‘notebook’ for each of your projects. You can then place Tasks, Notes, bookmarks and other objects in those notebooks.

For a journalist, the notebook format lends itself well to projects or investigations that you’re working on, especially as ideas occur to you on the move. As new tasks occur to you (‘I must interview that guy’, or ‘follow up that lead’) you add them to the relevant notebook (i.e. project or investigation) from the mobile app – or the website.

If you’re browsing the web and find a useful resource, you can use the Springpad bookmarklet to bookmark it, tag it, and add it to the relevant notebook(s).

And any emails or documents you receive that relate to the project you can forward to your Springpad account.

What’s particularly useful is the way you can choose to make public entire notebooks or individual items within them. So if you want others to be able to access your work, you can do so easily.

There are also a range of other features – such as events, contacts, barcode recognition, search, and a Chrome bookmarklet – some of which are covered in this video:

How I use it

Springpad seems to me a particularly individually-oriented tool rather than something that could be used for coordinating large groups (where Basecamp, for example, is better). None of its constituent elements – tagging, to-do lists, notes, etc. – are unusual, but it’s the combination, and the mobile application, that works particularly well.

If you have a number of projects on the go at any one time you tend to have to a) constantly remember what needs to be done on each of them; b) when; c) with whom; and d) keep track of documents relating to it. The management of these is often spread across To Do lists, a calendar, contacts book, and filing or bookmarks.

What Springpad effectively does is bring those together to one place on your mobile: the app (although at the moment there’s no real reason to use it for contacts). This means you can make notes when they occur to you, and in one place. The fact that this is both synced with the website and available on the app when offline gives it certain advantages over other approaches.

That said, I’ve adopted a few strategies that make it more useful:

  • Assign a date to every Task – even if it’s in 3 months’ time. This turns it into a calendar, and you can see how many things you need to get done on any given day, and shuffle accordingly.
  • Tasks should be disaggregated – i.e. producing an investigation will involve interviews, research, follow ups, and so on. Each of these is a separate task.
  • Start the day by looking at your tasks for that day – complete a couple of small ones and then focus on a bigger one.
  • If new ideas related to a Task occur to you, add them to that task as a note (these are different to standalone Notes). This is particularly useful for tasks that are weeks in the future: by the time they come around you can have a number of useful notes attached to it.
  • Use tags to differentiate between sub-projects within a notebook.
  • Install the bookmarklet on your phone’s browser so you can bookmark project-related webpages on the go.
  • Add the email address to your contacts so you can email key documents and correspondence to your account (sadly at the moment you still need to then open the app or website to tag and file them, but I’m told they are working on you being able to email-and-file at once).

Not a replacement for Delicious

You can import all of your Delicious bookmarks into Springpad, but I’ve chosen not to, partly because the site lacks much of the functionality that I’m looking for in a Delicious replacement, but also because I see it as performing a different task: I use Delicious as a catch-all, public filing system for anything that is or might be relevant to what I do and have done. Springpad is about managing what I’m doing right now, which means being more selective about the bookmarks that I save in it. Flooding it with almost 10,000 bookmarks would probably reduce its usefulness.

For the same reason I don’t see it as particularly comparable to Evernote. Dan Gold has an extensive guide explaining why he switched from Evernote to Springpad, and simplicity again plays a large role. It’s also worth reading to see how Dan uses the tool.

Perhaps the best description of the tool is as a powerful To Do list – allowing you to split projects apart while also keeping those parts linked to other items through notes, tags and categories.

Early days – room for improvement

The tool is a bit rough around the edges at the moment. Navigation of the app could be a lot quicker: to get from a list of all Tasks to those within one notebook takes 3 clicks at the moment – that’s too many.

Privacy could be more granular, allowing password-protection for instance. And the options to add contacts and events seem to be hidden away under ‘Add by type’ (in fact, the only way to add an event at the moment appears to be to sync with your Google account and then use a calendar app to add a new event through your Google calendar, or to go to an existing event in your app and create a new one from there).

The bookmarklet is slow to work, and alerts only come via RSS feed (you could use Feedburner to turn these into email alerts by the way).

That said, this is the first project management that I’ve actually found effective in getting stuff out of my head and onto virtual paper. Long may that continue.

Universities without walls

@majohns Economist believes in future their distinguished and knowledgable audience is as important as their editors #smart_2011

This post forms part of the Carnival of Journalism, whose theme this month is universities’ roles in their local community.

In traditional journalism the concept of community is a broad one, typically used when the speaker really means ‘audience’, or ‘market’.

In a networked age, however, a community is an asset: it is a much more significant source of information than in other media; an active producer of content; and, perhaps most importantly, at the heart of any online distribution system.

You can see this at work in some of the most successful content startups of the internet era – Boing Boing, The Huffington Post, Slashdot – and even in mainstream outlets such as The Guardian, with, for example, its productive community around the Data Blog.

Any fledgling online journalism operation which is not based on a distinct community is, to my thinking, simply inefficient – and any journalism course that features an online element should be built on communities – should be linking in to the communities that surround it.

Teaching community-driven journalism

My own experience is that leaving the walls of academia behind and hosting classes wherever the community meets can make an enormous difference. In my MA in Online Journalism at Birmingham City University, for example, the very first week is not about newsgathering or blogging or anything to do with content: it’s about community, and identifying which one the students are going to serve.

To that end students spend their induction week attending the local Social Media Cafe, meeting local bloggers and understanding that particular community (one of whom this year suggested the idea that led to Birmingham Budget Cuts). We hold open classes in a city centre coffee shop so that people from Birmingham can drop in: when we talked about online journalism and the law, there were bloggers, former newspaper editors, and a photographer whose contributions turned the event into something unlike anything you’d see in a classroom.

And students are sent out to explore the community as part of learning about blogging, or encouraged to base themselves physically in the communities they serve. Andy Brightwell and Jon Hickman’s hyperlocal Grounds blog is a good example, run out of another city centre coffee shop in their patch.

In my online journalism classes at City University in London, meanwhile (which are sadly too big to fit in a coffee shop) I ask students to put together a community strategy as one of their two assignments. The idea is to get them to think about how they can produce better journalism – that is also more widely read – by thinking explicitly about how to involve a community in its production.

Community isn’t a postcode

But I’ve also come to believe that we should be as flexible as possible about what we mean by community. The traditional approach has been to assign students to geographical patches – a relic of the commercial imperatives behind print production. Some courses are adapting this to smaller, hyperlocal, patches for their online assessment to keep up with contemporary developments. This is great – but I think it risks missing something else.

One moment that brought this home to me was when – in that very first week – I asked the students what they thought made a community. The response that stuck in my mind most was Alex Gamela‘s: “An enemy”. It illustrates how communities are created by so many things other than location (You could also add “a cause”, “a shared experience”, “a profession”, “a hobby” and others which are listed and explored in the Community part of the BASIC Principles of Online Journalism).

As journalism departments we are particularly weak in seeing community in those terms. One of the reasons Birmingham Budget Cuts is such a great example of community-driven journalism is that it addresses a community of various types: one of location, of profession, and of shared experience and – for the thousands facing redundancy – cause too. It is not your typical hyperlocal blog, but who would argue it does not have a strong proposition at its core?

There’s a further step, too, which requires particular boldness on the part of journalism schools, and innovativeness in assessment methods: we need to be prepared for students to create sites where they don’t create any journalism themselves at all. Instead, they facilitate its production, and host the platform that enables it to happen. In online journalism we might call this a community manager role – which will raise the inevitable questions of ‘Is It Journalism?’ But in traditional journalism, with the journalism being produced by reporters, a very similar role would simply be called being an editor.

PS: I spoke about this theme in Amsterdam last September as part of a presentation on ‘A Journalism Curriculum for the 21st Century’ at the PICNIC festival, organised by the European Journalism Centre. This is embedded below:

http://vimeo.com/15353276

Slides can be found below:

Comment call: do your students run hyperlocal blogs?

Thanks to the massive interest in hyperlocal blogs a lot of journalism courses are either asking their students to create hyperlocal websites, or finding their students are creating them anyway. This post is to ask what your own experiences are on these lines?

PS: I’ve also created a Google Group on the topic should you want to exchange tips with others.

The Independent’s Facebook innovation

The-Independent-Robert-Fisk

The Independent newspaper has introduced a fascinating new feature on the site that allows users to follow articles by individual writers and news about specific football teams via Facebook.

It’s one of those ideas so simple you wonder why no one else appears to have done it before*: instead of just ‘liking’ individual articles, or having to trudge off to Facebook to see if there’s a relevant page you can become a fan of, the Indie have applied the technology behind the ‘Like’ button to make the process of following specific news feeds more intuitive.

To that end, you can pick your favourite football team from this page or click on the ‘Like’ button at the head of any commentator’s homepage. The Independent’s Jack Riley says that the feature will be rolled out to columnists next, followed by public figures, places, political parties, and countries.

The move is likely to pour extra fuel on the overblown ‘RSS is dying‘ discussion that has been taking place recently. The Guardian’s hugely impressive hackable RSS feeds (with full content) are somewhat put in the shade by this move – but then the Guardian have generated enormous goodwill in the development community for that, and continue to innovate. Both strategies have benefits.

At the moment the Independent’s new Facebook feature is plugged at the end of each article by the relevant commentator or about a particular club. It’s not the best place to put given how many people read articles through to the end, nor the best designed to catch the eye, and it will be interesting to see whether the placement and design changes as the feature is rolled out.

It will also be interesting to see how quickly other news organisations copy the innovation.

*If I told you I said this deliberately in the hope someone would point me to a previous example – would you believe me? Martin Stabe in the comments points to The Sporting News as one organisation that got here first. And David Moynihan points out that NME have ‘Like’ buttons for each artist on their site.

More coverage at Read Write Web and Future of Media.

Consequences of covert recording of MPs’ advice surgeries

This article is a cross-post from the Wardman Wire.

We have a new Cablegate, in which Vince Cable the Business Minster has revealed that he was not carrying out his quasi-Judicial role in a takeover bid by News Corporation objectively, in the presence of Daily Telegraph undercover reporters:

I have blocked it, using the powers that I have got. And they are legal powers that I have got. I can’t politicise it, but for the people who know what is happening, this is a big thing. His whole empire is now under attack. So there are things like that, that being in Government…All we can do in opposition is protest.”

There are two angles which interest me around the intrusion of covert reporting into the Constituency Surgeries of MPs. Firstly, whether the covert reporting done was justified in the context, and then whether there will be a significant political impact.

Covert Reporting

The PCC Code of Practice states:

(*) 10 Clandestine devices and subterfuge

i) The press must not seek to obtain or publish material acquired by using hidden cameras or clandestine listening devices; or by intercepting private or mobile telephone calls, messages or emails; or by the unauthorised removal of documents or photographs; or by accessing digitally-held private information without consent.

ii) Engaging in misrepresentation or subterfuge, including by agents or intermediaries, can generally be justified only in the public interest and then only when the material cannot be obtained by other means.

but adds

The public interest

There may be exceptions to the clauses marked * where they can be demonstrated to be in the public interest.

1. The public interest includes, but is not confined to:
i) Detecting or exposing crime or serious impropriety.
ii) Protecting public health and safety.
iii) Preventing the public from being misled by an action or statement of an
individual or organisation.

2. There is a public interest in freedom of expression itself.

3. Whenever the public interest is invoked, the PCC will require editors to demonstrate fully that they reasonably believed that publication, or journalistic activity undertaken with a view to publication, would be in the public interest.

4. The PCC will consider the extent to which material is already in the
public domain, or will become so.

5. In cases involving children under 16, editors must demonstrate an exceptional public interest to over-ride the normally paramount interest of the child.

Given that the story has resulted in Vince Cable’s political role being heavily limited, and exposing his bias in a decision where he is required to be objective, I’d suggest that the subterfuge is very probably justified.

Impact on Constituency Surgeries

Politics is buried in mass lobbying from single issue campaigns by email (ask the people who run the House of Commons EMail system), demonstrations, and the rest. In this, the Constituency Surgery had given MPs at least one foot partly in touch with the ground.

As far as I am aware, this is the first time that covert recording has been used in a Constituency Surgery seriously to embarrass an MP, and I hope that MPs won’t be tempted to become much more cautious.

David Allen Green (aka Jack of Kent) has an interesting angle over at the New Statesman, pointing out that the newspapers would be fully aware of the views of Lib Dem Ministers:

… the Daily Telegraph’s lobby correspondents routinely hear what Liberal Democrat MPs are “really saying” about the Coalition. But because these conversations are on lobby terms, any criticisms will not be attributed to the MP in question.

but that therefore it was therefore necessary to record covertly somewhere else in order for direct ‘evidence’ to be obtained, and that this may form the thin end of a very long wedge. That “somewhere else” was the Constituency Surgery.

As a general rule, the constituency surgery of an MP should not be the place for secret recordings. That said, the confidentiality of the constituency surgery is there to protect the constituent, and not the MP (just as legal professional privilege is there to protect the client and not the lawyer). And so it is open for any constituent (real or supposed) to disclose what is said by an MP. So, on this basis, the Daily Telegraph’s secret recordings do not so far breach any grand political or legal principle.

However, there is some cause for concern. One suspects that the first use of interceptions of voicemails by tabloid reporters had a solid public interest basis; but it was quickly realised that such material was a rich seam to be mined just for trivial stories. Similarly, one hopes that newspapers do not now see constituency surgeries as “fair game”. The secret recording of a constituent would never be appropriate: there will always need to be a private space where a constituent can speak candidly to his or her Member of Parliament.

A variety of security measures would be available, ranging from verification of home addresses as being in the MP’s constituency to metal detectors and searches. Portable fingerprint scanners are now in use by the police routinely.

In a different context there was a conversation several years ago about whether the full Islamic veil was appropriate for an MP’s surgery, sparked off by Jack Straw.

Games, systems and context in journalism at News Rewired

I went to News Rewired on Thursday, along with dozens of other journalists and folk concerned in various ways with news production. Some threads that ran through the day for me were discussions of how we publish our data (and allow others to do the same), how we link our stories together with each other and the rest of the web, and how we can help our readers to explore context around our stories.

Continue reading

Adding geographical information to a spreadsheet based on postcodes – Google Refine and APIs

If you have a spreadsheet containing geographical data such as postcodes you may want to know what constituency they are in, or convert them to local authority. That was a question that Bill Thompson asked on Twitter this week – and this is how I used Google Refine to do that: adding extra columns to a spreadsheet with geographic information.

You can watch a video tutorial of this here.

1. Find a website that gives information based on a postcode

First, I needed to find an API which would return a page of information on any postcode in JSON…

If that sounds like double-dutch, don’t worry, try this instead.

Translation: First, I needed either of these websites: http://www.uk-postcodes.com/ or http://mapit.mysociety.org/

Both of these will generate a page giving you details about any given postcode. The formatting of these pages is consistent, e.g.

(The first removes the space between the two parts of the postcode, and adds .json; the second replaces the space with %20 – although I’m told by Matthew Somerville that it will work with spaces and postcodes without spaces)

This information will be important when we start to use Google Refine…

2. Create a new column that has text in the same format as the webpages you want to fetch

In Google Refine click on the arrow at the top of your postcode column and follow the instructions here to create a new column which has the same postcode information, but with no spaces. To replace the space with %20 instead you would replace the express with

value.split(" ").join("%20")

Let’s name this column ‘SpacesRemoved’ and click OK.

Now that we’ve got postcodes in the same format as the webpages above, we can start to fetch a bunch of code giving us extra information on those postcodes.

3. Write some code that goes to a webpage and fetches information about each postcode

In Google Refine click on the arrow at the top of your ‘SpacesRemoved’ column and create a new column by selecting ‘Edit column’ > ‘Add column by fetching URLs…’

You can read more about this functionality here.

This time you will type the expression:

"http://www.uk-postcodes.com/postcode/"+value+".json"

That basically creates a URL that inserts ‘value’ (the value in the previous column) where you want it.

Call this column ‘JSON for postcode’ and click OK.

Each cell will now be filled with the results of that webpage. This might take a while.

4. Write some code that pulls out a specific piece of information from that

In Google Refine click on the arrow at the top of your ‘SpacesRemoved’ column and create a new column by selecting ‘Edit column’ > ‘Add column based on this column…’

Write the following expression:

value.parseJson()["administrative"]["district"]["title"]

Look at the preview as you type this and you’ll see information become more specific as you add each term in square brackets.

Call this ‘Council’ and click OK.

This column will now be populated with the council names for each postcode. You can repeat this process for other information, adapting the expression for different pieces of information such as constituency, easting and northing, and so on.

5. Export as a standard spreadsheet

Click Export in the top right corner and save your spreadsheet in the format you prefer. You can then upload this to Google Docs and share it publicly.

Other possibilities

Although this post is about postcode data you can use the same principles to add information based on any data that you can find an API for. For example if you had a column of charities you could use the Open Charities API to pull further details (http://opencharities.org/info/about). For local authority data you could pull from the OpenlyLocal API (http://openlylocal.com/info/api).

If you know of other similarly useful APIs let me know.