Sunday, November 17, 2013

Information must be actionable - the importance of context

Sometimes we ask for information but once we have it we realise that there is nothing we can do with it because we didn't capture enough context to interpret it.

Here are three examples from one organisation:
  • An open forum was held to report to staff on some organisational changes and part of the forum was capturing staff ideas for improvement. Ideas came thick and fast and were noted as quickly as possible on butcher's paper for collation and later consideration. When managers later met to consider the merit of the ideas they spent most of their time trying to work out what the ideas meant since there hadn't been time to clarify with staff during the meeting and insufficient detail had been gathered, with most of the ideas having been summarised in less than 10 words.
  • A survey was placed on the organisation's website for voluntary completion anonymously by clients. For each question where a client indicated they were dissatisfied with some aspect of the service the client was offered the option of elaborating in their own words what they saw as the problem. Twenty-five clients indicated that in letters not enough information was given explaining the decision. None of the clients elaborated. As a result the information was useless - it wasn't possible to track back to letters sent to those clients to see what they meant since the survey was anonymous and there was insufficient information to determine how the organisation's written communication could be improved. (Ironically, the respondents did exactly what they claimed the organisation was doing.)
  • In staff surveys one of the issues which also comes up in staff responses is poor communication by management. Yet senior management still don't know what staff mean when they talk about poor communication: is there too much? too little? is it too detailed? is it confusing? Is the problem limited to specific managers? Or is it a general? What specifically is meant by 'poor communication'? - no one seems to know.
In all three cases, the lack of context has resulted in resources being wasted getting information that doesn't inform and that isn't actionable in any way. Then further resources were wasted trying to mind-read what was meant.

Most of the time it would be better to capture stories. For example in the case of a staff survey, we could ask staff to describe an example of poor communication within the past three months, why they thought it was bad, what its effects were and how it could have been done better. Collecting stories about poor communication would enable us to narrow the definition of the problem into something which we could deal with rather than dealing with a nebulous amorphous 'something' which we could deal with if we only knew what it was.

But even more important is to clearly understand what sort of information will be useful and then properly designing a methodology for getting that sort of information. Survey design is sometimes thought of as a no-brainer, something anyone can do. And that is why so often surveys are a waste of time, money, and effort. Thinking it through at the beginning is more likely to yield a pay off than trying to be a psychic at the end! Use hindsight rather than foresight. If you settle for 'garbage in' then you are also settling for sorting through the 'garbage out' in the hope of finding 'something" useful.

Not a terribly exciting prospect is it?



No comments:

Post a Comment