Needles and haystacks

by admin on January 11, 2007

in General

For those interested in grown up business intelligence, Andy Hayler has a terrific blog on the topic. I first met Andy when he ran Kalido, a specialised data warehouse company. He is super smart. The other day Andy pointed to an Information Week discussion about information overload. That in turn was based upon an Accenture report (sorry, no link available) which talks about the consequences of accessing the right information. According to Information Week:

IT managers say information-overload affects their jobs in a number of ways. Forty-two percent complain they are bombarded by too much information; 44% complain other departments in their companies are not forthcoming with data; 39% say they can’t figure out which information is current; 38% say they need to weed out duplicate information; and 21% say they don’t understand the value of the information they do receive.

What a mess? It’s an issue to which I can relate because try as I might, much of the information I really want is still hard to find. And that’s coming from someone who spends all day searching for stories. Andy’s incisive commentary argues:

The issue is not only that technologies are insufficiently intuitive. In my experience there are a number of factors that come into play:

- no culture of sharing information

- inconsistent data definitions

- poor data quality

- inability to locate appropriate data sources

- insufficient understanding of how to use BI tools effectively.

The one that interests me is ‘no culture’ because I believe the technology issues go away. But that’s for another day. Andy says:

If you set out to produce a useful new report in some area and succeed in doing so, what incentive is there for you to make this easily shared around the company, and to help others find it? In most companies this would be pure altruism, and so people just keep the information on their hard disk, and indeed may gain kudos from the “information is power” syndrome. Overcoming such cultural barriers is hard, and few companies succeed.

This worries me. I find it hard to believe that in the current world we occupy, that such Soviet style thinking persists to such an extent. It simply doesn’t make sense. I know as a profession we tend to believe that what we ‘know’ has an intrinsic value. Well, yes, in an academic sense, but knowledge is of no value unless it has context. Like the conversation I had with Julie Le of Zoobug where we talked about the value of certain services. My understanding of the area only takes on value when it is shared. As I explained to Julie, I can and do give a way a lot of information and I find it pays off.

It seems to me the obvious answer comes from using bottom up enterprise strength blog/wiki/RSS/search like say Blogtronix. SocialText, Attensa and Google. That could be a useful combination to kick start the discovery process at ridiculously low per user cost. Each of these services can be trialled though I rather suspect the standard 30-day period is a waste of time for most businesses. I struggle with fully understanding an industrial strength service because my attention is pulled in all sorts of directions. As I suspect most people’s attention is. I’d prefer 90-days.

In my experience, I’d much rather spend time working on relevant information rather than trying to hunt it down. I’d much rather forget organisational boundaries if it makes me more effective because there is satisfaction and comfort in doing that. These tools are certainly easing the information blockage overflow/problem but I accept there’s still more that can be done. The good news is that these tools deliver incremental value I can see will carry through into the future.

Which begs an interesting question. Why would I need BI tools when I can blog/wiki/RSS/search for it at a fraction of the cost today and not at some indeterminate time in the future?

Technorati Tags: ,

Comments have been disabled for this post.
Sort: Newest | Oldest

Excellent. I'm glad to read this dialog in our field (accounting). In the last year and half I've reached a similar conclusion. I've experimented with several wikis and blogs. For blogs, Wordpress is a no-brainer. Especially now with Wordpress MU. As for wiki software, sorry but Socialtext is a joke. The best business offering I've tried is MindTouch's (www.mindtouch.com). I have a client that uses their DekiBox. This is how I learned of MindTouch. An IT friend runs their open source version. I've been using their latest beta product. It's a VM based solution. I don't believe they offer a 90-day trial. By the way I totally agree with you on this. But their new product is free indefintely for the first 5 users. You can download it: www.mindtouch.com/evaluation , but it requires a login: "deki" and password: "beta".

You make a good point: the blogging from within such companies as Microsoft and SUN is new behaviour and the story on DKW shows that a wiki worked well for them.

These examples bring to mind shining examples of Total Quality Management that people used to talk about. In places where I've worked, TQM was a box to be checked but in practice didn't scratch the surface of the corporate cultures.

So, I concede these things are possible. What is probable is still to be revealed.

Interesting idea. Have you seen how Rod Boothby articulates this at InnovationCreators? It might be worthwhile checking out the Dresdner Keinwort Wasserstein case study at SocialText.

The person behindd that is JP Rangaswami, now at BT but his site talks about internal change a LOT - ConfusedOfCalcutta.

The BBC has had multiple ongoing projects of this kind ongoing for a few years.

Hello Dennis,

Like you, I'm fond of blogs, wikis, Google, etc. finding them both enriching and enabling. Nonetheless, I've never seen them used effectively across the internal boundaries of a large company. Further, I think a large business culture that actually allowed them to succeed would be quite remarkable.

A few years ago, my then employer implemented an intranet site, together with a forum. It was a flop - and the stumbling block was not technical but cultural. I would not be optimistic that more modern wikis, etc. would stand any better chance.

"Soviet style thinking" doesn't seem a mystery to me. Isn't it simply the result of being at work where extrinsic motivation dominates. There's no difficulty in finding lots of willing users of wikis and blogs when they are persuing their hobbies, because that's where intrinsic motivation rules.

Previous post:

Next post: