Data Mining: Gluttony or Grail? - Association Marketing Springboard
Subscribe to my full feed.

Data Mining: Gluttony or Grail?

Wednesday, May 21, 2008

I recently went with Maddie "Get the data, then throw it out!" Grant to an ASAE Technology Idea Swap on data mining. Several folks from inside ASAE were there showing off their new predictive modeling software package, Clementine. Predictive analytics, in my mind, is like the holy grail of data mining—it becomes an obsession for those who pursue it, but does it really change anything?

As a marketer, the data geek side of me is just dying for a magical piece of software to make decisions for me. Who should I target? What should I say to them? What’s the magic formula for getting someone to join/register/buy?

But true “Freakonomics” moments—where the singular pursuit of data analysis reveals a truth no one ever could have hypothesized—are rare and overrated. By overindulging in a gluttony of data, you lose track of cause and effect and weaken your findings. For me, the real value of data is the ability to test ideas from real people who are bringing all of their experience and real-life interactions to the table. In other words, learning directly from our co-workers, partners and members, and then double checking what we’re learning against our data.

It’s no accident that Google has built human bias into their algorithm, or that human-powered search like Mahalo is all the rage.

At the ASAE Tech Conference in January, David Gammel and Wes Trochlil presented on putting the intelligence back into business intelligence. I was really impressed with their insight, and so I’m tagging them both on this post. I'm also tagging Mads who was at the swap;-) I hope you guys will share your considerable knowledge on the topic of data mining.

So the question is, does it make sense for a membership organization to spend time and resources on predictive modeling, or is it just another layer separating us from our members?

Posted by Lindy Dreyer at 5:49 PM  

______________________________________________________________

6 comments:

Wes Trochlil said...
Nice post, Lindy. There is no question that software itself is not going to bring you the holy grail. Humans have to be asking the right questions for the data to make any sense.

I'm presenting on using BI in membership and marketing next week at the ASAE Marketing and Membership Conference. One of my overarching points is that an organization must have a willingness to act on the information it has. So even predictive analytics are useless if the organization doesn't leverage the data to change how they do things.
May 22, 2008 8:27 AM  

Lindy Dreyer said...
Wes - thanks for adding that point. The willingness to act on data is a critical piece. It's another strike against the "Freakonomics" moment because in order to act on the data, you must build consensus around the process of uncovering game-changing information. I'm not going to change my behavior based on something I don't understand.
May 22, 2008 9:41 AM  

David Gammel said...
I'll also add that the dramatic examples we hear of the impact of data analysis are just that: the most dramatic examples. It's far more likely that solid data analysis will yield incremental improvements.

This is still very much worth it in the long run but I agree with you the the 'hallelujah' data results aren't going to happen all that often. And, as you and Wes have discussed, it all doesn't matter if you aren't willing to act upon what the data show you.
May 22, 2008 10:19 AM  

Lindy Dreyer said...
David - you're right. I guess I should make the point that I love data. But I must admit, I'm weary of the bill of goods that is promised by predictive analysis. It's still so expensive and time-laden, and I worry that it waters down our real goal--getting closer to our members.
May 22, 2008 10:46 AM  

christin berry said...
I think the value of data mining to find that nugget of information. Perhaps you already thought the nugget was true, but with data mining you’re able to use data to back up the assumption. At ASAE & The Center, we’re not going to stop connecting with members (via surveys, focus groups, personal interactions, etc) but we are testing predictive modeling to dig deeper. I don’t see it as a way to distance ourselves, rather a way to become even more intimate (in a way!) to what members are doing. And also, as I pointed out in the Swap, what people say they’re gonna do and what people actually do are two different things. So simply surveying members is only step one in the process.
I know I get wrapped up in the nice-to-know-cool-flashy-stuff versus the need-to-knows and you can use predictive analysis until your blue in the face and not get any actionables out of it. It has to be about changing behavior. And then measuring it. And then measuring it again.
We’ve just started on our predictive modeling journey. Love to hear all the view points. This “stuff” is relatively new to me, so I’m looking forward to learning from everyone along the way.
May 23, 2008 11:14 AM  

Lindy Dreyer said...
Christin - Thanks so much for commenting here. I'm happy to see you contextualize your work for our discussion.

Part of me would really like to be proven wrong here. If I can offer any advice to you and your team, it would be to 1) identify the decision-points you might be able to influence, 2) convince the people making those decisions to buy-in by bringing them into the process early and often, and 3) tap the knowledge of your colleagues to differentiate between cause and effect before you add a new variable to the analysis.

Also, check out Maddie's thoughts on the same idea swap in the "Links to this post" below.
May 23, 2008 12:01 PM  

Post a Comment