Tuesday, May 11, 2010

web analytics and predictive analytics: comments from emetrics

I just got back from the latest (and my first) eMetrics conference in San Jose, CA last week, and was very impressed by the practical nature of the conference. It was also a quite different experience for me to be in a setting where I knew very very few people there. I was there to co-present with Angel Morales "Behavioral Driven Marketing Attribution". Angel and I are co-founders of SmarterRemarketer, a new web analytics company, and this solution we described is just one nut we are trying to crack in the industry.

This post though is related to the overlap between web analytics and predictive analytics: very little right now. It really is a different world, and for many I spoke with, the mere mention of "predictive analytics" resulted in one of those unknowing looks back at me. In fairness, much that was spoken to me resulted in the same look!

One such topic was that of "use cases", a term used over and over in talks, but one that I don't encounter in the data mining world. We describe "case studies", but a "use case" is a smaller and more specific example of something interesting or unusual in how individuals or groups of individuals interact with web sites (I hope I got that right). The key though is that this is a thread of usage. In data mining, it is more typical that predictive models are built, and then to understand why the models are the way they are, one might trace through some of the more interesting branches of a tree or unusual variable combinations in something similar to this "use case" idea.

First, what to commend... The analyses I saw were quite good: customer segmentation, A/B testing, web page layout, some attribution, etc. There was a great keynote by Joe Megibow of Expedia describing how Expedia's entire web presence has changed in the past year. One of my favorite bloggers, Kevin Hillstrom of MineThatData fame gave a presentation praising the power of conditional probabilities (very nice!).  Lastly, there was one more keynote by someone I had never heard of (not to my credit), but is obviously a great communicator and is well-known in the web analytics world, Avinash Kaushik. One idea I liked very much from his keynote was the long tail: the tail of the distribution of keywords that navigates to his website contains many times more visits than his top 10. In the data mining world, of course, this would push us to characterize these sparsely populated items differently so they produce more influence in any predictive models. Lots to think about.

But I digress. The lack of data mining and predictive analytics at this conference begs (at least from me) the question: why not? They are swimming in data, have important business questions that need to be solved, and clearly not all of these are being solved well enough. That will be the subject of my next post.


Kristine Vick said...

Hi Dean! I enjoyed reading your post from the recent eMetrics Conference & the connection (or lack of) between web analytics and predictive analytics. I know several of our team members enjoyed meeting you & they are looking forward to further discussions! On a related note, I'm also looking forward to hosting the Hands On Predictive Analytics Workshop at Predictive Analytics World again in October!

Brian said...

Dean, Is your presentation available anywhere online? Those of us in multi channel marketing have struggled with allocation of an order for many years.

Dean Abbott said...

The article isn't yet online. I check to see when it will be. Thanks for your interest!

Dean Abbott said...

Kristine: PAW is a great conference, I'm looking forward to another successful hands-on workshop on Monday the 18th. (we may have some new analysis exercises for this one....)

ikongsgf said...

Dean, great to catch up at eMetrics. Great post. Your impressions are similar to mine. These two worlds have little overlap (but should have a lot). Some of the possible reasons: 1. walk before you run 2. how high are the stakes and how actionable are the results of doing something advanced like a forecast or cluster analysis? 3. many people just don't know of the above. 4. different analytical silos (web reporting, BI, the predictive analytics groups, etc.) with different managers and departmental missions and siloed data collection and reporting. Anyway, looking forward to your follow up post. Will try to catch your workshop at PAW.

Brian said...

Thanks for checking on availability Dean. You have some great talks that those of us that work for a cheap...er i mean frugal employer can not attend :)