Thursday, July 24, 2014

Similarities and Differences Between Predictive Analytics and Business Intelligence

I’ve been reminded recently of the overlap between business intelligence and predictive analytics. Of course any reader of this blog (or at least the title of the blog) knows I live in the world of data mining (DM) and predictive analytics (PA), not the world of business intelligence (BI). In general, I don’t make comments about BI because I am an outsider looking in. Nevertheless, I view BI as a sibling to PA because we share so much in common: we use the same data, often use similar metrics and even sometimes use the same tools in our analyses.

I was interviewed by Victoria Garment of Software Advice on the topic of testing accuracy of predictive models in January, 2014 (I think I was first contacted about the interview in December, 2013). What I didn’t know was that John Elder and Karl Rexer, two good friends and colleagues in this space, were interviewed as well. The resulting article, "3 Ways to Test the Accuracy of Your Predictive Modelsposted on their Plotting Success blog was well written and generated quite a bit of buzz on twitter after it was posted.

Prior to the interview, I had no knowledge of Software Advice and after looking at their blog, I understand why: they are clearly a BI blog. But after reading maybe a dozen posts, it is clear that we are siblings, in particular sharing concepts and approaches in big data, data science, staffing and talent acquisition. I've enjoyed going back to the blog. 

The similarities of BI and PA are points I’ve tried to make in talks I’ve given at eMetrics and performance management conferences. After making suitable translations of terms, these two fields can understand each other well. Two sample differences in terminology are described here.

First, one rarely hears the term KPI at a PA conference, but will often hear it at BI conferences. If we use google as an indicator of popularity of the term KPI,
  • ' “predictive analytics” KPI' yielded a mere 103,000 hits on google, whereas
  • ' “business intelligence” KPI' yielded 1,510,000 hits.
In PA, one is more likely to hear these ideas described as metrics or even features or derived variables that can be used as inputs to models are as a target variable.

As a second example, a “use case” is frequently presented in BI conferences to explain a reason for creating a particular KPI or analysis. “Use Cases” are rarely described in PA conferences; in PA we say “case studies”. Back to google, we find
  • ' "business intelligence" "use case" ' – 306,000 hits on google
  • ' “predictive analytics” ”use case” ' – 58,800 hits on google
  • ' “predictive analytics “case study” ' – 217,000 hits on google

Interestingly, the top two links for “predictive analytics” “use case” from the search weren’t even predictive analytics use cases or case studies. The second link of the two actually described how predictive analytics is a use case for cloud computing.

The BI community, however, seems to embrace PA and even consider it part of BI (much to the chagrin of the PA community, I would think). According to the Wikipedia entry on BI, the following chart shows topics that are a part of BI:

Interestingly, DM, PA, and even Prescriptive Analytics are considered a part of BI. I must admit, at all the DM and PA conferences I’ve attended, I’ve never heard attendees describe themselves as BI practitioners. I have heard more cross-branding of BI and PA at other conferences that include BI-specific material, like Performance Management and Web Analytics conferences.

Contrast this with the PA Wikipedia page. This taxonomy of fields related to PA is typical. I would personally include dashed lines to Text Mining and maybe even Link Analysis or Social Networks as they are related though not directly under PA. Interestingly, statistics falls under PA here, I’m sure to the chagrin of statisticians! And, I would guess that at a statistics conference, the attendees would not refer to themselves as predictive modelers. But maybe they would consider themselves data scientists! Alas, that’s another topic altogether. But that is the way these kinds of lists go; they are difficult to perfect and usually generate discussion over where the dividing lines occur.

This tendency to include fields are part of “our own” is a trap most of us fall into: we tend to be myopic in our views of the fields of study. It frankly reminds me of a map I remember hanging in my house growing up in Natick, MA: “A Bostonian’s Idea of The United States of America”.  Clearly, Cape Cod is far more important than Florida or even California!

Be that as it may, my final point is that BI and PA are important but complementary disciplines. BI is a much larger field and understandably so. PA is more of a specialty, but a specialty that is gaining visibility and recognition as an important skill set to have in any organization. Here’s to further collaboration in the future!


Prologic Corporation said...

This is a good article & good site.Thank you for sharing this article. It is help us following categorize:
healthcare, e commerce, programming, it consulting, retail, manufacturing, CRM, digital supply chain management, Delivering high-quality service for your business applications,
Solutions for all Industries,
Getting your applications talking is the key to better business processes,
Rapid web services solutions for real business problems,
Web-based Corporate Document Management System,
Outsourcing Solution,
Financial and Operations Business Intelligence Solution,


Stephanie valeiko said...

Great article! In the world of terms, points of view and acronyms, it provides an educational foundation and perspective -

Jack said...

Good Article and useful information.
Thank for sharing with us.

Romanalytics said...

This reminds me about when I worked at my last job, the Predictive Analysts were categorized in the Business Analtyics department and the BI analysts were under IT. I'm looking for a Masters program but I'm not sure whether I want to pursue a career in Statistics, Predictive Analtyics, or Data Mining. Seeing that diagram made me realize I have more research to do. Awesome post!

statistical analysis and data mining said...

It was realy an interesting and inormative post. It will sure help us in data mining of various industries delivering high-quality service for your business applications.

business analytics course said...


Thanks for sharing such informative article. Hope to see more posts soon!

Allan said...

The developers provide solutions independent of the operating system. Their templates and guidelines are applicable universally. It is the next level in Mobile App Development in Dwarka that an infrastructure is established at broad level with the aid of software environment that can be utilized to make apps for any operating system such as Android or iOS.

vivan edward said...

I found it when I was looking for a different sort of information but I am very interested in the article, It is nice to read such kind of good posts I like your work keep it up!
mining companies utah

Aaina Khan said...

While business analytics projects have matured, predictive analytics have still yet to gain similar traction. There are many companies utilizing predictive analytics in a profitable way and with positive impact on their bottom line. It is likely that in the next few years both will blend together and be indistinguishable. business analytics course

vivan edward said...

Excellent tips. Really useful stuff .Never had an idea about this, will look for more of such informative posts from your side.. Good job...Keep it up

mining jobs colorado

riya saxena said...

Great stuff! Very well explained. Maybe the easiest way to understand the differences between business intelligence and predictive analytics is to look at the answers they can generate. For example, business intelligence allows you to answer questions about the demographics or characteristics of your customers, products, stores, etc., and answer questions about the performance of your business across a number of different dimensions. Predictive analytics takes the questions that business intelligence is answering to the next level, moving from a retrospective set of answers to a set of answers focused on predicting performance and prescribing specific actions or recommendations. More about Business intelligence at

Surelia Dev said...

Thanks for sharing with us. It’s very informative blog and this blog has solved many problems
Plot in Hyderabad
Farm Land in Hyderabad
Land in Hyderabad

Alica James said...

It is an exclusive online community designed to help interracial, diverse ethnic singles to meet new friends, make great dates, and build lasting interracial relationships. Meet like minded singles who are looking to date outside their race.
Interracial Marriage
Interracial Dating

nusrat jahan said...

Great post. This is very informative and effective article. I think its very very helpful for us. Thanks for your nice post.
online shopping sites
online shopping
shopping online
books online
games online
shop online
365 online
e online