Finding Value in Analytics, Part II: Our BI Legacy

Finding Value in Analytics - Part II

In this series of articles, our journey is finding the value generated by analytics within enterprise IT systems. In the first article, we set the stage for this journey by introducing the economic value principle:


Information has economic value only if organizations are enabled to make actionable choices that yield higher expected payoffs than if those choices were made in the absence of that information.


The implication is…to have value, analytics should enable the organization to execute improved actions that, in aggregate, modifies organization behavior toward customers and the like. The objective is a positive net value. 

In this second blog, we will explore our seven-decade legacy using various technologies to support Business Intelligence. BI is increasingly relying on machine-learning (ML) analytics that is known informally as artificial intelligence (AI) and properly as deep learning using artificial neural networks. 

The table below is an overview of those decades in terms of the value generated by the IT infrastructure. Note the general flow of the value definition (right column) through the decades. And, don’t be distracted by the details. 

Decade
Theme
Technology
Value
1950’s
Report Generation
keypunch, mag tapes, line printer, mainframes, COBOL, FORTRAN
Reducing internal costs and errors of manual clerical processing
1960’s
Transaction Processing
System-of-Record, merge-sort, OR/MS, ERP
Increasing efficiency of administrating financial and then other functional areas
1970’s
Database Management & Decision Support
CODASYL, relational normalization, joins, static SQL, IFPS, what-if cases, PC
Better choices for big decisions by a few executives; plus, efficiency in data mgt
1980’s
Online Database Systems
dynamic SQL, online reports, spreadsheets, dashboards, KPI
Better choices for small frequent decisions by many employees
1990’s
Data Warehousing
SVOT, ER model, subject areas, ETL-ELT, star schemas, data marts, ODS, Active DW, mobile
Data integration for Single Version of the Truth enabling cross-functional insights to optimize corporate-wide processes
2000’s
Visual Descriptive Analytics
drill-down, trending, ease-of-use UI, Big Data, insights
Insights into data patterns that improve policies and procedures by management
2010’s
Interactive Predictive Analytics
Big Data, machine learning,
Statistical predictions based on historical data for better planning of biz operations

Do you see the flow patterns in these BI periods? Notice the impacts of certain IT technologies, such as the organization of databases, the concept of decision support, cross-functional views of data warehouses, and interactivity of visual analysis. 

Here are some patterns to consider:

CumulativeThe first pattern that struck me is that the technology from each of these periods is present, alive, and improved today. Prior technology is not destroyed, but it stimulates, promotes, and blends into the next. We still do report generation, big time! We just do not kill trees to accomplish it. In the 1950s, interactive visual analysis was performed by plotting points manually on the blackboard while someone shouted out the numbers from a stack of green-lined printer output. That was the early beginnings of VisiCalc, 1-2-3, Excel and now Qlik & Tableau.

Pervasiveness: BI emerges explicitly around the 1960s as Decision Support Systems, which focuses on infrequent big decisions by executives. Subsequent periods progressively increased BI pervasiveness throughout the entire organization. Hence, BI today is about smart enterprise systems that change overall organizational behavior, both internally for thousands of employees and externally via web-based services to millions of customers.

Disruption: Each BI period contains the seeds for disruptive innovation, thus enabling the emergence of the next period. The infrastructure and practices of the previous era endure (with modifications) and enable its successor to exceed. As this blending into the new BI period occurs, there are dramatic shifts in concepts and twists in practices, resulting in disruptive infrastructure changes.

ActionableEach BI period offers a different value sequence for transforming data into action. In the literature, this sequence is described as a value chain where raw materials (data) are transformed into finished goods (actions) via a sequence of processes, the sum of which yields a net economic value. 

GeneralizingThe earlier periods focused solely on managing and describing known data, while the latter periods increasing emphasized generalizing beyond known data. This is the essence of being analytic. Generalizing is the inclusive term for inferring or predicting. The conceptual leap from describing to generalizing is one that everyone performs naturally and quickly, but they also perform predictably irrationally and sub-optimally. Capabilities of future analytics to generalize effectively will become the major value generator, as analytics teases every gram of actionable information from our big data. 

EffectivenessThe earlier periods were justified by reducing current administrative costs. This generates value via efficiency, which implies performing pre-defined actions better for a generic business situation. The latter periods shifted toward generating value via effectiveness, which implies performing better actions tailored to specific business situations. The key factor is the variability of the actions required for the situation. The extremes are a single market of a million customers versus a million markets of a single customer. 

Take-away:

Look around your organization for the numerous ways that BI systems are assisting your business. Become aware of this value perspective across your organization. What if pieces of that infrastructure cease to function? Describe how economic value would change? What would be the impacts on the financial statement? 

Note how analytics specifically contributes value. Start imagining that Excel (or similar) stops working. Then, imagine more advanced forms of data analysis tools or systems ceasing to work. What is the value generated from each? What are the impacts on the financials? 

Where are we heading on this value-finding journey? 

What will be the value generators for the 2020 decade? The next blog will offer clues based on the above flow patterns. We will also dive into distinctive implications of next-gen analytics based on neural networks, such as thinking casually. 

In summary, BI has given us a rich legacy and an exciting future, assuming that we, as a global BI professional community, can guide its usage over the next decade effectively and properly for everyone’s benefit. 

Read Finding Value in Analytics, Part III: Next-Gen

Richard Hackathorn

Richard Hackathorn, Ph.D., of Bolder Technology, Inc. is a well-known industry analyst, technology innovator, and international lecturer in business intelligence and data analytics. He is currently focusing on the managerial...

More About Richard Hackathorn