The Business Analytics & IT Monitoring Landscape
Before we get into the specifics of business monitoring, let’s first review how business analytics and IT monitoring have traditionally worked in an organization.Business Analytics
The new reality for nearly every business is that they generate massive amounts of data that may hold the key to their future success, and thus needs to be constantly analyzed. Many companies today still try to feed this data into legacy BI tools, although it’s become clear to many that these platforms require complex coordination and maintenance to deal with things like structured and unstructured data, cataloging data sources, adjusting static thresholds, and constantly building and “eyeballing” dashboards. To solve the challenges of modern business analytics, the field of autonomous, AI-based analytics has emerged as the dominant way to deal with the volume and volatility of human-generated data.IT Monitoring
As discussed in our white paper on Business Monitoring, many companies have tried to feed business metrics — such as revenue, user activity, and customer experience — into APM or IT monitoring systems. These solutions can monitor metrics in real time based on log or application data. The issue, however, is that these systems are built to monitor machines and not the human behavior that shapes business metrics. APM and IT monitoring solutions fail to understand the nuances and seasonality present in business data, and consequently are unable to produce the accuracy and granularity that's required to reduce both time to detection, root-cause analysis, and time to resolution for the incidents that most impact the bottom line. The reason for this shortcoming is quite simple: Monitoring machines and monitoring business KPIs are completely different tasks.Why Business Monitoring Has Become the New Standard
There are three main reasons that business metrics and KPIs are completely different from monitoring machine-generated data: context, topology and volatility.- Context: One of main differences of machine-data versus human-generated data is that context plays a large role in the latter. In particular, business metrics can’t be evaluated on an absolute basis, but rather in the context of changing conditions. The most common example of this is the ever-changing seasonality of human behavior, which must be accounted for in a business monitoring solution.
- Topology: When we’re monitoring machine data we already know the relationships, or topology, between different machines and metrics. With human-generated business metrics, on the other hand, the topology is unknown. This means that we need autonomous algorithms to learn and map these unique relationships on their own.
- Volatility: Unlike machine data, business KPIs are irregular and volatile. Instead of frequently getting new data at each time step, there may be several minutes or hours without certain user activity, such as a purchase for example. This irregular sampling rate means that we need a monitoring system that can adapt to these changes in real-time.
How AI & Machine Learning Deal with Complexity
AI and machine learning can deal with the above-mentioned complexity in the following ways:- Granularity: AI & machine learning can monitor 100% of the data in real-time. This is contrasted to a BI solution that might simply summarize data into a KPI, but not actually monitor the individual data points.
- Fully Autonomous: Through the use of unsupervised learning, the system can learn each one of the data points’ usual behavior on its own.
- Correlation & Root Cause Analysis: Each metric can also be correlated to one another, and with a root cause analysis you can go from detection to resolution in the fastest time possible.