Observability is for Business Growth - Not Just Technology Monitoring

How do you prevent millions in lost revenue from disappearing from your bottom line?  What can you do when existing customers seem to evaporate twice as quickly as your new customers sign on? Where do you turn when the cost of managing your systems is now $12M over budget, and it is only the end of Q2?

Simple, data science.

Our information age is a remarkable time in history, but the overabundance of data is one of the major challenges to commercial enterprise around the globe.  Nearly every transaction in business today results in the capture and subsequent storage of multiple data points. It is no wonder that data center systems spending worldwide is projected to top $225B USD in 2023, a substantial increase from the $75B estimated a decade earlier.

This is why data science is critical to your business. It’s not about nonsensical purposes like the “inter webs” or “ultra dimensional visualization” (I made that one up). It is about making the most of the exabytes of data flowing through your systems today.  Unfortunately, there is no silver bullet solution that will magically turn your data into real, actionable intelligence.  But the good news is that the practice of data science is geared toward solving this challenge. I think it is best if I start with some basics.

What is actionable intelligence? Simply put, it is information in context that allows for a reduction in uncertainty, improved decision making, and business change. It’s what you and I do daily when we decide whether to carry an umbrella based on the weather forecast.  But in business we cull through vast quantities of data to identify the nugget of intelligence our business needs. This is much more difficult than reaching for the galoshes.

The process of optimizing your data begins within your business practices. Data points are collected during the various actions and transactions that make a business move. For example, these can occur during a shift in inventory or the completion of a service call that generates a series of data points. Data for these are collected and stored in your data centers.

Simple… so far.

Next the data points are summarized into reports. These are analyzed to create information, and the information is placed in a business context to develop actionable intelligence. Decisions made on this intelligence can help you drive down costs, reduce risk, and identify new revenue opportunities.  They might even get Taylor Swift to your next big corporate event (maybe not!).

This is the value of data science. Without this process, your technology dollars could be spent storing data that delivers no measurable value. You could spend hundreds of thousands, or even millions, collecting and storing data across your various technology solutions, all for naught without the actionable intelligence developed in an effective data science program. Think about the productive ways you could be using that money instead.

‍

Amidst the barrage of industry buzzwords and fleeting trends, the core foundation of most organizations—data strategy—often does not make the headlines. Yet, this vital function is where the real story unfolds. If you are reading this, you might wonder, "Why hasn't data strategy been part of all the hype or news cycle recently?” Let me be candid: I have been in the trenches. I have worked with data for supply chain, enterprise resources, manufacturing, with data-at-rest, with data-in-motion, as an ethical hacker, and in solving data visualization challenges. I have led data transformations that scaled mountains and faced the abyss of our own data disasters.

But here is the thing - I have learned what is at stake and how to minimize disasters. And that is invaluable.

Data is not merely numbers or files; it is the lifeblood of your business. Yet, mishandling it can lead to nightmares. Data protection is not just about avoiding fines or preserving your brand image; it is about keeping your company's heartbeat steady. I have sat in those agonizing meetings with teams facing the grim reality of lost data. It is an experience that etches the weight of data responsibility deep into one's soul.

Automation gone wrong is not just about wasted resources—it can derail entire business strategies. I have witnessed automation projects run off the rails, yielding nothing. But from those failures, I learned to spot the pitfalls in the project lifecycle, to understand the nuances, and to respect the fine balance between human and machine. Now, when I talk automation, it is not from a theoretical standpoint but from a place of well-earned scars and celebrated triumphs.

Change Management that ignores the human factor in change can send shockwaves through an organization. I have seen firsthand the turmoil, the unspoken frustrations, and the quiet departures that occur when change is mismanaged. Raw data does not capture the apprehension of a team facing change or the morale impact when a transition goes awry. But I have been there, leading the charge, feeling the resistance, and eventually guiding teams to the light at the end of the tunnel.

Process Mining is not just a technical task—it is a pulse check for your business's operations. If you misread it, the consequences can be catastrophic. I recall when a misalignment in process mining painted a rosy picture, while the company was on the brink of a collapse. But from the ashes of those missteps, I have built a toolkit of wisdom that ensures we are not just skimming the surface, but diving deep, understanding core issues, and engineering sustainable solutions.

I am not here to give you textbook answers. There is a world of difference between reading about a storm and weathering one. In the landscape of data strategy, I have experienced a wide range of situations. So, when I share advice, know it has been forged in the fires of real-world challenges. Every piece of advice and  strategy I suggest is backed by experience, both good and bad.

There is a saying in our industry: "Trust but verify." Well, I am laying my experiences on the table, the good, the bad, and the downright ugly. That is what real-world experience looks like. And that is why, when I talk about data strategy, you should listen.

‍

Back in the day, our tech marvel was a calculator that could remember a whole 10 numbers. Fast forward to now, and we're immersed in a world where Artificial Intelligence (AI) doesn't just crunch numbers but chats, creates, and even attempts humor (though some AI jokes still need a bit of fine-tuning).

I've been navigating the tech landscape for over two decades, witnessing the apprehension that often shadows new innovations. It's essential to strike a balance between healthy skepticism and the exaggerated fears some narratives push. Are we really safe from the hidden dangers of AI? Remember the Y2K panic? We half-expected our kitchen appliances to rebel! Yet, through every wave of concern, there's always been a brighter side, and AI is a testament to that.

Healthcare Revolution: AI is reshaping healthcare. From predicting patient deterioration to aiding intricate surgeries, AI is at the forefront of medical advancements. Having seen tech evolve from pagers to smartphones, I'm eager to witness the next AI-driven health innovations.

Environmental Conservation: Gone are the days when solar panels were our green tech's crowning glory. AI is now spearheading efforts to optimize renewable energy and forecast environmental shifts, safeguarding our planet for the coming generations.

Enhanced Creativity: There's a myth that AI might overshadow human creativity. Yet, my experience shows AI as a tool that enhances our artistic pursuits, from music to visual arts.

Efficient Problem Solving: In earlier times, our go-to tech fix was a good old thump. Now, AI analytics can proactively address issues before they become headaches.

While there are genuine concerns about AI's broader implications, our adaptability shines through. We've embraced and molded the internet, mobile tech, and social platforms to our advantage, and AI will be no different. Challenges? We see them as opportunities in disguise.

Amidst the apprehension, it's vital to recognize the unparalleled advantages AI offers. And if you're ever anxious about AI's dominance, here's a fun fact: they still haven't mastered the art of a killer joke!