Skip to main content

The Shift from Monitoring to Observability

A few years ago, I would have said monitoring was good enough for most systems. But then cloud systems exploded in complexity, and everything changed. These days, when dealing with loads of microservices, containers, and distributed applications running all at once, I quickly realised that monitoring alone just points out that something’s broken. It rarely tells the whole story.

Observability is what’s changed the game for me and many engineers. It’s about seeing under the surface, connecting the scattered pieces — metrics, logs, traces, dependencies — and understanding how everything interacts. It’s the difference between knowing there’s a fire alarm going off and knowing where the fire is and what caused it.

I’ve seen firsthand how missing observability leads to playing whack-a-mole with incidents. It becomes a constant scramble to fix things after the fact. According to a 2024 Grafana Labs survey, over 80% of organisations still struggle to trace incidents to the root cause in today’s complex environments. That’s not just stressful — it’s expensive. The industry numbers back this up: the observability market is growing at lightning speed and is set to reach $6.1 billion by 2030. Teams that invest in observability consistently resolve issues faster and bring down downtime. From what I’ve experienced, these benefits are impossible to ignore, and it’s not just the IT folks who notice — customers do, too.



Working in managed cloud environments, I’ve seen how observability reshapes team dynamics. Instead of reacting to outages once users complain, teams can use trends and signals to fix problems before they escalate. There’s less guesswork, less finger-pointing, and far more collaboration, because everyone has access to the same clear view of what’s happening.

A big plus? Teams spend less time juggling dashboards and more time making lasting improvements. Early anomaly detection means stronger uptime and better customer satisfaction. What I like most is how every incident becomes a chance to learn and automate the “fix” for next time, moving the whole team toward real resilience.

Observability in Azure powered by AI

Azure’s observability tools have made a real difference for teams I’ve worked with. Azure Monitor brings all your telemetry — logs, metrics, and traces — into one place. At the same time, Application Insights offers a deeper look into app performance and how dependencies behave behind the scenes. With Azure Log Analytics and its powerful queries, it’s possible to connect events and issues rapidly. OpenTelemetry bridges gaps in multi-cloud or hybrid setups, offering true end-to-end tracing.

When all these come together, you don’t just spot issues faster — you connect them to code or changes, and respond confidently in real time.

The latest thing is how AI now supercharges this whole process. In Azure, AI can learn “normal” behaviours and automatically alert you to anything strange, without needing you to set up complex rules. Sometimes it feels like magic to ask Copilot a question in plain English for Azure Log Analytics and instantly get the log analysis you need. When predictive alerts warn about issues before they reach users, you feel ahead of the curve for once.

AI doesn’t just reduce alert overload — it highlights the true causes and even recommends steps to resolve them, which means more time building and less time firefighting.

Thoughts... not the final ones...

The way I see it, monitoring answers “what happened,” while observability digs into “why” — and helps keep tomorrow’s systems healthier than today’s. Cloud complexity isn’t going away, but with a robust observability strategy, it becomes much easier to trust that what’s running behind the scenes is working. With Azure’s growing set of AI-driven tools, I’m excited for a future where our systems start to look after themselves, and engineers can focus on what matters most. 

Comments

Popular posts from this blog

How to audit an Azure Cosmos DB

In this post, we will talk about how we can audit an Azure Cosmos DB database. Before jumping into the problem let us define the business requirement: As an Administrator I want to be able to audit all changes that were done to specific collection inside my Azure Cosmos DB. The requirement is simple, but can be a little tricky to implement fully. First of all when you are using Azure Cosmos DB or any other storage solution there are 99% odds that you’ll have more than one system that writes data to it. This means that you have or not have control on the systems that are doing any create/update/delete operations. Solution 1: Diagnostic Logs Cosmos DB allows us activate diagnostics logs and stream the output a storage account for achieving to other systems like Event Hub or Log Analytics. This would allow us to have information related to who, when, what, response code and how the access operation to our Cosmos DB was done. Beside this there is a field that specifies what was th...

Cloud Myths: Migrating to the cloud is quick and easy (Pill 2 of 5 / Cloud Pills)

The idea that migration to the cloud is simple, straightforward and rapid is a wrong assumption. It’s a common misconception of business stakeholders that generates delays, budget overruns and technical dept. A migration requires laborious planning, technical expertise and a rigorous process.  Migrations, especially cloud migrations, are not one-size-fits-all journeys. One of the most critical steps is under evaluation, under budget and under consideration. The evaluation phase, where existing infrastructure, applications, database, network and the end-to-end estate are evaluated and mapped to a cloud strategy, is crucial to ensure the success of cloud migration. Additional factors such as security, compliance, and system dependencies increase the complexity of cloud migration.  A misconception regarding lift-and-shits is that they are fast and cheap. Moving applications to the cloud without changes does not provide the capability to optimise costs and performance, leading to ...

Cloud Myths: Cloud is Cheaper (Pill 1 of 5 / Cloud Pills)

Cloud Myths: Cloud is Cheaper (Pill 1 of 5 / Cloud Pills) The idea that moving to the cloud reduces the costs is a common misconception. The cloud infrastructure provides flexibility, scalability, and better CAPEX, but it does not guarantee lower costs without proper optimisation and management of the cloud services and infrastructure. Idle and unused resources, overprovisioning, oversize databases, and unnecessary data transfer can increase running costs. The regional pricing mode, multi-cloud complexity, and cost variety add extra complexity to the cost function. Cloud adoption without a cost governance strategy can result in unexpected expenses. Improper usage, combined with a pay-as-you-go model, can result in a nightmare for business stakeholders who cannot track and manage the monthly costs. Cloud-native services such as AI services, managed databases, and analytics platforms are powerful, provide out-of-the-shelve capabilities, and increase business agility and innovation. H...