Real observability: logs, metrics and traces that talk to each other
Teams confuse monitoring with observability all the time. Monitoring alerts you that latency went up. Observability takes you to the guilty line of code — and the difference is correlation.
The three pillars
- Logs: discrete events with context. Great for the detail of what happened.
- Metrics: aggregated time series (p99 latency, throughput, error rate). Cheap to store, perfect for alerts and dashboards.
- Traces: the full path of a request across every service, with time spent at each hop.
Correlation is the trick
In isolation the three pillars have limited value. The real win comes when the same trace_id shows up in the log, the metric and the trace. You jump from a latency alert straight to the slow span and the query behind it — cutting MTTR from hours to minutes.
Cardinality and cost
Watch out for cardinality explosion: every label combination becomes a new series. Without discipline your observability bill grows faster than your infra. Choose labels deliberately.
Start where it hurts
Don't instrument everything at once. Start with business-critical endpoints, add distributed tracing on inter-service calls, then iterate. With Kubmix Flux you centralize logs, metrics and traces and correlate them in one place.