Open Source Summit Korea 2026

AI agents are quickly moving from prototypes to production systems that manage APIs, tools, and complex reasoning tasks.

Once these systems are deployed, they often act like black boxes, hiding failures, slowdowns, and unexpected behavior.

This session will show you how to add observability to agentic systems with open-source tools and cloud-native tech.

​Brandon and Mostafa will break down the lifecycle of an AI agent, covering prompt execution, tool invocation, memory access, and multi-agent coordination, and demonstrate how to make each stage observable.

Using a practical, architecture-focused approach, they will show how to:

- Trace agent workflows across distributed systems
- Monitor latency and token usage
- Detect anomalies such as hallucinations, tool misuse, and runaway behavior.
- Connect LLM behavior with infrastructure metrics like GPU, container, and network data.

They will also present a complete reference architecture that uses open-source projects including OpenTelemetry (OTel), Prometheus, Grafana, and some new tools for LLM observability.

Attendees will learn practical ways to build transparent and reliable production AI agent systems.