We instrumented an AI agent swarm with SigNoz, and its own telemetry told us we were wrong about almost everything
A team built DevSwarm, a multi-agent system using five open-weight models (GLM-5.2, Qwen3-Coder-480B, Kimi-K2.7-Code) to generate full-stack apps from a single prompt, with every step instrumented as OpenTelemetry spans in self-hosted SigNoz. Telemetry revealed six critical misconceptions: blaming models for self-imposed limits, misattributing provider outages, assuming the review agent was strongest when it was weakest, and a design system that degraded output quality. The system processes 189 traced model calls across 8 models, 2.85M tokens, and 225 critic catches, with all metrics served live from ClickHouse queries against the trace store.