Skip to content

Our AI support agent doesn't use RAG - here's the math

7.5 relevance
Score Breakdown
technical depth
9
novelty
8
actionability
7
community
3
strategic
6
personal
9

Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.

Novel AI support agent without RAG, strong technical depth and relevance.

AI/ML dev.to
Our AI support agent doesn't use RAG - here's the math
Summary

Clanker Support's AI agent loads all active knowledge sources (url, text, qa) directly into the system prompt, capped at 80k characters (~20k tokens), using a simple WHERE clause and per-source character budget (floor(80k/N)). This avoids RAG's complexity for small support knowledge bases, but fails when the corpus exceeds the context window. The approach is open-source and trades retrieval infrastructure for a dozen lines of arithmetic.

Author

Omar Bni

More from Omar Bni →