· Swadhin Kumar · AI Engineering
Making an LLM Agent Production-Grade
The unglamorous half of shipping Zoe: poisoned conversations that 400 forever, duplicate edits from retries, tool timeouts, rate limits, tracing, and the prompt caching and telemetry that made it affordable and debuggable.