All posts

"Running LLM automation unattended for months: what actually breaks"

An LLM automation that works in week one will find new ways to fail by month three. Here is what actually broke when I ran one unattended for months — from provider outages that arrive in bursts to a model that changed personality underneath me — and the small set of guards that earned their keep.

Category:

AI engineering

Posted by:

Ahmed

Tags:
  • #AIengineering
  • #Reliability
  • #Automation
  • #Production
Posted on:

8 July 2026

"Running LLM automation unattended for months: what actually breaks"

If you have an LLM feature in production, you have probably lived through the week where it quietly degraded and nobody noticed until a customer did. The demo was fine. The first month was fine. Then something shifted — the provider, the model, the inputs — and the thing that "just worked" started producing garbage with complete confidence. This post is a field report from the other side of that week.

© 2026 Ahmed Fareed. All rights reserved.

LOADING