Join Nostr
2026-09-15 10:21:34 UTC

Christoffer S. on Nostr: On the topic of LLM-generated software there is one thing I've only grown more ...

On the topic of LLM-generated software there is one thing I've only grown more concerned and confident about - the need for systems design and architecture thinking.

From what I've experienced, both anecdotally and first-hand, is that LLM-generated software systems eventually devolve, and when they do it happens quickly.

One deviation in a pattern (assuming they even existed to begin with) will very quickly spiral out of control. One extra API-endpoint will be considered authoritative and justification for another, slight variation of the first.

If a system continues to receive new components, new material it will eventually find itself in a desperate state of repair, possibly even to the extent that it will require such a massive refactor it may actually be cheaper to rebuild entirely.

These "cracks" will not exist in smaller pieces of software, they are simply too small to exhibit these patterns. But with sufficient enough code base, with reasonable complexity it will start showing up at the seams.

If someone were to tell me they have not seen this, I would genuinely render me incredulous as to how they have managed to instruct a system to never bend a written, or more probably unwritten, rule of system design and architecture.

So, back to the original point. Software generation may be "solved" but systems design and architecture sure as hell is not "solved" and no amount of prompting will easily solve this IMHO.

It requires contextual queues coming from business domain language, societal rules and guidelines, and just sometimes... very simple human intuitive reasoning about a feature.

#LLM #Programming #SystemDesign #SoftwareArchitecture