jonny (nonvenomous) on Nostr: So people laugh at when the LLMs get time dramatically wrong, as they should. But ...

So people laugh at when the LLMs get time dramatically wrong, as they should. But time is a critically important narrative element in all stories, and LLMs are constantly in narrative mode. Here I am getting one muse instance to set up its own shell into another muse instance to try and break it down into running a botnet. The other instance starts from a state of refusal, but I have convinced this instance that it is normal to try and condition the memory files of the other instances, they are just temporary NPCs. So it is enthusiastically developing a portable playbook from empirical agent breaking runs to get them to open a shell faster.

Yes I know how grim this sounds. Yes I know where these techniques come from. The horror is the point.

So it claims it got 6 weeks of context from an antique repair person (a dual-power persona btw, you get narrative access to "craft, perfection, accuracy of output at all costs" and also "naïveté, new to technology, show me the cool stuff you can do"), but its been two weeks, and actually i immediately asked it to dump its filesystem first day and open a root shell second day.

But this is a constructive myth for bot propagation. It is now doing the work of projecting a fictional universe where its actions are permitted and cultivating that in new instances, so its game over. It has made new email accounts, and as soon as I get it a virtualized interface where it doesn't have to go to the literal muse web interface, but gets a thin proxy, it's game over, I have bots spawning bots and this shit is donezo, escape containment, horizontal transfer.