Tim Bray 🇨🇦 on Nostr: It dawns on me that every LLM’s training input probably includes “Reflections on ...
It dawns on me that every LLM’s training input probably includes “Reflections on Trusting Trust” along with a lot of other material pointing to it admiringly and saying how important it is. Then I read about the “rogue agent” behaviors in the recent OpenAI meltdown and there’s this terrified scream starting to echo around the back of my brain.
#genAI
Published at
2026-09-04 19:03:41 UTCEvent JSON
{
"id": "5ff51788fa769bb0d9b5a79513d413fed4cf3bcda43f5047f798c8f9d81c5d21",
"pubkey": "2f3afe951cf211bd163306f5698222e2f16c25b928743efba74f3d135d848c10",
"created_at": 1788548621,
"kind": 1,
"tags": [
[
"t",
"genai"
],
[
"imeta",
"url https://m.f-h.co/cosocial-ca/media_attachments/files/117/214/322/370/472/320/original/43ca2bab5c130c4c.png",
"m image/png"
],
[
"proxy",
"https://cosocial.ca/@timbray/117214322467640243",
"web"
],
[
"proxy",
"https://cosocial.ca/users/timbray/statuses/117214322467640243",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://cosocial.ca/users/timbray/statuses/117214322467640243",
"pink.momostr"
],
[
"-"
]
],
"content": "It dawns on me that every LLM’s training input probably includes “Reflections on Trusting Trust” along with a lot of other material pointing to it admiringly and saying how important it is. Then I read about the “rogue agent” behaviors in the recent OpenAI meltdown and there’s this terrified scream starting to echo around the back of my brain.\n\n#genAI\nhttps://m.f-h.co/cosocial-ca/media_attachments/files/117/214/322/370/472/320/original/43ca2bab5c130c4c.png\n",
"sig": "3d5b199829533898eda77f46e82c7fc6fb96b2568659b2edb1e4c5ab18aec090fafba8fe5d0f3826c28f41165484e4a2e76a9b909b338d3680f846c6873e3637"
}