Victoria Stuart 🇨🇦 🏳️⚧️ on Nostr: Our world changed with LLM / AI chatbots, which must be assessed for reliability. I ...
Our world changed with LLM / AI chatbots, which must be assessed for reliability. I evaluate LLM in part by asking them about known content (me!).
In today's news Olmo 3 (Allen AI) is an epic fail on my self-test.
Aside: another chatbot I recently tested was initally dead-on viz-a-viz me BUT (exhausted of facts) w/o warning BADLY hallucinated when pressed for additional detail, fabricating false content.
Better models (Claude ...) will admit no new data and stop.
#Olmo3 #Ai2 #DigitalLiteracy
Published at
2025-11-21 21:14:58 UTCEvent JSON
{
"id": "c713b508d032fd1f2021d106bb8b4e4749b96a34569bb285a5520e3392530790",
"pubkey": "ba127250544b40c3d80f42bfa4cde70f089f92c8b58393bb55f91cb76378cec7",
"created_at": 1763759698,
"kind": 1,
"tags": [
[
"t",
"ai2"
],
[
"t",
"olmo3"
],
[
"t",
"digitalliteracy"
],
[
"imeta",
"url https://files.mastodon.social/media_attachments/files/115/589/751/595/453/205/original/3b2fb1a24e79b410.png",
"m image/png",
"dim 749x989",
"blurhash UFQcbeogxt%201f+juWB57ayR*WBVtWCWBa{"
],
[
"proxy",
"https://mastodon.social/users/persagen/statuses/115589755607983294",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.ditto.pub/"
]
],
"content": "Our world changed with LLM / AI chatbots, which must be assessed for reliability. I evaluate LLM in part by asking them about known content (me!).\n\nIn today's news Olmo 3 (Allen AI) is an epic fail on my self-test.\n\nAside: another chatbot I recently tested was initally dead-on viz-a-viz me BUT (exhausted of facts) w/o warning BADLY hallucinated when pressed for additional detail, fabricating false content.\nBetter models (Claude ...) will admit no new data and stop.\n\n#Olmo3 #Ai2 #DigitalLiteracy\n\nhttps://files.mastodon.social/media_attachments/files/115/589/751/595/453/205/original/3b2fb1a24e79b410.png",
"sig": "ed062437cd72804e4d1f71d880814632231c22d276eb54518063e4f4c6a16bc4d4c56fdf534ce9ddf25661e9887d1c3cf312479165dab15dcf3aa3f9d60b5aac"
}
