j_bertolotti on Nostr: Tl;DR: “The short answer is no, they don’t [work reliably]” Using a LLM to ...
Tl;DR: “The short answer is no, they don’t [work reliably]”
Using a LLM to decide whether a text was written by a LLM is largely a fool's errand, and you will have an enormous amount of false positives.
(Not that the self-proclaimed "experts" at recognising LLM-generated text are much better. Most of their "telltale signs" are just BS.)
https://www.nature.com/articles/d41586-026-01358-2Published at
2026-07-07 08:41:09 UTCEvent JSON
{
"id": "9543f161ebe334bf3fc47c03ea11d75f5cb4c87240f3a2a5e3709221fa278841",
"pubkey": "e04ab873a2a16d381911efeaa323e063c07286adf850d765122d2723abde0122",
"created_at": 1783413669,
"kind": 1,
"tags": [
[
"proxy",
"https://mathstodon.xyz/@j_bertolotti/116877798249943061",
"web"
],
[
"proxy",
"https://mathstodon.xyz/users/j_bertolotti/statuses/116877798249943061",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://mathstodon.xyz/users/j_bertolotti/statuses/116877798249943061",
"pink.momostr"
],
[
"-"
]
],
"content": "Tl;DR: “The short answer is no, they don’t [work reliably]”\nUsing a LLM to decide whether a text was written by a LLM is largely a fool's errand, and you will have an enormous amount of false positives.\n(Not that the self-proclaimed \"experts\" at recognising LLM-generated text are much better. Most of their \"telltale signs\" are just BS.)\n\nhttps://www.nature.com/articles/d41586-026-01358-2",
"sig": "189e33320f3d6184b5d561869a71bb5671fe73a47790a1edd4ede885301597c4705046b3f42d8ea7906cb3935af3be94f485a0f69f7c9777af84a2230d472772"
}