“I’d created 2000 free-text responses and labelled them ‘UK’. Then I copied and pasted the exact same 2000 responses but labelled these ‘US’. Finally, I combined them to create a dataset of 4000 total responses, and jumbled them up.
Despite the responses being identical for the UK and US, Copilot produced a rich, detailed summary of how US and UK respondents differed.”
https://kucharski.substack.com/p/real-signals-or-artificial-stereotypes
H/T nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqxrvp0m595s633r7g5r9c9r5ccur8vxf0p9244ayamjflewjz4exss55c5s (nprofile…5c5s)
Greg Egan
npub1qq…j5nhv
2026-05-20 10:18:35 UTC
Author Public Key
npub1qqm7nu2qf25xd3mw6y6cyp4v2wr7ktf43ymp5wqz4u8jvz76ymtsjj5nhvSeen on
wss://relay.ditto.pubPublished at
2026-05-20 10:18:35 UTCEvent JSON
{
"id": "50abffe6e03ea5dd4661695fbea8bdbb981bc533fba3352218d2e67ebd8fe16f",
"pubkey": "0037e9f1404aa866c76ed1358206ac5387eb2d3589361a3802af0f260bda26d7",
"created_at": 1779272315,
"kind": 1,
"tags": [
[
"p",
"30d817ee85a435188fc8a0cb828e98c70676192f09555af49ddc93fcba42ae4d",
"wss://relay.ditto.pub"
],
[
"p",
"a3656f1f6910112c5d377d0a6113bb9d00e1d2d300cf90e9c8a6c67af346d50f",
"wss://relay.ditto.pub"
],
[
"proxy",
"https://mathstodon.xyz/users/gregeganSF/statuses/116606390500783662",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.ditto.pub"
]
],
"content": "“I’d created 2000 free-text responses and labelled them ‘UK’. Then I copied and pasted the exact same 2000 responses but labelled these ‘US’. Finally, I combined them to create a dataset of 4000 total responses, and jumbled them up.\n\nDespite the responses being identical for the UK and US, Copilot produced a rich, detailed summary of how US and UK respondents differed.”\n\nhttps://kucharski.substack.com/p/real-signals-or-artificial-stereotypes\n\nH/T nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqxrvp0m595s633r7g5r9c9r5ccur8vxf0p9244ayamjflewjz4exss55c5s",
"sig": "b7a18d62784cd8d59bb28bdf5a05655dad232ce916320b93ea8dbb9d8137c187afdae2a2ad6636a87f98e80a877a36a6a241f7369e780ab427557457384a7d97"
}