#Librarians and #Archivists: how are you and your orgs tackling the decision of whether to explicitly allow bots like ChatGPT to scrape your online archives and other content?
My instinct is to set all our htaccess files to “disallow” for all the reasons why these models are problematic, including not citing sources. (Yes, I know it’s a little late.)
But I suppose some will argue that allowing the bots serves a mission of information accessibility, given that web searching is moving to LLMs. 😞
Stephen Coles
npub1wl…k9dwm
2024-07-04 16:51:15 UTC
Author Public Key
npub1wlnr8z7vcapcqwjrwa5d2jtwxqd4euqgva8xrzm8wj20k0gw0y4swk9dwmPublished at
2024-07-04 16:51:15 UTCEvent JSON
{
"id": "da7e27bb8bbdea2c9b162536c21868e6cbce8a5f5232f0f6980f3c78e03f19c0",
"pubkey": "77e6338bccc743803a437768d5496e301b5cf008674e618b677494fb3d0e792b",
"created_at": 1720111875,
"kind": 1,
"tags": [
[
"t",
"librarians"
],
[
"t",
"archivists"
],
[
"proxy",
"https://mstdn.party/users/stewf/statuses/112729251849479915",
"activitypub"
]
],
"content": "#Librarians and #Archivists: how are you and your orgs tackling the decision of whether to explicitly allow bots like ChatGPT to scrape your online archives and other content?\n\nMy instinct is to set all our htaccess files to “disallow” for all the reasons why these models are problematic, including not citing sources. (Yes, I know it’s a little late.)\n\nBut I suppose some will argue that allowing the bots serves a mission of information accessibility, given that web searching is moving to LLMs. 😞",
"sig": "2973a6f3bae32f26f2ce97f6df87584510427402c8b8492dc7bf0136fb7796a5e6d8ca670ab5a6d696d881767b3dbf6951c22d526106fa217884e9cb4ef9153f"
}