nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpq7lgy0rj5a2nwpnyc4hup6ufpfz7wz6dzcgd3crm6fm2yd34dcz0qrh5lc3 (nprofile…5lc3) There’s a lot of good work being done here: https://github.com/ai-robots-txt/ai.robots.txt
This repo also has server configuration that will deny access to matching user agents (not just asking them nicely to go away via robots.txt). Of course it’s only as effective as honest crawlers that send a genuine UA string, but it’s a start.
Adam
npub1xj…8adpa
2025-05-12 11:49:06 UTC
in reply to nevent1q…3qdy
Author Public Key
npub1xj6phmj4dxzs7usud5p4v07l4q3m4z0fteln2j0y2lvmpmdddjvqa8adpaSeen on
wss://relay.ditto.pubPublished at
2025-05-12 11:49:06 UTCEvent JSON
{
"id": "c21ffe26d02d897f45f2afecedb79f4cdb834952768f284283a83cf0de3d3646",
"pubkey": "34b41bee5569850f721c6d03563fdfa823ba89e95e7f3549e457d9b0edad6c98",
"created_at": 1747050546,
"kind": 1,
"tags": [
[
"p",
"f7d0478e54eaa6e0cc98adf81d712148bce169a2c21b1c0f7a4ed446c6adc09e",
"wss://relay.mostr.pub"
],
[
"p",
"f6870afcde4480ec8508f50304859e14a51309ff24ab3f0f862c52bdc4af8747",
"wss://relay.mostr.pub"
],
[
"e",
"4d2dce4bd29eec1de93485624864a6ab4f8712eca54246268cdda402a56ceefb",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://social.lol/users/adam/statuses/114494704647781514",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.mostr.pub"
]
],
"content": "nostr:nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpq7lgy0rj5a2nwpnyc4hup6ufpfz7wz6dzcgd3crm6fm2yd34dcz0qrh5lc3 There’s a lot of good work being done here: https://github.com/ai-robots-txt/ai.robots.txt\n\nThis repo also has server configuration that will deny access to matching user agents (not just asking them nicely to go away via robots.txt). Of course it’s only as effective as honest crawlers that send a genuine UA string, but it’s a start.",
"sig": "db7bcdb5c8ce9fab825fdc0aa4240175bcc3bc09bbf602f9bc72ce1af4bdd5fb9a15b262c9427f2006497de0adb3f3a1409d876feacc310a615b739039a65c0b"
}