A couple new #scrapers to block that I haven't seen on robotstxt.com:
* Amzn-SearchBot is the search engine for Alexa and Rufus. Amazon claims on https://developer.amazon.com/amazonbot that it doesn't do AI training, but it still hammered our sites the past two days.
* SleepBot I haven't found much on, but it was requesting URLs for files that were submitted in a document upload spam attack we had a few months ago. Very sus.
#SysAdmin #webhosting #bots
Rachel Rawlings
npub18w…ywcwl
2026-05-05 18:50:45 UTC
Author Public Key
npub18wmgwdw5qkdjpeanvu62pgr3ca459jwhkz63utc5mstec7jm2tzqyywcwlSeen on
wss://relay.ditto.pubPublished at
2026-05-05 18:50:45 UTCEvent JSON
{
"id": "fed2125597a8962863e8fac58afaffb274f80d4f66e949d3aca04d767b5033af",
"pubkey": "3bb68735d4059b20e7b36734a0a071c76b42c9d7b0b51e2f14dc179c7a5b52c4",
"created_at": 1778007045,
"kind": 1,
"tags": [
[
"t",
"scrapers"
],
[
"t",
"sysadmin"
],
[
"t",
"webhosting"
],
[
"t",
"bots"
],
[
"proxy",
"https://hachyderm.io/users/linuxandyarn/statuses/116523469746197525",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.ditto.pub"
]
],
"content": "A couple new #scrapers to block that I haven't seen on robotstxt.com:\n* Amzn-SearchBot is the search engine for Alexa and Rufus. Amazon claims on https://developer.amazon.com/amazonbot that it doesn't do AI training, but it still hammered our sites the past two days. \n* SleepBot I haven't found much on, but it was requesting URLs for files that were submitted in a document upload spam attack we had a few months ago. Very sus.\n\n#SysAdmin #webhosting #bots",
"sig": "cb9cff81b3fbe0dd5fbfe5aa90ea420dad6c0923a30bf938f17be346ca79b4691144e384c5a570a60361f4b111e7e84ec69a0b602af7b80701fefc0d3c946d83"
}