tatiana :witches_town: on Nostr: actually, as mean girl as i am, i do let everybody ask for robots.txt. i get that the ...

actually, as mean girl as i am, i do let everybody ask for robots.txt. i get that the contract is broken, but i don't want to specifically target bots that might (might) care about my policies. that's like anubis only issuing challenges to requests whose user agents start with 'mozilla'. you're choosing to attack a set that's actually slightly less likely to be evil