Join Nostr
2024-09-27 16:01:48 UTC
in reply to

Deus on Nostr: So I read somewhere that just like disallow all in Robots.txt works if the bots ...

So I read somewhere that just like disallow all in Robots.txt works if the bots respect it or not. And that it's the same case with these "AI scrapers" and there's no way to 'brute force' stop them, am I right? Has anyone arrived at a solution to this?