Join Nostr
2024-06-25 05:14:09 UTC
in reply to

gyptazy on Nostr: Stefano Marinelli Yeah that was a thing many people were complaining about the ...


Yeah that was a thing many people were complaining about the “Facebook external hit” crawler - especially it revisits every day and also fully downloads all binary artifacts which consumes a lot of bandwidth and on dynamic websites cpu and mem.

This was especially funny on mirrors and cdn archieves.