Discussion about this post

User's avatar
Olivia's avatar

There is a resistance of opportunists building towards protection and cost savings against AI bot scraping. That will be harder to do with features like “recall” built into the new Microsoft hardware in the future but I have some hope 😇

Cloudfare blocks AI bots by default

https://www.technologyreview.com/2025/07/01/1119498/cloudflare-will-now-by-default-block-ai-bots-from-crawling-its-clients-websites

Was

Open source

https://anubis.techaro.lol/docs/

No posts

Ready for more?