Jason Koebler / 404 Media:
Some popular sites like Condé Nast’s and Reuters’ have robots.txt files meant to block Anthropic’s bots, but Anthropic has just made new bots with other names — Hundreds of sites have put old Anthropic scrapers on their blocklist, while leaving a new one unblocked.
No comment yet, add your voice below!