Digital Content Next, a trade body representing US digital publishers, has sent a cease and desist letter to the Common Crawl Foundation. The letter demands Common Crawl stop collecting publisher content and remove material already in its datasets. DCN CEO Jason Kint announced the legal notice in a blog post, and Press Gazette reported additional […]
More News Sites Default To Blocking AI Crawlers
Reuters and Time now default to blocking AI bots, allowing only approved crawlers through allowlists, Digiday reports. Both publishers made the decision in May, joining People Inc. and The Atlantic, which adopted similar setups within the past year. Reuters says the change hasn’t cost it traffic, while cutting what it spends serving bots. Executives credit […]