John Shehata, CEO of NewzDash, found something in July that a lot of publishers threatening to block Google’s AI don’t realize is already happening underneath them. Google has started folding entire Top Stories carousels directly inside AI Overviews, and the robots.txt directive most publishers reach for first does nothing to stop it. Shehata posted on […]
Report That Cloudflare AI Bot Blocking Prevents Googlebot From Indexing Sites
There’s a report that blocking AI training bots with Cloudflare is also blocking legitimate Googlebot and Bingbot from indexing a website. Cloudflare recently announced that this would happen beginning in September. It’s unclear whether this is a fluke or user error but it does serve as a reminder to be aware of the pending change […]