For about two months, business owners and SEO professionals have reported that pages have been removed from Google’s index without a clear explanation. The reports started in late April and have continued into June. In many of those reports, the affected pages had neither a manual action nor a crawl error. They moved into “excluded” […]
Google Explains Why URLs Blocked By Robots.txt Can Still Be Indexed
Google’s John Mueller answered a question about the curious circumstance of Search Console reporting thousands of URLs as indexed despite being blocked by robots.txt. Mueller helped explain how this happens and what to do about it. Content Indexed Despite Being Blocked By Robots.txt A Redditor asked for advice because Google Search Console was reporting more […]