The Mystery Behind Google’s Indexing of Blocked Content
Google's John Mueller clarifies why disallowed pages occasionally get indexed and advises that specific Search Console reports regarding these pages can be disregarded. Google’s John Mueller addressed a question about why pages blocked from crawling by robots.txt are still indexed and explained why it's safe to...