Gary Illyes of Google warns that sudden spikes in Google’s crawling activity could signal severe issues with your website. While increased crawling can sometimes indicate positive trends, Illyes advises caution. He highlights two common problems to watch for infinite spaces and potential website hacks. His advice underscores the importance of vigilance when monitoring your site’s crawl behavior.
Beware of Infinite Spaces: How They Can Trigger Crawling Spikes
Gary Illyes of Google has drawn attention to a critical issue known as “infinite spaces,” encompassing areas such as calendar modules or endlessly filterable product listings capable of generating infinite URLs.
When a website is already subject to frequent crawling, crawlers may exhibit heightened interest in these infinite spaces.
Illyes explains: “If your site generally hosts pages that search users find valuable, crawlers may temporarily prioritize crawling these infinite spaces.”
He advises using the robots.txt file to restrict crawler access to infinite spaces as a proactive measure.
Beware: Hacked Sites Can Trigger a Crawling Frenzy
Gary Illyes of Google highlights another concerning reason behind sudden crawling spikes: security breaches where hackers inject spam onto legitimate websites. Initially, crawlers might mistake this injected content as legitimate and start indexing it before recognizing its malicious nature.
Illyes explains: “If a malicious actor gains access to your site and floods it with spam content, crawlers may temporarily prioritize crawling these new pages.”
He emphasizes the importance of maintaining strong security measures to prevent unauthorized access and the subsequent impact on search engine crawling behavior.
Approach Crawling Spikes with Caution
Gary Illyes advises against assuming that a crawling spike is a positive development. Instead, he recommends treating it as a potential issue until the underlying cause is thoroughly investigated.
He explains: “Consider unexpected sharp increases in crawling as a symptom that requires further investigation, rather than automatically assuming it’s beneficial. Or, perhaps I’m just a hardline pessimist.”
This cautious approach underscores the importance of vigilance and thorough analysis when monitoring search engine crawling behavior changes.
Google’s Recovery Steps for Hacked Websites
Google’s video outlines a comprehensive recovery process for hacked websites:
- Identify the Vulnerability: Begin by pinpointing how the hacker gained access. Tools like Google’s Webmaster Tools can help detect vulnerabilities.
- Fix The Vulnerability: Once identified, close the security hole promptly to prevent future unauthorized access. This may involve updating software and adjusting passwords.
- Clean The Hacked Content: Thoroughly inspect the site’s content and code to remove spam, malware, defaced pages, or other unauthorized injections by the hacker. Security plugins such as Wordfence can facilitate this cleanup.
- Harden Security: Strengthen the site’s security beyond fixing the specific vulnerability. Measures could include enabling firewalls, restricting user permissions, and ensuring regular software updates.
- Request A Review: After patching the vulnerability and cleaning hacked content, request Google to review the site. Upon verification of cleanliness, Google will remove any security warnings or blacklists.
The video emphasizes that Google’s review process is typically quicker for malware issues (days) than spam issues (weeks), as spam cleanup requires more thorough inspection.
Additional Tips from Google’s John Mueller:
- Use the URL removal tool to deindex hacked pages swiftly.
- Focus on enhancing overall site quality beyond removing hacked content.
- Recovery of Google’s trust may take months, as lingering impacts can affect SEO.
These steps and insights from Google’s experts provide a structured approach to recovering from website hacking incidents effectively.
Why Website Security Matters
Ensuring website security is paramount for businesses, as compromised content can undermine trust and affect search engine rankings.
Gary Illyes from Google has highlighted that unexpected increases in crawling activity may signal security breaches or technical issues demanding urgent resolution. If you face challenges in managing these aspects, consider exploring our monthly SEO packages for expert assistance and guidance.