B2B Articles - Jul 16, 2012 9:15:05 AM

Webmaster alerts for crawl errors

Google is now sending out Google Webmaster Tools alerts for crawl errors with websites. The alerts are organized into two categories:

  1. Website Error alerts for major site-wide problems
  2. URL Error anomaly alerts for  less critical issues

Examples of major site-wide crawl error issues

  • Your DNS server is down or misconfigured.
  • Your web server itself is firewalled off.
  • Your web server is refusing connections from Googlebot.
  • Your web server is overloaded, or down.
  • Your site’s robots.txt is inaccessible.

Examples of URL Error Anomaly Alerts

  • Server error
  • Soft 404
  • Access denied
  • Not found
  • Not followed

The reason why Google can detect and distinguish such crawl errors is due to the fact that the Googlebot regularly crawls websites and can find irregularities in crawl patterns. Systemic errors experienced by the Googlebot can indicate problems by average users.

Tel 212-993-7809  

Ironpaper ®
10 East 33rd Street 
6th Floor
New York, NY 10016

Ironpaper - B2B Agency

B2B Marketing and Growth Agency.

Grow your B2B business boldly. Ironpaper is a B2B marketing agency. We build growth engines for marketing and sales success. We drive demand generation campaigns, ABM programs, B2B content, sales enablement, qualified leads, and B2B marketing efforts. 

Ironpaper Twitter Ironpaper Linkedin