• URLs that a search engine bot is unable to crawl.
  • URLs that return a status code error.