Search engine crawlers may perhaps examine a variety of different factors when crawling a web-site. Not each and every web site is indexed by serps. The distance of webpages within the root directory of the site may additionally be a factor in whether or not web pages get crawled.[forty two]??t inde