Crawling The process of gathering information, using a crawler, from the billions of public web pages to update, add, and organize web pages in a search engine’s index.