Crawling and Indexing in SEO

Now that you know what a SERP looks like, you will see how the search engine curates the list of results using a multi-step process.

The first process is called ‘crawling’, wherein the search engine ‘crawls’ the web to discover all the publicly available web pages. Sonesh will explain it in the following video.

As Sonesh explained, search engines use web crawlers to pore over webpages and follow the links they contain, just as a normal person would do. This data is collected and sent back to the search engine database.

He also explained how a search engine performs data ‘indexing’. Every time a search query is made, it is matched with the searchable index of the search engine, and the most appropriate results are pulled out.

In the next segment, you will learn how this indexed data is ranked and displayed as a search result.