An Index is the complete list of web pages that the search engine knows about. It resembles a library’s index. Website owners can influence it by excluding some pages through the noindex tag or the robots.txt file. They can also feed pages to search engines through some of their tools (like Google’s Search Console).