In the beginning, site owners submitted the handle of a page, or URL to the different search engines like google and yahoo, which would send out a web crawler to crawl that web site, extract inbound links to other web pages from it, and return info observed to the webpage https://www.youtube.com/watch?v=7OfVkYHB1OY