In the beginning, webmasters submitted the tackle of a web page, or URL to the different search engines like google and yahoo, which would send out a web crawler to crawl that site, extract links to other web pages from it, and return details found around the website page to https://www.youtube.com/watch?v=ARvdj_mJDAY