In the beginning, website owners submitted the tackle of the website page, or URL to the assorted search engines like google and yahoo, which would send out an internet crawler to crawl that web page, extract links to other internet pages from it, and return information observed over the web https://www.youtube.com/watch?v=ARvdj_mJDAY