In the beginning, webmasters submitted the deal with of the web page, or URL to the various search engines like google and yahoo, which would ship a web crawler to crawl that webpage, extract one-way links to other pages from it, and return facts identified to the web site to https://www.youtube.com/watch?v=XcL519f9jd0