SEO OPTIMIZATION - AN OVERVIEW

In order to avoid unwanted content inside the look for indexes, website owners can instruct spiders to not crawl specified files or directories through the conventional robots.txt file in the root Listing of the domain. Also, a web site is usually explicitly excluded from a search engine's database by using a meta tag distinct to robots (ordinarily