To avoid unwanted written content from the lookup indexes, website owners can instruct spiders never to crawl particular data files or directories in the normal robots.txt file in the basis directory in the area. Moreover, a webpage is often explicitly excluded from a search engine's databases by using a meta https://news.rafeeg.ae