Robots.txt is actually a file that exists on the root directory of each Site and can be used to instruct search engines like google and yahoo on which directories/information of the web site they're able to crawl and involve in their index. It’s Just about All set. We did a https://news.rafeeg.ae