Robots.txt is a text file which is used to instruct the search engines for how to crawl and index the pages on your...