This tool parses and displays the rules in your robots.txt file, organized into a table. It also displays any sitemaps from the robots.txt file, followed by the raw text.
This tool parses and displays the rules in your robots.txt file, organized into a table. It also displays any sitemaps from the robots.txt file, followed by the raw text.