Robots.txt File Generator

Robots.txt is a special text file on your website that instruct robots whether or not to crawl and index certain pages and directories within your site.

The generated code must be placed inside a text file called robots.txt that is located at the root level of your website. For example, the robots.txt file for google.com is located at http://www.google.com/robots.txt

Select User Agent:
Directory or Pages to disallow:

For example:
1. images
2. contact/secret.htm


You can add multiple user agents and directories by clicking on this button multiple times.