Robots.txt Generator

Leave blank if you don't have.
Google
Google Image
Google Mobile
MSN Search
Yahoo
Yahoo MM
Yahoo Blogs
Ask/Teoma
GigaBlast
DMOZ Checker
Nutch
Alexa/Wayback
Baidu
Naver
MSN PicSearch
The path is relative to the root and must contain a trailing slash "/".

Robots.txt Generator Tool is a free tool which allows you to configure your web crawling settings, including what pages and files Googlebot should follow with respect to your robots.txt file. It also provides the ability to automate the retrieval of robots.txt directives, depending upon your specific needs.