Robots.txt Generator

Generate robots.txt files for your website. Control search engine crawling.

Sitemap URL

Crawl Delay (seconds)

Disallow (one per line)

Allow (one per line)

User-agent: *
Disallow: /admin/
Disallow: /private/