robots.txt Generator

Build robots.txt files visually with presets for AI crawlers, SEO, and custom rules.

All processing happens in your browser

Presets

User-agent

Sitemap URL

Crawl-delay (seconds)

Generated robots.txt

User-agent: *
Allow: /