Tool

Robots.txt Generator

Create a robots.txt file for better crawl control.

Tool UI

Runs entirely in your browser.

FREE

Rules

Allow all crawling (Disallow:) Disallow paths (one per line) Sitemap URL (optional)

robots.txt

Done