Tools

Robots.txt Generator

Easily generate a robots.txt file to control how search engines crawl and index your website.

Default Access (All Robots)

Sitemap URL

Disallowed Directories (One per line)

Specific Bots (Block AI & LLMs)

GPTBot CCBot

robots.txt Output