Robots.txt Generator

Create a robots.txt file to control search engine crawlers

User-Agent:

Crawler Access:

Allow All Disallow All

Allow Paths (one per line):

Disallow Paths (one per line):

Sitemap URL:

Generated robots.txt:

Copy and paste this code into your website to display this tool: