Robots.txt Generator
Create a custom robots.txt file to control how search engines crawl your website.
Configuration
No rules added yet. Click “Add Rule” to get started.
Generated Robots.txt
# Your robots.txt file will be generated here # To get started, add some rules using the controls on the left.
Preview Explanation
Your robots.txt file tells search engine crawlers which URLs they can access on your site.
Use the controls on the left to add rules that allow or disallow access to specific paths.