Back to SEO
Robots.txt generator for WordPress and other websites
Tick what to block: the admin area, search pages, cart, AI bots. Add your sitemap and get a robots.txt file with correct syntax.
How to use
- Choose WordPress or another platform to get the right admin path.
- Tick what you want to block, add custom paths if needed and fill in the sitemap.
- Save it as robots.txt in the site root, then open yourdomain/robots.txt to check.
Frequently asked questions
Does blocking a page in robots.txt remove it from Google?
Not reliably. Robots.txt only asks bots not to crawl a page. To keep a page out of results, use a noindex tag and let bots crawl that page.
Should I block AI bots?
Your call. Blocking keeps your content out of AI training, but your site may appear less often in answers from AI tools.
Why is admin-ajax.php still allowed?
Many WordPress themes and plugins call it from public pages. Blocking it can make Google render the page incorrectly.