🤖
Robots.txt
Generate robots.txt file.
🔒100% Privacy⚡Instant🆓Free Forever📱Mobile Friendly
Disallow paths:
robots.txt:
User-agent: * Allow: / Disallow: /admin/ Disallow: /private/ Sitemap: https://example.com/sitemap.xml
◆ How it works
Robots.txt — 3 simple steps
01
Configure rules
Allow / Disallow paths
02
Add sitemap
Tell crawlers where to find sitemap
03
Upload to root
yoursite.com/robots.txt
◆ FAQ
Common questions.
Where to upload?
+
◆ Related tools