Crawler Directives
Robots.txt File Generator
Generate syntax-perfect robots.txt files with custom user-agents, crawl-delays, and AI bot blocking rules.
Generated robots.txt PreviewSyntax Verified
User-agent: * Disallow: /wp-admin/ Disallow: /private/ Disallow: /api/ Allow: /wp-admin/admin-ajax.php Sitemap: https://seoland.in/sitemap_index.xml