client-side
robots.txt generator
Useful for a fast start or a quick review of robots.txt when you need a clear interface instead of manual syntax editing.
Supports multiple user agents in one file.
Includes Allow, Disallow, Sitemap, and Host directives.
The final text is ready to paste into the project.
Generated robots.txt
User-agent: * Allow: / Allow: /wp-content/uploads/ Disallow: /admin/ Disallow: /api/ Disallow: /tmp/ User-agent: Googlebot Allow: / Allow: /wp-content/uploads/ Disallow: /admin/ Disallow: /api/ Disallow: /tmp/ Host: shelpakov.online Sitemap: https://shelpakov.online/sitemap.xml
What to check before publishing
Do not block important sections if they are supposed to stay indexable.
Make sure the sitemap points to the correct protocol and production domain.
If the project has mirrors or alternate hosts, review redirects and canonicals as well.