Robots.txt Generator Create a clean robots.txt file for your website (no data saved). Ready Website Site URL (optional) Sitemap URL (optional) Mode Allow All Block All Custom Tip: If you want Google to index your site, use Allow All or Custom. Custom Rules User-agent Disallow paths (one per line) Allow paths (one per line) Add […]