Robots.txt Generator
Create a robots.txt file for your website. Allow or block crawlers and add your sitemap. Free robots.txt generator.
Build a valid robots.txt file in seconds. Choose whether to allow all crawlers, block folders, set a crawl delay and add your sitemap URL.
How to use the Robots.txt Generator
- Choose the default rule for all robots.
- Add folders to block and your sitemap URL.
- Copy or download robots.txt and upload it to your site root.
Frequently asked questions
Where do I put robots.txt?
Upload it to the root of your domain so it opens at https://yourdomain.com/robots.txt.
Does robots.txt hide pages from Google?
It stops crawling, but a blocked page can still appear in results if other sites link to it. Use a noindex tag to keep a page out of results.
Is there a limit on how many I can generate?
No. You can generate as many results as you like, as often as you like.
Is the Robots.txt Generator free to use?
Yes. The Robots.txt Generator on BookmarkBuild is completely free, with no hidden charges, no trial period and no watermark.
Do I need to create an account?
No. You can use the tool straight away without signing up or logging in.
Is my data stored or sent anywhere?
No. Everything you enter is processed in your browser and is not saved or sent to our server.
Does the Robots.txt Generator work on mobile phones?
Yes. It works in any modern browser on Android phones, iPhones, tablets, laptops and desktop computers.
Which browsers are supported?
The latest versions of Chrome, Edge, Firefox, Safari, Opera, Brave and Samsung Internet are all supported.
Do I need to install any software?
No. The tool works in your web browser, so there is nothing to download or install.
Is there a daily usage limit?
No. You can use the tool as many times as you want, every day.
Can I use the Robots.txt Generator for commercial work?
Yes. The results are yours to use in personal and commercial projects.
Does it work offline?
Once the page has loaded, the tool itself runs in your browser, so it keeps working if your connection drops. You need the internet only to open the page.
