SellstampRobots.txt generator
Write a robots.txt file: which crawlers may visit which paths, optional rules for AI training crawlers, and your sitemap address.
Adds Disallow: / for GPTBot, ClaudeBot, Google-Extended, CCBot, PerplexityBot. Crawlers that follow robots.txt honour it; it is a request, not a lock.
Stays on your device
Everything runs in your browser. Nothing you type is sent to Sellstamp or anyone else.
Building something to sell?
Sellstamp has a storefront, a checkout into your own payment account, automatic delivery and an API with webhooks. Open a free store
How to use it
- Add a rule per crawler; * means all.
- List paths to keep crawlers out of, one per line.
- Add your sitemap, then save the file as robots.txt at the root of your site.
Nothing you paste leaves this page
The conversion runs in this browser tab. Nothing is sent to Sellstamp or anyone else, which matters for configuration files, customer exports and tokens.
A request, not a lock
robots.txt tells well-behaved crawlers where not to go. It does not hide pages: a blocked page can still appear in results if other sites link to it, and anyone can read your robots.txt. To keep a page out of search results, use a noindex tag; to keep it private, require a login.
The AI option adds rules for crawlers whose operators publish a user-agent name for training or AI features (GPTBot, ClaudeBot, Google-Extended, CCBot, PerplexityBot). It does not affect normal search crawling.
Questions
Where does robots.txt go?
At the root of your domain: https://yourshop.com/robots.txt.
Does Disallow remove a page from Google?
No. Use a noindex tag for that; Disallow only stops crawling.
What does an empty Disallow mean?
Nothing is blocked for that crawler.
Will blocking AI crawlers affect my search ranking?
Blocking these user agents does not block Googlebot or Bingbot, which do normal search crawling.
Related tools
Sitemap generator
URLs to a valid sitemap.xml.UTM builder
Tagged links for campaign tracking.User agent parser
Browser, system and device from a UA.Password generator
Cryptographically random, with the entropy shown honestly.UUID generator
Version 4, from the browser's own generator, one or a hundred at a time.JSON formatter
Pretty-print or minify, with the line and column of any error.
Popular free tools
QR code generator
Any link or text to a QR code, with a logo in the middle.Background remover
A transparent PNG, cut out without uploading the photo.Invoice generator
Line items, tax and a total, ready to print or save as a PDF.Image resizer
Exact pixels or a percentage, as PNG, JPEG or WebP.Logo maker
A mark, a monogram or a wordmark, as a transparent PNG and an SVG.Profit margin calculator
Cost and price to margin, or a target margin to the price that hits it.