Robots.txt Generator and Local Test
Runs locally
Processing runs in your browser. Creating a result-sharing link is a separate, explicit action with its own storage notice.
Generate robots.txt or locally check basic allow/disallow matching for a path.
Input and options
Loading tool…
Resultat
Usage and supported scope
Local * / $ path matching, longest rule and allow-on-tie. Not a crawler or an exhaustive implementation of engine-specific URL normalization.
Tool input and output are processed in your browser. The tool does not upload or store input content. Closing the tab discards results. Required processing modules are downloaded on first use.
More tools in this category