Eazy SEO Tools

Robots.txt Generator

Build a valid robots.txt with AI-crawler presets.

Runs 100% in your browser — your input never leaves this page. How we handle your data →
Runs 100% in your browser — your input never leaves this page.

Rules

Each rule: which crawler (user-agent), allow or disallow, and which path.

Presets

AI crawlers

Check the bots you want to keep out. Compliance is voluntary — see Honest limits.


        
        

            
            
        

        
Upload the file to your site's root (e.g. https://example.com/robots.txt).

    


    

    

    


    

        
Your results will appear here.

        
Fill in the input above and run the tool to get started.

    





    


    
    

        
        
    


    
        

        

    

        
        

                        
Honest limits

                        
robots.txt is an instruction to well-behaved crawlers, not a firewall — and it can't keep a page out of Google's index by itself.

        

    



    

    
        

        
How to use the Robots.txt Generator

        
    
    
  1. Choose the robots.txt tab (for search crawlers) or the llms.txt tab (a machine-readable summary for AI assistants).
    2. 
    
  2. Add rules or links, or start from a preset. The file preview updates live.
    3. 
    
  3. Copy or download the file and place it at your site's root.
    4. 


    

    
        

        
Examples

        

        

        
Example
            

        
The WordPress preset generates a ready-to-use robots.txt that allows all crawlers, blocks /wp-admin/, and adds your sitemap line. The AI crawler section adds disallow rules for GPTBot, ClaudeBot, PerplexityBot and Google-Extended.



    

    
        

        
What this tool doesn't do

        
    
    
  • robots.txt is a voluntary convention — well-behaved crawlers obey it, but nothing forces them to. It is not a legal mechanism to control AI training-data use.
    • 
    
  • Blocking a crawler does not remove already-indexed or already-collected content.
    • 
    
  • llms.txt is an emerging convention, not a standard — support varies.
    • 


    

    
        

        
Frequently asked questions

        

        

        

            
        

        
    

        

        

            
        

        
    

        

        

            
        

        
    

        

        

            
        

        
    

        

        

            
        

        
    

        

        

            
        

        
    

    

    

    
    

    
Related tools

    

                
    
        
    
        
Meta Tags Analyzer

            
Audit any page's title, description and social tags.

        
        Use tool 
    

                
    
        
    
        
XML Sitemap Generator

            
Generate a valid XML sitemap from your URL list.

        
        Use tool 
    

                
    
        
    
        
Open Graph Generator

            
Build perfect Open Graph and Twitter Card meta tags with a live social-share preview.

        
        Use tool 
    

                
    
        
    
        
Slug Generator

            
Turn any title into a clean, SEO-friendly URL slug — lowercase, hyphenated, accent-free.

        
        Use tool 
    

                
    
        
    
        
SERP Preview Tool

            
See exactly how your page appears in Google results — live preview with truncation warnings.

        
        Use tool 
    

                
    
        
    
        
Heading Analyzer

            
Paste your HTML and audit the H1–H6 hierarchy — catch skipped levels and empty headings.

        
        Use tool 
    

            




    

        
Need another tool?

        
Browse all 70 free tools — no signup, no paywalls.

        Browse all tools