GigaTools
DE
EnglishEspañolFrançaisDeutsch
Tools durchsuchen

Robots.txt-Tester

Prüfe eingefügte Allow- und Disallow-Regeln für Crawler und URL-Pfade, mit Anzeige der maßgeblichen Regel ohne Website-Anfragen.

Kostenlos Keine Registrierung Läuft in deinem Browser

Tests pasted rules only. Up to 500 KB, 500 rules and 50 paths. Does not fetch robots.txt or prove indexing.

Die Verarbeitung bleibt im Browser. Keine Website-Anfragen oder Uploads.

Ergebnis

Dein Ergebnis erscheint hier


        

        
Allowed means no selected rule blocks this path. It does not mean Google has crawled or indexed it. Check robots meta tags separately.
            



        






    

        

            
What is Robots.txt Tester?

            
Robots.txt Tester is a free online seo tool from GigaTools. Test pasted Allow and Disallow rules against crawler tokens and URL paths, with winning rule lines and no live website requests. It runs entirely in your web browser, so nothing is uploaded and it works on any device without installing software.

        

        

            
Häufige Anwendungen

            
    
                
  • Check whether a draft directory is blocked
  • Compare a specific crawler group with wildcard rules
  • Test Allow exceptions and PDF filename patterns
    •             

        

    






    

        
So funktioniert es
How to use Robots.txt Tester

        

                            
Paste the actual rules
Copy your robots.txt content into the input. The tool does not fetch a live file.

                            
Choose the crawler and paths
Enter a crawler product token such as Googlebot and up to 50 paths or full URLs. Test rules for the site the file belongs to.

                            
Review the winning rule
Run the test and inspect the selected groups, allowed status and winning line. Fix your real file separately.

                    

    






    

        

            
FAQ
Gut zu wissen

        

        

                            
How do I use Robots.txt Tester? 
1. Paste the actual rules: Copy your robots.txt content into the input. The tool does not fetch a live file. 2. Choose the crawler and paths: Enter a crawler product token such as Googlebot and up to 50 paths or full URLs. Test rules for the site the file belongs to. 3. Review the winning rule: Run the test and inspect the selected groups, allowed status and winning line. Fix your real file separately.

                            
Does allowed mean indexed? 
No. This checks pasted Allow and Disallow rules only. It does not inspect robots meta tags, X-Robots-Tag headers, canonical tags, HTTP responses or Google indexing.

                            
Which matching rules are supported? 
The tester selects the longest matching crawler token prefix and merges equally specific groups. It supports case-sensitive paths, query strings, * wildcards, terminal $ anchors, percent-encoded paths and Allow winning an equal-length conflict. It is a local approximation, not a Google certification or live crawler test.

                            
What is ignored? 
Empty Allow and Disallow values are ignored. Sitemap lines do not affect crawling rules. Unsupported directives such as Crawl-delay are reported but not evaluated. Invalid path rules are flagged and skipped; review warnings before relying on the result.

                            
Was sind die Grenzwerte? 
Up to 500 KB of robots text, 500 groups, 500 non-empty rules and 50 paths, each up to 2,048 characters. Complex matching can stop with an error instead of freezing your browser.

                    

    






    

        

            
Weiterarbeiten
Weitere SEO-Tools

            Alle anzeigen 
        

        

                            
    
    
        
Backlink-Generator

        
Erstelle einen sofort nutzbaren HTML-Link-Code.

    
    
                            
    
    
        
XML-Sitemap-Generator

        
Erstelle aus einer URL-Liste eine gültige XML-Sitemap.

    
    
                            
    
    
        
XML-Sitemap-Validator

        
Prüfe das Sitemap-XML, zähle URLs und erkenne fehlerhafte oder unsichere Einträge.

    
    
                            
    
    
        
Link-Analysator

        
Untersuche und klassifiziere Links im eingefügten HTML-Code.

    
    
                            
    
    
        
Keyword-CPC-Rechner

        
Schätze die Kampagnenkosten anhand von Klicks und CPC.

    
    
                            
    
    
        
Keyword-Suchergebnisse prüfen

        
Prüft näherungsweise, ob eine Domain in DuckDuckGo erscheint, und öffnet Google- und Bing-Suchen zur manuellen Kontrolle. Es wird kein Rankingverlauf gespeichert.