SEO Glossary

robots.txt

robots.txt is a text file in a website’s root that tells search engines which areas they should not crawl.

robots.txt – explained simply

It always sits at yourdomain.ch/robots.txt and should also point to the sitemap. It prevents crawling, but not reliably indexing.

One wrong line such as “Disallow: /” can make an entire website invisible to Google – a common mistake after a relaunch.

Practical tip for Swiss SMEs

Open your robots.txt yourself. If it says “Disallow: /”, your website is blocked for Google.

Related services and pages

Related terms

Request a free SEO analysis

Tell us your website and region. Within two working days you’ll receive:

  • +Your current positions in Google and Google Maps
  • +The three biggest levers for more enquiries
  • +A fixed-price quote
What are you interested in?

We only use your details for this request.

Request sent. You’ll hear from us within two working days.