OdooWiki OCA HUB

Disallow indexing completely via robots.txt

web_no_crawler folder_open OCA/web open_in_new
web License: LGPL-3

This module was written to implement a robots.txt file to prevent web crawlers (like google) from indexing pages. This module does not depend on Website module.

auto_awesome What this module does

AI-generated from the code · Odoo 12.0

This module adds a robots.txt file to your Odoo website that tells all search engines and web crawlers not to index any page of your Odoo instance.

Once installed, this module makes Odoo respond to requests for the /robots.txt address with a simple text file containing the rules "User-agent: *" and "Disallow: /". In plain words, this tells every web crawler (Google, Bing, and others) that it is not allowed to index any part of your Odoo site.

  • The file is served automatically at the standard /robots.txt location, so search engines find it without any configuration.
  • No menu, screen, or setting is added; the behaviour is active as soon as the module is installed.
  • It works at the web server level of Odoo and does not require the Website application to be installed.
  • It only affects crawler instructions; it does not hide pages from visitors or add any password protection.

This is useful for internal or test Odoo databases that should not appear in search results. The module only touches the web routing layer and does not modify any business model or data.

Depends on

web

Text generated by AI (DeepSeek) from reading the Odoo 12.0 code on GitHub; it may contain mistakes, so check the code before deciding. View the code on GitHub

Availability by version

Reviewed: 2026-11-03
Confirmed (verified in repository and branch) Estimated (unverified) No information

Confirmation status: 1 confirmed, 8 with no information of 9 versions.

terminal Installation and usage

OCA documentation · Odoo 12.0

Installation

Source · Odoo 12.0

Installation as usual. No specific installation steps / configuration required.

WARNING: this module is not to be used with Website module as it has a separate functionality for robots.txt.

Usage

Source · Odoo 12.0

To use this module, you need to:

No configuration needed. Once installed adds robots.txt (ex.: http://example.org/robots.txt).

No verified information in OCA: Configuration.

info

Data imported from GitHub: this sheet reflects the latest catalog review, not a live lookup. Always check the module documentation and staging before installing in production.