Stott Robots Handler

Stott Robots Handler is an Add-on for Optimizely CMS that allows a CMS Administrator to manage robots.txt content, llms.txt content and environment robots meta tag and header overrides without requiring a code deployment. This Add-on is free to use and is covered by an MIT License. If you wish to support the ongoing development of this Add-on, then please feel free to buy me a coffee.

Key Features

User Friendly Interface: Manage robots.txt content across your whole CMS without a code deployment.
Per Application & Host: Define distinct robots.txt content by application (site in CMS 12) and by specific host.
Smart Resolution: Requests to /robots.txt are matched to the correct application by domain, returning sensible default content when none has been configured.

Familiar Interface: Manage Markdown llms.txt content in the same interface used for robots.txt, with a larger editor suited to longer files.
Per Application & Host: Configure llms.txt by application (site in CMS 12) and specific host, or as an application-wide default.
Served on Demand: Content is served on /llms.txt only when defined — matching a specific host first, then an application default, otherwise returning a 404.

Protect Lower Environments: Override robots meta tags and response headers at an environment level to keep integration and preproduction environments out of search engines.
Global Configuration: Applied across the whole instance, independent of any application or host configuration.

Conversational Management: Create and modify robots.txt and llms.txt content directly from Optimizely Opal's chat interface.
Bearer Token Management: Issue multiple tokens, each with its own Read or Write scope for robots.txt and llms.txt.
Self-Describing: A built-in discovery endpoint registers the available tools with Opal.
Instruction Friendly: Pair the tools with Opal Instructions to generate rich llms.txt content tailored to your site.

Headless Support: APIs allow robots.txt and llms.txt content to be served and managed within headless solutions.
No Code Deployment: All content is managed by CMS administrators with no need for a code deployment.
Opti Id Ready: Configurable for use with Optimizely Opti Id.
CMS 12 & 13: Supports both Optimizely CMS 12 (Sites) and CMS 13 (Applications).
Free & Open Source: Released under the MIT licence.

Articles

Stott Robots Handler v7 for Optimizely CMS 13

Published: 2nd April 2026

Stott Robots Handler v7 for Optimizely CMS 13 has been released, with functionality updated to support the new Application based architecture.