PHPackages                             innomedia/silverstripe-robots-txt - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility & Helpers](/categories/utility)
4. /
5. innomedia/silverstripe-robots-txt

ActiveSilverstripe-vendormodule[Utility & Helpers](/categories/utility)

innomedia/silverstripe-robots-txt
=================================

A modern, dynamic robots.txt module for SilverStripe

0.1(2mo ago)01BSD-3-Clause

Since May 19Compare

[ Source](https://github.com/innomedia/geo-tools)[ Packagist](https://packagist.org/packages/innomedia/silverstripe-robots-txt)[ RSS](/packages/innomedia-silverstripe-robots-txt/feed)WikiDiscussions Synced 3w ago

READMEChangelog (1)Dependencies (3)Versions (2)Used By (0)

SilverStripe Robots.txt Module
==============================

[](#silverstripe-robotstxt-module)

A modern, dynamic `robots.txt` module for SilverStripe that works correctly with multi-domain, multilingual, and Subsites-based setups.

Features
--------

[](#features)

- **Dynamic Generation**: `robots.txt` and `llms.txt` are generated on-the-fly, allowing for host-specific rules.
- **Automatic Exclusions**: Automatically disallows pages where `ShowInSearch` is set to false in `robots.txt`.
- **Integration with SEO Sitemap**: If `wilr/silverstripe-googlesitemaps` is installed, it can automatically include a `Sitemap:` directive and respect its exclusion rules.
- **LLMs.txt Support**: Generates an `llms.txt` file for Large Language Models.
- **AI-Powered Summaries**: Automatically generates page summaries for `llms.txt` using GPT (OpenAI).
- **Elemental Support**: Correctlty extracts content from Elemental areas for AI processing.
- **CMS Configurable**: Editors can manage all settings via SiteConfig.
- **Sensible Defaults**: Comes with a pre-configured set of common blocked paths (e.g., `/cms/`, `/resources/`).
- **Developer Friendly**: Highly extensible via an interface-based provider system.

Installation
------------

[](#installation)

```
composer require innomedia/silverstripe-robots-txt
```

Configuration
-------------

[](#configuration)

### CMS Settings

[](#cms-settings)

#### Robots.txt

[](#robotstxt)

Under **Settings > Robots.txt**, you can:

- Toggle default disallowed paths (technical paths like `/cms/`).
- Toggle automatic exclusion of `ShowInSearch = false` pages.
- Toggle Sitemap module integration (excludes pages that are not in the sitemap).
- Toggle Sitemap reference line.
- Add raw custom `robots.txt` lines.

#### LLMs.txt

[](#llmstxt)

Unter **Settings > LLMs.txt** (oder **Einstellungen > LLMs.txt**), können Sie:

- Eine allgemeine Seitenbeschreibung angeben.
- Kontaktinformationen für die `llms.txt` hinterlegen.
- Ihren OpenAI API Key für die Generierung von Zusammenfassungen hinterlegen.
- Bis zu 10 Kapitel definieren, jeweils mit einem Titel und einer Auswahl relevanter Seiten.
- Das System ruft beim Speichern automatisch die Inhalte ab (inklusive Elemental-Blöcken) und generiert KI-Zusammenfassungen via GPT.

Die `llms.txt` wird nach einem modernen Standard formatier inkl. Seitentitel, Beschreibung als Zitat, Sitemap-Link und Kontaktinfo.

### YAML Configuration

[](#yaml-configuration)

You can override the default blocked paths or add your own disallow providers:

```
Innomedia\RobotsTxt\Builders\RobotsTxtBuilder:
  default_disallowed_paths:
    - '/cms/'
    - '/resources/'
    - '/my-custom-blocked-path/'
  disallow_sources:
    - 'Innomedia\RobotsTxt\Providers\ShowInSearchDisallowProvider'
    - 'MyCustom\Provider\DisallowProvider'
```

Extensibility
-------------

[](#extensibility)

### Custom Disallow Rules

[](#custom-disallow-rules)

Implement `Innomedia\RobotsTxt\Interfaces\DisallowSourceInterface` and register it in YAML:

```
namespace MyCustom\Provider;

use Innomedia\RobotsTxt\Interfaces\DisallowSourceInterface;

class DisallowProvider implements DisallowSourceInterface
{
    public function getDisallowedPaths(): array
    {
        return ['/private-area/'];
    }
}
```

### Custom Sitemap Resolver

[](#custom-sitemap-resolver)

Implement `Innomedia\RobotsTxt\Interfaces\SitemapResolverInterface` and register it in YAML:

```
Innomedia\RobotsTxt\Builders\RobotsTxtBuilder:
  sitemap_resolver: 'MyCustom\Provider\SitemapResolver'
```

License
-------

[](#license)

See [LICENSE](LICENSE) (BSD-3-Clause).

###  Health Score

29

—

LowBetter than 57% of packages

Maintenance86

Actively maintained with recent releases

Popularity1

Limited adoption so far

Community2

Small or concentrated contributor base

Maturity23

Early-stage or recently created project

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Unknown

Total

1

Last Release

66d ago

### Community

Maintainers

![](https://www.gravatar.com/avatar/c4b6c925a833158ea12f065131daea53a49fc4b76323ad05e7b67d35821172a5?d=identicon)[chromos33](/maintainers/chromos33)

---

Tags

silverstripeseorobots.txt

###  Code Quality

TestsPHPUnit

### Embed Badge

![Health badge](/badges/innomedia-silverstripe-robots-txt/health.svg)

```
[![Health](https://phpackages.com/badges/innomedia-silverstripe-robots-txt/health.svg)](https://phpackages.com/packages/innomedia-silverstripe-robots-txt)
```

###  Alternatives

[silverstripe/userforms

UserForms enables CMS users to create dynamic forms via a drag and drop interface and without getting involved in any PHP code

1321.1M86](/packages/silverstripe-userforms)[symbiote/silverstripe-advancedworkflow

Adds configurable workflow support to the CMS, with a GUI for creating custom workflow definitions.

46302.4k9](/packages/symbiote-silverstripe-advancedworkflow)[cyber-duck/silverstripe-seo

A SilverStripe module to optimise the Meta, crawling, indexing, and sharing of your website content

4351.3k](/packages/cyber-duck-silverstripe-seo)[hubertusanton/silverstripe-seo

SEO module for Silverstripe

4523.3k2](/packages/hubertusanton-silverstripe-seo)[axllent/silverstripe-trailing-slash

Ensure that a single trailing slash is always added to the URL

11188.5k5](/packages/axllent-silverstripe-trailing-slash)[silverstripers/seo

SEO for SilverStripe websites

1145.4k](/packages/silverstripers-seo)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)