PHPackages tractorcow/silverstripe-robots - PHPackages - PHPackages [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register) 1. [Directory](/) 2. / 3. [Utility & Helpers](/categories/utility) 4. / 5. tractorcow/silverstripe-robots ActiveSilverstripe-vendormodule[Utility & Helpers](/categories/utility) tractorcow/silverstripe-robots ============================== Simple robots generation module for Silverstripe 5.0.0(11mo ago)1395.1k↑122.9%67BSD-3-ClausePHP Since Sep 29Pushed 11mo ago3 watchersCompare [ Source](https://github.com/tractorcow/silverstripe-robots)[ Packagist](https://packagist.org/packages/tractorcow/silverstripe-robots)[ RSS](/packages/tractorcow-silverstripe-robots/feed)WikiDiscussions master Synced 1mo ago READMEChangelog (7)Dependencies (1)Versions (10)Used By (7) Robots.txt generation module for Silverstripe ============================================= [](#robotstxt-generation-module-for-silverstripe) This module provides simple robots.txt generation for Silverstripe, with various configuration options available. When a site is not in live mode (such as on a testing domain) it will respectively block the entire domain, ensuring that (at least respectful) search engines will refrain from indexing your test site. This doesn't support complex rules (such as multiple rules for different user agents), as it's designed to cater to the 99.9% of cases which won't require manual configuration. Credits and Authors ------------------- [](#credits-and-authors) - Damian Mooyman - Requirements ------------ [](#requirements) - Silverstripe 6 Installation Instructions ------------------------- [](#installation-instructions) - Extract all files into the 'robots' folder under your Silverstripe root, or install using composer ``` composer require "tractorcow/silverstripe-robots": "^5" ``` - Make sure you are correctly setting your environment for it to work properly - It's also advisable to either install the googlesitemaps module, or to create a physical `sitemap.xml` in your site root. Configuration ------------- [](#configuration) You can add a page or pattern to be blocked by adding it to the disallowedUrls configuration ``` --- Name: myrobotsconfiguration --- TractorCow\Robots\Robots: disallowed_urls: - 'mysecretpage.html' - '_private' - 'Documents-and-Settings/Ricky/My-Documents/faxes/sent-faxes' ``` Also by default, any page with 'ShowInSearch' set to false will also be excluded. This can be useful for hiding auxilary pages like "thanks for signing up", or error pages. You can turn this off (if you really absolutely think you need to) using the below ``` --- Name: myrobotsconfiguration --- TractorCow\Robots\Robots: disallow_unsearchable: false ``` By default the module will check for a sitemap file in `/sitemap.xml`, or will assume one is there if the googlesitemap module is installed. You can set a custom file location using the below configuration. ``` --- Name: myrobotsconfiguration --- TractorCow\Robots\Robots: sitemap: '/sitemap_index.xml' ``` Need more help? --------------- [](#need-more-help) Message or email me at or, well, read the code! License ------- [](#license) Copyright (c) 2013, Damian Mooyman All rights reserved. All rights reserved. Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met: - Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. - Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. - The name of Damian Mooyman may not be used to endorse or promote products derived from this software without specific prior written permission. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. ### Health Score 49 — FairBetter than 95% of packages Maintenance52 Moderate activity, may be stable Popularity39 Limited adoption so far Community23 Small or concentrated contributor base Maturity69 Established project with proven stability Bus Factor1 Top contributor holds 76.2% of commits — single point of failure How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window. **Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores. **Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement. **Maturity (30%)** — Project age, version count, PHP version support, and release stability. ### Release Activity Cadence Every ~443 days Total 9 Last Release 338d ago Major Versions 3.0.x-dev → 4.0.02019-07-16 4.x-dev → 5.0.02025-06-15 ### Community Maintainers ![](https://www.gravatar.com/avatar/f6a363b2d85dc3e82e73cc9e3a57fc15132920b166c5938ad63a54029b9f94b9?d=identicon)[tractorcow](/maintainers/tractorcow) --- Top Contributors [![tractorcow](https://avatars.githubusercontent.com/u/936064?v=4)](https://github.com/tractorcow "tractorcow (16 commits)")[![lerni](https://avatars.githubusercontent.com/u/472115?v=4)](https://github.com/lerni "lerni (3 commits)")[![3Dgoo](https://avatars.githubusercontent.com/u/2616373?v=4)](https://github.com/3Dgoo "3Dgoo (1 commits)")[![muskie9](https://avatars.githubusercontent.com/u/870751?v=4)](https://github.com/muskie9 "muskie9 (1 commits)") --- Tags robotsrobots-txtsilverstripesilverstripe-4silverstriperobots ### Embed Badge ![Health badge](/badges/tractorcow-silverstripe-robots/health.svg) ``` [![Health](https://phpackages.com/badges/tractorcow-silverstripe-robots/health.svg)](https://phpackages.com/packages/tractorcow-silverstripe-robots) ``` ### Alternatives [silverstripe/multi-domain Allows multiple domains to access one CMS instance, mapping them to different sections of the hierarchy 141.6k](/packages/silverstripe-multi-domain) PHPackages © 2026 [Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)