PHPackages                             taurus-media/module-robots - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility & Helpers](/categories/utility)
4. /
5. taurus-media/module-robots

ActiveMagento2-module[Utility & Helpers](/categories/utility)

taurus-media/module-robots
==========================

Add filterable attributes to robots.txt in Magento 2

1.0.0(5mo ago)3391MITPHP

Since Jan 16Pushed 5mo ago1 watchersCompare

[ Source](https://github.com/taurus-media/module-robots)[ Packagist](https://packagist.org/packages/taurus-media/module-robots)[ RSS](/packages/taurus-media-module-robots/feed)WikiDiscussions master Synced today

READMEChangelogDependencies (2)Versions (2)Used By (0)

Taurus Robots
=============

[](#taurus-robots)

A Magento 2 module that automatically adds filterable product attributes to the `robots.txt` file to prevent search engines from crawling layered navigation filter combinations, which can lead to duplicate content issues.

Description
-----------

[](#description)

The `Taurus_Robots` module extends the default Magento 2 Robots functionality. It identifies all product attributes configured to be "Use in Layered Navigation" (filterable) and adds a `Disallow` rule for each of them under the `User-agent: *` section.

For example, if you have a filterable attribute `color`, it will add: `Disallow: /*color=*`

Features
--------

[](#features)

- Automatically detects filterable product attributes.
- Dynamically injects `Disallow` rules into the generated `robots.txt`.
- Sorts rules alphabetically for better readability.
- Ensures rules are placed under the global `User-agent: *` block.

Installation
------------

[](#installation)

```
composer require taurus-media/module-robots
bin/magento module:enable Taurus_Robots
bin/magento setup:upgrade
bin/magento setup:static-content:deploy
```

###  Health Score

35

—

LowBetter than 77% of packages

Maintenance70

Regular maintenance activity

Popularity20

Limited adoption so far

Community4

Small or concentrated contributor base

Maturity35

Early-stage or recently created project

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Unknown

Total

1

Last Release

167d ago

### Community

Maintainers

![](https://www.gravatar.com/avatar/9a63921d7d7fd387db50f9e01c25123205ad89de7a50c0c95ea2ba4061cc4b26?d=identicon)[taurus-media](/maintainers/taurus-media)

---

Tags

magento2magento2-extensionmagento2-modulemagento2-seo

### Embed Badge

![Health badge](/badges/taurus-media-module-robots/health.svg)

```
[![Health](https://phpackages.com/badges/taurus-media-module-robots/health.svg)](https://phpackages.com/packages/taurus-media-module-robots)
```

###  Alternatives

[elgentos/regenerate-catalog-urls

Regenerate Catalog URL Rewrites (products, categories, cms pages)

2842.6M](/packages/elgentos-regenerate-catalog-urls)[nosto/module-nostotagging

Increase your conversion rate and average order value by delivering your customers personalized product recommendations throughout their shopping journey.

27703.7k4](/packages/nosto-module-nostotagging)[tig/postnl-magento2

TIG Magento 2 PostNL extension

59570.5k5](/packages/tig-postnl-magento2)[myparcelnl/magento

A Magento 2 module that creates MyParcel labels

1860.2k](/packages/myparcelnl-magento)[loki/magento2-components

Core module for defining Alpine.js components with advanced AJAX features

1011.8k26](/packages/loki-magento2-components)[angeo/module-llms-txt

Magento 2 module for AI Engine Optimization (AEO). Generates spec-compliant llms.txt and llms-full.txt per llmstxt.org standard, plus streaming JSONL for vector indexing. Multi-store, multi-website, CLI, cron, async admin UI, Page Builder-aware sanitization, customer-group pricing, atomic writes, ETag/Cache-Control, .md mirrors.

111.1k](/packages/angeo-module-llms-txt)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)