PHPackages oyym/clickhouse-trans - PHPackages - PHPackages [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register) 1. [Directory](/) 2. / 3. [Database & ORM](/categories/database) 4. / 5. oyym/clickhouse-trans ActiveLibrary[Database & ORM](/categories/database) oyym/clickhouse-trans ===================== mysql mongo transfer data to clickhouse 441PHP Since Feb 16Pushed 3y ago1 watchersCompare [ Source](https://github.com/oyym123/clickhouse-trans)[ Packagist](https://packagist.org/packages/oyym/clickhouse-trans)[ RSS](/packages/oyym-clickhouse-trans/feed)WikiDiscussions main Synced 1mo ago READMEChangelogDependenciesVersions (1)Used By (0) clickhouse-trans ================ [](#clickhouse-trans) PHP 脚本 (mysql | mongo) 全量 & 增量传输数据到 clickhouse 超轻量级代码 开箱即用 **背景** ------ [](#背景) - 因业务需求 想用clickhouse做支撑 实现实时统计报表。调研了几个比较出名开源go写的 CDS同步 代码。 都安装运行了，有界面化操作。但整体感觉 比较 “重”，不能随心所欲的玩耍，so 自己造个吧! **功能** ------ [](#功能) - 可以添加多个 mysql 、mongo、clickhouse 配置 - 可以自定义字段同步 - 可以定时同步 - 自动去重 - 详细日志 **安装** ------ [](#安装) `composer require oyym/clickhouse-trans` **配置项** ------- [](#配置项) - 在config.php 配置好默认的 mysql、clickhouse、mongo 数据库 - 在Mapping.php 中添加需要同步到clickhouse的字段（直接复制mysql建表sql） **命令行** ------- [](#命令行) - 【-a 方法名 -b 类型id】 创建clickhouse表 - `php index.php -a=createTable -b=10` - 【全量同步数据 数据不宜超过500万】大数据量请使用 incrementalDataBySelf() 方法分批导入 - `php index.php -a=initData -b=10` - 【按小时 增量同步】每小时第5分钟跑 上个小时之间的数据 - `5 * * * * php index.php -a=incrementalDataByHour -b=10` - 【按天 增量同步】定时任务 每天凌晨2点同步数据 - `0 2 * * * php index.php -a=incrementalDataByHour -b=10` - 【-c 起始时间 -d 结束时间 -e (day:按天跑 month:按月跑)】新增指定日期间的数据 最小维度 【天】 - `php index.php -a=incrementalDataBySelf -b=10 -c=2021-11-01 -d=2022-07-01 -e=day` - 按天跑的含义： 会获取 间隔时间内所有的天数，一天天的同步 - 按月跑的含义： 会获取 间隔时间内所有的月份，一月月的同步 **Laravel安装** ------------- [](#laravel安装) `composer require oyym/clickhouse-trans` [![Snipaste_2023-02-16_16-46-21](https://user-images.githubusercontent.com/20701868/219314824-737184d6-3f69-43ea-b481-a9d1eb502ae1.png)](https://user-images.githubusercontent.com/20701868/219314824-737184d6-3f69-43ea-b481-a9d1eb502ae1.png) ``` public function handle() { //入口函数需要设定 这三个文件的绝对路径 putenv("CONFIG_FILE_PATH=" . __DIR__ . '/Config.php'); //日志文件地址 putenv("MAPPING_FILE_PATH=" . __DIR__ . '/Mapping.php'); //映射文件地址 putenv("LOG_DIR_PATH=" . storage_path() . '/logs/trans/'); //记录日志的目录地址 //创建表 (new CkService(Mapping::TYPE_PRICE_CHANGE_HISTORY))->createTable(); //初始化数据 (new CkService(Mapping::TYPE_PRICE_CHANGE_HISTORY))->insertData(); //增量更新 每小时第5分钟跑 上个小时之间的数据 5 * * * * php artisan trans (new CkService(Mapping::TYPE_PRICE_CHANGE_HISTORY))->incrementalDataByHour(); return true; } ``` 运行 php artisan trans 其他的框架运行也是一样的，找到php-cli的执行入口 把上面的函数复制进去就行 ### Health Score 16 — LowBetter than 5% of packages Maintenance20 Infrequent updates — may be unmaintained Popularity8 Limited adoption so far Community8 Small or concentrated contributor base Maturity23 Early-stage or recently created project Bus Factor1 Top contributor holds 100% of commits — single point of failure How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window. **Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores. **Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement. **Maturity (30%)** — Project age, version count, PHP version support, and release stability. ### Community Maintainers ![](https://www.gravatar.com/avatar/b5c31cc0f9c4a75c370473b2e45917297481cfe1cc481b9423b4b9eff7ff4c91?d=identicon)[oyym123](/maintainers/oyym123) --- Top Contributors [![oyym123](https://avatars.githubusercontent.com/u/20701868?v=4)](https://github.com/oyym123 "oyym123 (20 commits)") ### Embed Badge ![Health badge](/badges/oyym-clickhouse-trans/health.svg) ``` [![Health](https://phpackages.com/badges/oyym-clickhouse-trans/health.svg)](https://phpackages.com/packages/oyym-clickhouse-trans) ``` ### Alternatives [doctrine/orm Object-Relational-Mapper for PHP 10.2k285.3M6.2k](/packages/doctrine-orm)[jdorn/sql-formatter a PHP SQL highlighting library 3.9k115.1M102](/packages/jdorn-sql-formatter)[illuminate/database The Illuminate Database package. 2.8k52.4M9.4k](/packages/illuminate-database)[mongodb/mongodb MongoDB driver library 1.6k64.0M546](/packages/mongodb-mongodb)[ramsey/uuid-doctrine Use ramsey/uuid as a Doctrine field type. 90340.3M211](/packages/ramsey-uuid-doctrine)[reliese/laravel Reliese Components for Laravel Framework code generation. 1.7k3.4M16](/packages/reliese-laravel) PHPackages © 2026 [Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)