PHPackages                             highperapp/stream-processing - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility & Helpers](/categories/utility)
4. /
5. highperapp/stream-processing

ActiveLibrary[Utility & Helpers](/categories/utility)

highperapp/stream-processing
============================

High-performance distributed stream processing library with multiple engine support (Rust FFI, Hybrid, Python wrappers)

00PHP

Since Oct 3Pushed 7mo agoCompare

[ Source](https://github.com/highperapp/stream-processing)[ Packagist](https://packagist.org/packages/highperapp/stream-processing)[ RSS](/packages/highperapp-stream-processing/feed)WikiDiscussions main Synced 1mo ago

READMEChangelogDependenciesVersions (1)Used By (0)

HighPer Stream Processing Library
=================================

[](#highper-stream-processing-library)

A comprehensive distributed stream processing library for PHP with multiple performance tiers, designed to be completely standalone and framework-agnostic.

🚀 **Three Performance Scopes**
------------------------------

[](#-three-performance-scopes)

### **Scope 1: Native Rust FFI Integration** (Ultra High Performance)

[](#scope-1-native-rust-ffi-integration-ultra-high-performance)

- **Arroyo**: Distributed stream processing engine (Rust)
- **DataFusion**: High-performance SQL query engine (Rust)
- **Performance**: 10-100x faster than alternatives
- **Latency**: Sub-millisecond event processing
- **Throughput**: 1M+ events per second

### **Scope 2: Hybrid Architecture** (High Performance + Flexibility)

[](#scope-2-hybrid-architecture-high-performance--flexibility)

- **Intelligent routing**: Jobs routed to optimal engines
- **Multiple backends**: Arroyo + DataFusion + Pathway
- **Load balancing**: Automatic workload distribution
- **Fallback mechanisms**: Engine failures handled gracefully

### **Scope 3: Python Wrapper** (Maximum Compatibility)

[](#scope-3-python-wrapper-maximum-compatibility)

- **Apache Spark**: Large-scale batch processing
- **Apache Flink**: Advanced stream processing
- **Full ecosystem**: Access to Spark/Flink features
- **Enterprise ready**: Compatible with existing infrastructure

### **Scope 4: Pure PHP Fallback** (Guaranteed Compatibility)

[](#scope-4-pure-php-fallback-guaranteed-compatibility)

- **Zero dependencies**: Only PHP 8.2+ standard library
- **100% compatibility**: Works in any environment
- **Emergency fallback**: Ultimate reliability guarantee
- **Development friendly**: Perfect for CI/CD and testing

---

🛠️ **Installation**
-------------------

[](#️-installation)

### **Basic Installation (PHP Only)**

[](#basic-installation-php-only)

```
composer require highperapp/stream-processing
```

### **With Rust FFI Support (Best Performance)**

[](#with-rust-ffi-support-best-performance)

```
# Install PHP FFI extension
sudo apt-get install php-ffi  # Ubuntu/Debian
# or
brew install php --with-ffi   # macOS

# Install Rust libraries
composer run-script install-rust-libs
```

### **With Python Wrapper Support (Maximum Compatibility)**

[](#with-python-wrapper-support-maximum-compatibility)

```
# Install Python dependencies
pip3 install pyspark apache-flink

# Install Python bridge
composer run-script install-python-deps
```

---

📖 **Quick Start**
-----------------

[](#-quick-start)

### **Basic Usage (Any PHP Application)**

[](#basic-usage-any-php-application)

```