ArkFlow: A High-Performance Rust Stream Processing Engine

2025-04-29
ArkFlow: A High-Performance Rust Stream Processing Engine

ArkFlow is a high-performance stream processing engine built on Rust and Tokio, offering powerful data stream processing capabilities. It supports multiple input/output sources (Kafka, MQTT, HTTP, files, etc.) and processors (JSON, SQL, Protobuf, etc.), with a flexible YAML configuration. Built-in features include SQL queries, JSON processing, and Protobuf encoding/decoding. ArkFlow is highly extensible and includes buffering for backpressure handling and diverse error output options. Get started by cloning the repository and following the simple build and run instructions.

Development