SQLFlow: Stream Processing with DuckDB and SQL
2025-01-03
SQLFlow is a stream processing engine powered by DuckDB, enabling SQL-based operations on real-time data from sources like Kafka and webhooks. It supports data transformations, enrichment, aggregation, tumbling window aggregations, and outputs to destinations such as Kafka, databases, or local files. SQLFlow boasts high throughput, handling tens of thousands of messages per second, and supports custom serialization and encoding. Docker deployment is readily available for easy setup.
Development
stream processing