GlassFlow: Real-time Streaming ETL for ClickHouse
GlassFlow is a real-time stream processor designed for data engineers to simplify creating and managing data pipelines between Kafka and ClickHouse. It boasts a user-friendly interface for building and managing real-time data pipelines, featuring built-in deduplication and temporal joins. Handling late-arriving events and ensuring exactly-once processing, GlassFlow scales to handle high-throughput data, delivering accurate, low-latency results without sacrificing simplicity or performance. The intuitive web interface simplifies pipeline configuration and monitoring, while its robust architecture guarantees reliable data processing. It supports local development and Docker deployment, and includes a comprehensive demo setup for quick onboarding.