Polars Cloud: A Scalable, Serverless DataFrame Processing Platform

The Polars team is building Polars Cloud, a flexible DataFrame API platform backed by high-performance compute. It aims to bridge the gap between Pandas and PySpark, offering both ease of use and scalability. Polars Cloud supports distributed computing, serverless compute, configurable hardware (GPU and CPU), diagonal scaling (both horizontal and vertical), multi-cloud support (AWS, Azure, GCP), on-premise licensing, fault tolerance, data lineage, and observability. Users can execute queries remotely with simple API calls, supporting both batch and interactive modes. Polars Cloud also supports multiple scaling strategies, including distributed, partitioned, and parallel queries, to handle various data processing needs.