Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

Web ui for Apache Paimon.

Apache Paimon Rust The rust implementation of Apache Paimon.

Apache DataFusion SQL Query Engine

Open, Multi-modal Catalog for Data & AI

A high-performance, geo-distributed and federated metadata lake

Apache Spark

Apache Celeborn Site

A native Rust library for Apache Hudi, with bindings into Python

An Apache Flink subproject to provide storage for dynamic tables.

Apache Flink

Apache Flink Kubernetes Operator

Apache Spark Kubernetes Operator

Upserts And Incremental Processing on Big Data

Distributed DataFrame for Python designed for the cloud, powered by Rust

Apache Arrow DataFusion Comet Spark Accelerator

Alluxio, data orchestration for analytics and machine learning in the cloud

A Pythonic framework to simplify AI service building

OneTable is an omni-directional converter for table formats that facilitates interoperability across data processing systems and query engines.

An open-source, cloud-native, distributed time-series database with PromQL/SQL/Python supported.

A cloud native implementation for Apache RocketMQ 5.0

A cloud native implementation for Apache Kafka

Catch common Java mistakes as compile-time errors

Apache Iceberg (Incubating)

Apache Doris is an easy-to-use, high performance and unified analytics database.

�� Building applications with LLMs through composability ⚡

Apache Kyuubi is a distributed multi-tenant JDBC server for large-scale data processing and analytics, built on top of Apache Spark

StarRocks is a next-gen sub-second MPP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics and ad-hoc query.