History

PieCloudDB is developed by OpenPie. PieCloudDB issued its community edition and enterprise edition on Oct. 24, 2022. And Cloud on Cloud edition went on public on March.14, 2023.

Compression

PieCloudDB utilizes a hybrid row-column storage approach, where data of the same type is clustered together. This provides excellent compression rates for dictionary-based compression algorithms.

Concurrency Control

In PieCloudDB, the concurrency control scheme used by each coordinator instance is Multi-Version Concurrency Control (MVCC). This approach ensures that each transaction reads from a consistent snapshot of the database that remains unaltered by concurrent transactions. MVCC offers several advantages over lock-based concurrency control in PieCloudDB, particularly in terms of performance.

Data Model

PieCloudDB is a rational database, compatible with the complete SQL standard and ACID transactions.

Indexes

PieCloudDB does not support normal index because dense index is extremely expensive for OLAP scenario. However, PieCloudDB uses min-max based pruning, and other techniques to accelerate data access.

Isolation Levels

PieCloudDB support two isolation levels: Read Committed and Repeatable Read.

Joins

PieCloudDB support multiple joins, including Hash Join, Merge Join and Nested Loop Join. And PieCloudDB also support two logical joins: Semi Join and Anti Join, which are used to support sub-link pull up.

Query Compilation

PieCloudDB is JIT compatible

Query Execution

Query Interface

PieCloudDB is highly compatible with the SQL:2016 standard, fully supporting the SQL:1992 standard, most of the SQL:1999 standard, and some features of the SQL:2003 standard (with a focus on OLAP capabilities). It also supports advanced expressions such as window functions.

Storage Architecture

PieCloudDB uses object storage for data storage.PieCloudDB nodes uses HTTP -based interface to read/write data upon query execution. The worker node also uses its local disk as a cache.

Storage Format

PieCloudDB build its own hybrid storage "JAMN"

Storage Model

PieCloudDB's horizontal data block into compressed, immutable files, along with the inclusion of footers containing column offsets, provides an efficient and optimized storage system. It improves data compression, accelerates query processing, and simplifies data management within the database.

Stored Procedures

PieCloudDB support standard store procedure

System Architecture

PieCloudDB utilizes object storage as its underlying data storage mechanism. Query execution is performed within elastic clusters of virtual machines called virtual warehouses. When executing queries, virtual warehouses utilize an HTTP-based interface to read and write data from the object storage. The Cloud Service layer in PieCloudDB encompasses a collection of services responsible for managing computation clusters, queries, transactions, and metadata such as database catalogs and access control information. These services are stored in FoundationDB.

Views

PieCloudDB support both materialized views and virtual views.