DBDB.io The Encyclopedia of Database Systems · Est. 2017
Login
Database of Databases

Database Entry

DataFusion

AI-Assisted Query Engine

DataFusion is an extensible framework for planning and executing SQL queries.

Website
https://datafusion.apache.org[01]
Source Code
https://github.com/apache/arrow-datafusion[02]
Tech Docs
https://docs.rs/datafusion/latest/datafusion[03]
Twitter
@ApacheDataFusio
Governance
Apache Software Foundation
Country of Origin
US
Start Year
2016 [05]
Coding Agents
Project Type
Open Source
Written in
Rust
License
Apache v2

Database Entry

DataFusion

AI-Assisted Query Engine

DataFusion is an extensible framework for planning and executing SQL queries.

History[04]

DataFusion became a top-level Apache project in 2024.

Data Model

Relational

Parallel Execution

Intra-Operator (Horizontal)

Query Interface

SQL

Storage Format

Parquet Arrow

Storage Model

Decomposition Storage Model (Columnar)

System Architecture

Shared-Everything
Embeddings
Seafowl Seafowl ParadeDB ParadeDB KantoDB KantoDB
View All (7)
People Also Viewed
Seafowl Seafowl Databend Databend TensorBase TensorBase PhotonDB PhotonDB

Citations

7 sources
  1. Apache DataFusion — Apache DataFusion documentation apache.org
  2. https://github.com/apache/arrow-datafusion github.com
  3. https://docs.rs/datafusion/latest/datafusion docs.rs Dead — Check Archive
  4. Apache Software Foundation Announces New Top-Level Project Apache® DataFusion™  - The ASF Blog apache.org
  5. Initial Commit github.com
  6. https://github.com/apache/arrow-datafusion/commit/3b321a20ea6edf7457085886445ed02078f86de2 github.com
  7. https://github.com/apache/arrow-datafusion/commit/11caa4c1bb498eb5a766dd3a14c5bc54a14d48b5 github.com
Revision #4 Last Updated: