Velox is a reusable vectorized database execution engine. It can be used to build compute engines focused on analytical workloads, including batch (Spark, Presto), interactive (PyVelox), stream, log processing, and AI/ML.[04][05]
- Website
- https://velox-lib.io[01]
- Source Code
- https://github.com/facebookincubator/velox[02]
- Developer
- Country of Origin
- US
- Start Year
- 2020 [07]
- Project Types
- Industrial Research, Open Source
- Written in
- C++
- License
- Apache v2
Unlike a complete database, Velox cannot be used directly by end-users. Rather, it is designed to be a general-purpose component to handle execution that database developers can use in their systems.
Velox is a reusable vectorized database execution engine. It can be used to build compute engines focused on analytical workloads, including batch (Spark, Presto), interactive (PyVelox), stream, log processing, and AI/ML.
Unlike a complete database, Velox cannot be used directly by end-users. Rather, it is designed to be a general-purpose component to handle execution that database developers can use in their systems.[04][05]
History[04][06]
Meta's data infrastructure contains dozens of specialized data computation engines, which have been largely developed independently. Maintaining and enhancing each of them can be difficult, especially considering the rapid change of workload requirements and hardware condition.
Velox is created in 2020 and open-sourced in 2021 to address this problem as a unified execution engine. It is under active development, but it’s already in various stages of integration with some systems, including Presto, Spark, and PyTorch (the latter through a data preprocessing library called TorchArrow), etc. Additional contributions were provided by Intel, ByteDance, and Ahana.
SereneDB
Citations
7 sources- Velox | Open-Source Composable Execution Engine velox-lib.io
- GitHub - facebookincubator/velox: A composable and fully extensible C++ execution engine library for data management systems. · GitHub github.com
- Velox Documentation — Velox documentation github.io
- Velox: Meta’s Unified Execution Engine fbcdn.net
- https://www.youtube.com/watch?v=HgNP3d93Jb4 youtube.com
- Introducing Velox: An open source unified execution engine fb.com
- https://twitter.com/andy_pavlo/status/1523666175602814976?s=20 twitter.com