QuestDB

QuestDB is a high performance open source SQL database for time series data.

It uses a column-oriented approach, heavy parallelized vectorized execution, SIMD instructions and a whole array of low-latency techniques. The whole code base is built from scratch, without dependencies and 100% free from garbage collection.

QuestDB implements SQL and augments it for time-series with native extensions. It exposes a Postgres wire protocol, high-performance REST API and supports ingestion with InfluxDB Line Protocol. QuestDB uses a relational model and can be both shema or schema-free through InfluxDB Line Protocol. Relational and time-series joins make it easy to correlate data over time. Writes are durably committed to disk, meaning that the data is safe - yet instantly accessible.

History

QuestDB started as a side project in 2013 by Vlad Ilyushchenko who applied principles from low latency techniques found in the financial services industry. QuestDB is backed by YCombinator.

Concurrency Control

Timestamp Ordering

QuestDB uses a single writer model. The writer re-orders timestamps on the fly. Multi-publisher, single consumer queue provides concurrent write access.

Stored Procedures

Not Supported

Storage Model

Decomposition Storage Model (Columnar)

QuestDB uses a column-based storage model. Data is stored in tables with each column stored in its own file and its own native format. New data is appended to the bottom of each column to allow data to be organically retrieved in the same order that it was ingested.

Query Interface

SQL

QuestDB enhances ANSI SQL with time series extensions to manipulate time stamped data.

Query Compilation

JIT Compilation

Data Model

Relational

QuestDB uses a relational model with column-based storage model.

Storage Organization

Log-structured

Hardware Acceleration

Custom

SIMD optimised analytics.

Storage Architecture

Disk-oriented

Memory mapped files data access.

Foreign Keys

Not Supported

Indexes

Hash Table

Indexing is available for symbol columns. Index support for other types will be added over time.

Parallel Execution

Inter-Operator (Vertical)

Multi threaded SQL execution.

Joins

Hash Join Semi Join

QuestDB supports the following types of joins: INNER, OUTER, CROSS, ASOF and SPLICE. FULL joins are not yet implemented and are on our roadmap. All supported join types can be combined in a single SQL statement.

Logging

Not Supported

System Architecture

Shared-Nothing Embedded

QuestDB Logo
Website

https://www.questdb.io/

Source Code

https://github.com/questdb/questdb

Tech Docs

https://questdb.io/docs/introduction/

Developer

QuestDB

Country of Origin

GB

Start Year

2013

Project Type

Commercial, Open Source

Written in

C++, Java

Supported languages

C, C++, Go, Java, JavaScript, Python, R, Rust, SQL

Inspired By

Kdb+

Compatible With

InfluxDB, PostgreSQL

Operating Systems

Android, Linux, OS X, Windows

Licenses

Apache v2