TileDB

TileDB is a multi-dimentional array management system which uses an on-disk format that can store dense and sparse array data with support for fast updates. Current open-source version of TileDB functions as a storage layer, connecting user applications to storage backend.

History

TileDB was invented at the Intel Science and Technology Center for Big Data, a collaboration between Intel Labs and MIT. The research project was published in a VLDB 2016 paper. TileDB, Inc. was founded in February 2017 to further develop and maintain the DBMS.

Query Interface

Custom API

TileDB supports API for the following languages: C, C++, Python, Java, R, and Go.

Views

Not Supported

TileDB does not support views at the current version.

Storage Model

Decomposition Storage Model (Columnar)

TileDB supports columnar format for different attributes stored in arrays.

Foreign Keys

Not Supported

TileDB does not support foreign keys at the current stage.

Logging

Not Supported

TileDB does not support logging at the current stage.

Stored Procedures

Not Supported

TileDB does not support stored procedures at the current stage.

Data Model

Array / Matrix

TileDB uses a multi-dimensional array format that handles both sparse data and dense data.

Concurrency Control

Not Supported

TileDB provides no transaction support in the current version. It only guarantees atomic reads and writes.

Isolation Levels

Read Uncommitted

TileDB provides no transaction support in the current version, and no isolation could be guaranteed.

Joins

Not Supported

TileDB does not support join operations at the current stage.

Storage Architecture

Disk-oriented

TileDB uses a disk-oriented storage format that can store dense and sparse array data and support fast updates.

Checkpoints

Not Supported

TileDB does not support checkpoints at the current stage.

Compression

Dictionary Encoding Run-Length Encoding

TileDB supports the following compressors: GZIP, Zstandard, LZ4, RLE, Bzip2, and Double-delta. Double-delta is a compressor created for TileDB, and is similar to Facebook's Gorilla system.

TileDB Logo
Website

http://tiledb.org/

Source Code

https://github.com/TileDB-Inc/TileDB

Tech Docs

https://people.csail.mit.edu/stavrosp/papers/vldb2017/VLDB17_TileDB.pdf

Developer

TileDB Inc, Intel Labs

Country of Origin

US

Start Year

2017

Acquired By

TileDB Inc

Project Type

Commercial, Open Source

Written in

C++

Supported languages

C, C++, Go, Java, Python, R

Operating Systems

Linux, OS X, Windows

Licenses

MIT