SciDB

Stored Procedures

Supported

Data Model

Array / Matrix

System Architecture

Shared-Nothing

Compression

Run-Length Encoding Null Suppression

SciDB allows users to define how each attribute of an array will be compressed when the array is created. The default is no compression. The additional options are zlib, bzlib, or null filter (null suppression) compression. Since SciDB stores data by attribute, vertically partitioning logical chunks of an array into single-attribute physical chunks, the specified compression is used on a chunk-by-chunk basis. If certain parts of a chunk are accessed more often than others, causing overhead due to decompression and recompression, SciDB can partition a chunk into tiles and compress on a tile-by-tile basis. Run-length encoding is used to compress recurring sequences of data. In addition, SciDB’s storage manager compression engine can split or group logical chunks in order to optimize memory usage while remaining within the limit of the buffer pool’s fixed-size slots.

Storage Model

Custom

Storage Architecture

Disk-oriented

SciDB Logo
Website

http://scidb.org/

Source Code

https://forum.paradigm4.com/t/index-of-scidb-releases/773

Developer

Paradigm4

Country of Origin

US

Start Year

2008

Project Type

Academic, Commercial, Open Source

Written in

C++

Supported languages

C++, Python, R

Embeds / Uses

PostgreSQL, RocksDB

Operating Systems

Linux

Licenses

AGPL v3, Proprietary

Wikipedia

https://en.wikipedia.org/wiki/SciDB