DBDB.io The Encyclopedia of Database Systems · Est. 2017
Database of Databases

Database Entry

Splunk


Splunk allows for structuring of machine data. It combines data from things like other databases, web servers, networks, etc. and then offers services to analyze the data, and produce dashboards, graphs, reports, and alerts that offer analysis of the data.[04]

Database Entry

Splunk


Splunk allows for structuring of machine data. It combines data from things like other databases, web servers, networks, etc. and then offers services to analyze the data, and produce dashboards, graphs, reports, and alerts that offer analysis of the data.[04]

Checkpoints[05]


Splunk supports the notion of checkpoints. When reading data and indexing, a checkpoint can be created to mark the data as being read or indexed.

Compression[06]


Splunk compresses the raw data up to half its size.

Data Model[07]


Splunk uses a flat file database model.

Indexes[08][09][10]


Indexes in Splunk do not seem to be the traditional B+ Trees, Skip Lists, or Radix Trees. However, Splunk indexes data by breaking them into events, based on the timestamp of the data. After breaking the data up into events, the events are passed through the indexing pipeline where additional steps are taken such as: breaking the events into segments so indexing and searching can be done efficiently, building data structures for the indices, and writing the events out to disk.

Joins[11]


Splunk supports inner join, outer join, but inner join is the default.

Query Execution[12]


Splunk uses MapReduce as a way of speeding up searches.

Storage Architecture[13]


Splunk is disk-oriented.

Revision #5