VictoriaMetrics is time series database management system that is designed as a storage back-end for Prometheus.[03][04]
- Developer
- Country of Origin
- UA
- Start Year
- 2018 [10]
- Project Type
- Open Source
- Written in
- Go
- License
- Apache v2
Checkpoints[05]
VictoriaMetrics uses their modified version of LSM tree (Logging Structure Merge Tree). All the tables and indexes on the disk are immutable once created. When it's making the snapshot, they just create the hard link to the immutable files.
Data Model[06]
The time series is consist of metrics and the values for corresponding timestamps. It looks like:
{"metric":{"__name__":"up","job":"node_exporter","instance":"localhost:9100"},"values":[0,0,0],"timestamps":[1549891472010,1549891487724,1549891503438]}
{"metric":{"__name__":"up","job":"prometheus","instance":"localhost:9090"},"values":[1,1,1],"timestamps":[1549891461511,1549891476511,1549891491511]}
Indexes[05][07]
VictoriaMetrics stores the data in MergeTree, which is from ClickHouse and similar to LSM. The MergeTree has particular design decision compared to canonical LSM.
MergeTree is column-oriented. Each column is stored separately. And the data is sorted by the "primary key", and the "primary key" doesn't have to be unique. It speeds up the look-up through the "primary key", and gets the better compression ratio. The "parts" is similar to SSTable in LSM; it can be merged into bigger parts. But it doesn't have strict levels.
The Inverted Index is built on "mergeset" (A data structure built on top of MergeTree ideas). It's used for fast lookup by given the time-series selector.
Logging[08]
The design philosophy of VictoriaMetrics is that time series DBMSs do not require strict safety guarantees. That is, organizations can endure losing some recently inserted data. As such, it does not use a WAL and it delays flushing new data to disk.
Query Interface[09]
VictoriaMetrics provides a proprietary query language called MetricsQL that is a superset of PromQL.
Citations
10 sources- VictoriaMetrics: Simple & Reliable Monitoring for Everyone victoriametrics.com
- GitHub - VictoriaMetrics/VictoriaMetrics: VictoriaMetrics: fast, cost-effective monitoring solution and time series database · GitHub github.com
- VictoriaMetrics/README.md at master · VictoriaMetrics/VictoriaMetrics · GitHub github.com
- https://medium.com/@valyala/mmap-in-go-considered-harmful-d92a25cb161d medium.com
- https://medium.com/@valyala/how-victoriametrics-makes-instant-snapshots-for-multi-terabyte-time-series-data-e1f3fb0e0282 medium.com
- VictoriaMetrics/README.md at master · VictoriaMetrics/VictoriaMetrics · GitHub github.com
- https://clickhouse.yandex/docs/en/development/architecture/ clickhouse.yandex
- https://medium.com/@valyala/wal-usage-looks-broken-in-modern-time-series-databases-b62a627ab704 medium.com
- https://victoriametrics.github.io/MetricsQL.html github.io
- Initial commit github.com