Kylin is an open source distributed data analytics engine on top of Hadoop/Spark. It offers SQL interface to do OLAP on large datasets. [04][05][06]
- Website
- http://www.kylin.io[01]
- Source Code
- https://github.com/apache/kylin[02]
- Tech Docs
- https://kylin.apache.org/docs[03]
- Developer
- Country of Origin
- CN
- Start Year
- 2013 [04]
- Former Name
- KylinOLAP
- Project Type
- Open Source
- Written in
- Java
- Supported Languages
- Java
- License
- Apache v2
Unlike massive parallel processing engines like Hive and Presto, Kylin pre-calculates a set of data cubes, stores them in HBase, and directly looks up the results in them. If a query cannot be answered by the data cubes, it will be executed by the underlying process engine. In this way, Kylin is usually used as an accelerator of traditional parallel data processing engines.
Kylin is a pure OLAP engine, so it only supports SELECT queries. INSERT, UPDATE and DELETE are not supported.
Kylin is an open source distributed data analytics engine on top of Hadoop/Spark. It offers SQL interface to do OLAP on large datasets.
Unlike massive parallel processing engines like Hive and Presto, Kylin pre-calculates a set of data cubes, stores them in HBase, and directly looks up the results in them. If a query cannot be answered by the data cubes, it will be executed by the underlying process engine. In this way, Kylin is usually used as an accelerator of traditional parallel data processing engines.
Kylin is a pure OLAP engine, so it only supports SELECT queries. INSERT, UPDATE and DELETE are not supported.[04][05][06]
History[04]
The Kylin project was started in 2013, from eBay's R&D in Shanghai, China. It was open sourced on Github as "KylinOLAP" in Oct 2014.
In Nov 2015, Kylin joined Apache Software Foundation incubator;
In Dec 2015, Apache Kylin became a Top Level Project.
Compression[07]
Kylin applies dictionary encoding to all dimension values in data cubes. Kylin's dictionary is order-preserving and supports mapping both from keys to values and vice versa. The dictionary is implemented as a radix tree.
Besides, Kylin also supports naive compression in HBase and Hive.
Citations
7 sources- http://www.kylin.io kylin.io
- GitHub - apache/kylin: Apache Kylin · GitHub github.com
- Index of /docs apache.org
- Apache Kylin - Wikipedia wikipedia.org
- http://kylin.apache.org/docs/gettingstarted/faq.html apache.org
- 403 Forbidden jianshu.com
- http://kylin.apache.org/blog/2015/08/13/kylin-dictionary/ apache.org