Greenplum database is an open source data warehouse. It uses massive parallel processing technique to provide large-scale analytics on pentabyte scale data volumns. It is powered by an advanced cost-based cascade framework query optimizer to achieve fast analytical query execution.[04][05]
- Website
- http://greenplum.org[01]
- Source Code
- https://github.com/greenplum-db/gpdb[02]
- Country of Origin
- US
- Start Year
- 2003 [03]
- Project Types
- Commercial, Open Source
- Written in
- C
- Derived From
- PostgreSQL
- Operating System
- Linux
- License
- Apache v2
History[05]
Greenplum is found in September 2003 by Luke Lonergan and Scott Yara. The company releases the database management system software based on PostgreSQL in 2005. The company is aquired by EMC in 2010, and its database management system is known as Pivitol Greenplum Database. The company became part of the Pivitol Software in 2012.
Concurrency Control[04]
Greenplum uses PostgreSQL MVCC as the concurrency control scheme for each database instances. Each transaction reads from a consistent snapshot that's not modified by any concurrent transactions. MVCC generally performs better than lock-based concurrency control in Greenplum because transactions performing read will not block transactions updating the table.
Foreign Keys[07]
Greenplum supports all features in SQL1992 standard, users can define foreign keys in Greenplum and it will be stored in the system catalog.
Indexes[04]
Greenplum supports PostgreSQL index type B-tree and Gist. B-tree index is the default index type as it fit with most common situations. Bitmap index is also supported in Greenplum to accelerate analytics queries in data warehouse applications and desicion support systems.
Isolation Levels[04]
Greenplum supports three isolation levels, read uncommitted, read committed and serializable. The default mode is read committed, which allows more concurrency than serializable. Requesting repeatable read in Greenplum will produce an error.
Joins[08][09][10]
Three types of join algorithms, nested loop join, hash join and sort-merge join are supported in Greenplum. According to the blog article for their optimizer, semi join type is also supported.
Logging[11][12]
Greenplum achieves fault tolerance for data tables via segment mirroring. Each table is divided into several segments, and each segment has two copies, primary and mirror, stored in different nodes. The primary and mirror perform the same operation and keeps the same data. For master nodes, they also do mirroring by storing transaction level logging in a stand-by node. DBAs are able to view the status of the database by checking the command logging.
Query Compilation[13]
Greenplum utilizes query compilation for predicate evaluation, tuple deform and primitive type functions, etc. It doesn't compile the execution engine into a push-based model. As it is mentioned in the Query Execution section, the execution model is volcano pull style.
Query Interface[15][16][07][04]
Greenplum supports all features in SQL 1992 standard, most of the features in SQL 1999 standard and some features in SQL 2003 standard. Users interact with Greenplum in the same way as they interact with PostgreSQL. They can directly enter query statements in SQL clients such as psql to perform view, change and analyze in the database. The system also support PL/pgSQL, but features such as triggers, scrollable cursors and updatable cursors are not supported.
Storage Architecture
Greenplum takes the disk-oriented storage architecture from Postgres.
Storage Model[04]
Greenplum supports both the N-ary storage model and Decomposition storage model. Clients can specify the storage model options using WITH clause of the CREATE TABLE command. The default is row-oriented(N-ary) storage model.
System Architecture[04]
Greenplum uses massive parallel processing architecture to execute large-scale analytical queries, the workload is distributed among nodes to parallelize query execution. Each machine runs an PostgreSQL database instance, which is modified to support parallel query execution. All the nodes are connected via Greenplum interconnect(the netwrok layer) to perform the behaviour as a single database instance. Greenplum differs from Postgres in 3 ways, first it leverages Orca as a query planner, second it supports column store, third it has declarative partitioning and sub-partitioning.
Citations
19 sources- http://greenplum.org greenplum.org
- https://github.com/greenplum-db/gpdb github.com
- Greenplum - Wikipedia wikipedia.org
- Broadcom Inc. | Connecting Everything broadcom.com
- Greenplum - Wikipedia wikipedia.org
- PostgreSQL: Documentation: 9.2: WAL Configuration postgresql.org
- https://gpdb.docs.pivotal.io/4320/ref_guide/feature_summary.html pivotal.io
- Home - Tanzu vmware.com
- https://gpdb.docs.pivotal.io/4370/ref_guide/sql_commands/SELECT.html pivotal.io
- https://gpcc.docs.pivotal.io/210/gpcc/topics/db-iterator-metrics.html pivotal.io
- https://gpdb.docs.pivotal.io/4370/admin_guide/highavail/topics/g-overview-of-high-availability-in-greenplum-database.html pivotal.io
- https://gpdb.docs.pivotal.io/4360/gp_toolkit-topic16.html pivotal.io
- CMU SCS 15-721 (Spring 2017) :: Query Compilation cmu.edu
- https://gpdb.docs.pivotal.io/4330/admin_guide/parallel_proc.html pivotal.io
- Broadcom Inc. | Connecting Everything broadcom.com
- https://gpdb.docs.pivotal.io/4330/admin_guide/query.html pivotal.io
- https://gpdb.docs.pivotal.io/4370/ref_guide/extensions/pl_java.html pivotal.io
- https://gpdb.docs.pivotal.io/4370/ref_guide/sql_commands/CREATE_VIEW.html pivotal.io
- http://gpdb.docs.pivotal.io/43130/common/welcome.html#topic1__section_gpdb_rn pivotal.io