BangDB

BangDB

Industry	Database
Key people	Sachin Sinha (Creator)
Parent	Iqlect Software Solutions
Website	bangdb.com

BangDB is a NoSQL database written in C/C++ from scratch to scale out applications suitable for heavy lifting.

It is a multi-flavored database available as BangDB Embedded, BangDB Server, Data Fabric and Elastic Cache. It is a high-performance embedded database for transactional key value data which supports full ACID (Atomicity, Consistency, Isolation and Durability) by implementing optimistic concurrency control with parallel verification for high performance and concurrency and is downloadable via a BSD License.

BangDB was developed and authored by Sachin Sinha in 2012. It has its own buffer pool, write ahead log with crash recovery system and provides users with many configuration to control the execution environment including the memory budget.

History

BangDB was developed in 2011 and released its first beta version in 2012 November. BangDB 0.1 was released with few simple features such as key- value store DB with opaque data, support for Btree + extHash, get, put, delete and simple scan, write-ahead log and buffer pool. When it was first developed, it was mostly used for fast key access especially for a small size data.

In 2014, BangDB 0.9 was released which included features like replication, support for multiple table types and index support. Currently BangDB 1.5 is the recent version for BangDB-embedded and server.

BangDB is not fully open-source. It is offered as binaries under BSD 3 licence for free which has a limited usage constrain.

BangDB, which is a part of IQLECT Software Solutions was backed by Exfinity ventures in the year 2014.

Architecture

File:BangDb server.png

BangDB_Server Architecture

The architectural objectives while designing the BangDB were:

• The Flexibility - key-value store in various forms
• The performance and scalability
• The robustness and reliability.

BangDB - Embedded

BangDB Embedded version is part of the BangDB family and a high level architecture consists of three main important components of the Database.

• The Access Methods or indexes
• The Buffer Pool and management, and
• The Write Ahead Log

Access or indexing methods: The BangDB access methods are highly concurrent, which means on a machine with more CPUs or Cores, the db will perform better. Btree and hash methods are currently supported in the BangDB as access methods.

The Buffer Pool and management: The BangDB, when enabled, reads and writes data from the buffer pool. The buffer pool also allows one to control the memory budget on a machine.

The Write Ahead Log: The BangDB implements write ahead log, the ARIES algorithm, for data durability and atomicity. The write-ahead log provides the data recovering capability when required. For example, in the event of process or machine crash etc..., It recovers the data when restarted and brings the DB to the state where it was when it crashed.

BangDB-Server

In this flavour, BangDB runs as network service and clients access it over the network. This model is good for sharing data with multiple apps or instances of an app. The typical use case for this flavour is cache on top of the database, a network data store etc.

The architecture of BangDB follows a form of Staged Event-Driven Architecture (SEDA) which suits a highly concurrent network server. The server is stage driven and with a number of stages available as configurable parameter. This makes the server well-conditioned even with increasing loads and connections in a highly stressed scenario.

Main Features

Compatible with Multi-table types:

Compatible with all table types like Normal table, Wide table and primitive table.

Multi-indexing:

Creates index on the family or lets database create on auto mode as defined.

Highly Concurrent Operations on B Link - Tree:

Manipulation of the tree performed by any thread using a small constant number of page locks anytime. Search procedure does not involve reading any node.

Concurrent Buffer Pools:

Separate pools for different types of data with semi-adaptive data flush to ensure performance degrades gracefully in the case of data overflow out of the buffer.

Sequential Data/log:

The write of data/log is always sequential and a Vectored read/write. Across the cluster, the user has more than one option. BangDB can be set as ACID within the node of the cluster.

Memory:

Slab allocator is present for most of the memory requirements. Pre-allocated client buffer present for most of the operations which enhances efficient use of memory. It Runs on commodity hardware and with smallest amount of memory committed to it. Users can allocate as much as memory needed or available.

Real-time Analytics:

Built in abstraction for Real-time data analysis is available. Counting, topk, sliding window are examples of inbuilt analytical abstractions in BangDB for various data analytics.

Concurrency:

Most of the data structures are concurrent and capable of handling tens of thousands of concurrent connections.

Complex Event processing:

Suitable for Complex Event processing and defines queries with no post processing and notifies, alerts while data is in the memory.

Machine Learning:

Suitable for training machine learning models using simple API and predicting events or streams and take necessary auto actions. Can be used for Model versioning, release and update process. Suitable for A/B testing framework, logging and alerting.

R programming:

Suitable to run R queries, building models, generating reports and charts. Integrates with R to provide insights in an ad-hoc manner to understand patterns and to select suitable ML mod-crash recovery model and WAL (Write-ahead log).

Robust and Crash-proof:

Due to the write-ahead log feature, it frequently check points the log in order to speedup the data recovery process by replaying the log in case of db/machine crash.

Differences with other database systems

Since BangDB is a NoSQL Database, it is not suitable for any relational database management systems (RDBMS) and cannot run SQL based queries. It is also said not to be suitable for heavy business intelligence queries and banking and financial DB structures.

But BangDB is time and storage efficient and has high processing speed for log data analysis, Streaming data performed in a distributed cluster environment.

Replications

The Replication of data is enabled by default in the db. No replication can also be opted by users but in a Network DB scenario, the replication is recommended to be turned ON. The data replication in sync mode allows user to switch between master and standby modes at run time.

Apart from data replication, Log replication can also be opted.

Performance

BangDB performs well for both read and write in save mode or non-save mode (as a cache). BangDB implements its own buffer pool with semi-adaptive page prefetch and performed well even with billion keys insert when compared with other NoSQL DBS.

BangDB also implements write ahead log which append only and so it avoids random seeks by optimizing the disk writes.

Transaction in BangDB

BangDB allows to create multiple user connections and simultaneous operations can be run without any concurrency issues. BangDB is a concurrent DB engine allowing multiple threads or connections to modify the DB at a time.

For a Single operation, the concurrency is done by locking and for multiple transactions, it is offered through transactions (occ). The transaction can be enabled or disabled by setting appropriate bangdb.config.

Supported platform for BangDB server

Operating Systems:

Linux (Supports Ubuntu, Debian, CentOS, Fedora, RedHat, SUSE etc. with an OS version 2.6 X onwards (32/64) bit)

Language:

C++, natively on Linux

Client:

C++ and Linux

See also

• NoSQL
• Big data
• Data analysis
• Document-oriented database
• Key–value database
• Multi-model database

External Links

• Official Website