DKV-Store

An on-disk, high-performant & consistent distributed key value store in C++

Components

• Shard master: share/update distribution of keys between volume servers
• Volume server: Database storing key-value pairs

Tools & Libraries used

• gRPC
• levelDB
• concurrent-queue
• thread-pool
• md5 hashing

Build and Run

Dependencies:

• gRPC: Install
• levelDB: Install
• cmake: Install

The project uses cmake > 3.5.1 to generate build files. After installing dependencies, run bash build.sh to generate build files.

To run tests:

• Navigate to tests
• Run bash test.sh

To manually spawn servers & clients:

Write your own instructions using APIs provided in client/client.cc

• Navigate to client
• To launch shard-master & volume-servers, run bash launch.sh $num-of-volume-servers
• Finally to launch your client, run ../cmake/build/client

Dev Workflows

Tests are based of here and are automated on Github Actions.

Code Structure

License

MIT