Skip to content

Latest commit

 

History

History
70 lines (48 loc) · 2.39 KB

readme.md

File metadata and controls

70 lines (48 loc) · 2.39 KB
Raw

🦫 CapybaraDB in Go 🦫

Project Goal

The goal of this project is to create a high-performance, scalable, and versatile database system written in Go. This database aims to support both ACID compliance and clustering, offering robust features for modern applications. It is designed to handle column-oriented and row-oriented storage, providing flexibility for both transactional and analytical workloads.

Key Features

  1. ACID Compliance

    • Ensures data integrity with support for transactions, locking mechanisms, and durability through Write-Ahead Logging (WAL).

  2. Clustering

    • Built-in support for distributed storage, replication, and sharding.
    • Strong consistency protocols (Raft/Paxos) to synchronize data across nodes.

  3. Dual Storage Models

    • Column-Oriented Storage: Optimized for analytical queries, enabling high-speed aggregation and column-based operations.
    • Row-Oriented Storage: Ideal for transactional workloads with rapid row-level access.

  4. Indexing and Optimization

    • Advanced indexing structures (B-Tree, LSM-Tree) for efficient data retrieval.
    • Support for compression algorithms like Snappy or Zstandard to minimize storage footprint.

  5. Concurrency and Performance

    • Leverages Go’s goroutines for handling multiple operations simultaneously.
    • Built-in caching and Bloom filters to accelerate query performance.

Why Go?

Go is chosen as the primary language due to its:

  • Efficient concurrency model with goroutines.
  • Simplicity and performance for building low-level, high-performance systems.
  • Extensive support for networking and distributed systems.

Why Capybara DB?

Because capybaras are awesome! 🦫

Architecture Overview

  1. Storage Engine

    • Manages columnar and row-based data layouts.
    • Handles on-disk and in-memory storage seamlessly.

  2. Transaction Manager

    • Implements isolation levels, locking, and commit/rollback functionality.

  3. Distributed Consensus

    • Uses Raft for leader election and data synchronization between nodes.

  4. Query Engine

    • Parses and executes queries, optimizing based on storage type.

  5. APIs

    • Provides REST and gRPC endpoints for interacting with the database.

Getting Started

Prerequisites

  • Go 1.23 or higher.
  • Docker (optional, for clustering and testing).

Installation

TODO...