Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document node's store structure #1603

Merged
merged 18 commits into from
Nov 28, 2024
Merged
Show file tree
Hide file tree
Changes from 17 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .vitepress/config.ts
Original file line number Diff line number Diff line change
Expand Up @@ -477,6 +477,10 @@ function sidebarHome() {
text: "Syncing a light node from a trusted hash",
link: "/how-to-guides/celestia-node-trusted-hash",
},
{
text: "Datastore structure",
link: "how-to-guides/celestia-node-store-structure",
},
{
text: "Troubleshooting",
link: "/how-to-guides/celestia-node-troubleshooting",
Expand Down
28 changes: 28 additions & 0 deletions how-to-guides/celestia-node-store-structure.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
---
description: This section contains information on the celestia-node datastore and its contents.
jcstein marked this conversation as resolved.
Show resolved Hide resolved
---

# celestia-node datastore

The node's datastore refers to the storage structure
used to manage the data that supports the node's operation.
It consists of directories and files that contain the node's state,
configuration, and other information relevant to the node.

The following are the directories and files found in the datastore:

- `/blocks`: This directory stores blocks. Each file contained in this directory
represents a block on Celestia and contains its associated data. This directory is present in the datastore for bridge and full nodes but not light nodes, as light nodes do not store blocks.

- `/data`: This directory contains block headers and various files belonging to node log-structured merge (LSM) storage system such as `DISCARD`, `KEYREGISTRY`, and `MANIFEST`.
jcstein marked this conversation as resolved.
Show resolved Hide resolved

- `/index`: This directory stores the index files that handle mapping specific keys such as block heights, to the corresponding data. Similar to `/blocks`, the light node's datastore does not include this directory, as they do not perform indexing.

- `/inverted_index`: This directory stores the inverted index files used for mapping queries to the corresponding data location, and various files belonging to node LSM storage system, such as `DISCARD`, `KEYREGISTRY`, `LOCK`, and `MANIFEST`. The light node's datastore does not contain this directory.
jcstein marked this conversation as resolved.
Show resolved Hide resolved

- `/keys`: This directory stores the cryptographic key pairs that are used to operate the node.

- `/transients`: This directory contains temporary data such as cache files
that are used while the node is operating, but are not a part of the permanent blockchain state.

- `config.toml`: This is the node's primary configuration file. It defines the node's core settings, such as the network parameters.
jcstein marked this conversation as resolved.
Show resolved Hide resolved
Loading