Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mstore: implement rebalancing #1

Open
ThomasWaldmann opened this issue Aug 2, 2024 · 0 comments
Open

mstore: implement rebalancing #1

ThomasWaldmann opened this issue Aug 2, 2024 · 0 comments

Comments

@ThomasWaldmann
Copy link
Member

(re)balancing of data distribution, includes:

  • non-mirrored MStore with one store to mirrored with N stores
  • moving data from an old disk (store) to a new disk (store)
  • changing bucket count ratio between stores, because one might get full
  • maybe have a "previous" map for quicker rebalancing
  • does it need locking or can we support parallel ops while rebalancing?

Note: the current MStore implementation supports writing to SOME stores and reading from ALL stores, so it should always find data, even if we are in the process of stopping to use one store.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant