Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scatter might have a skewed distribution if the operators fails #7838

Open
rleungx opened this issue Feb 22, 2024 · 0 comments
Open

Scatter might have a skewed distribution if the operators fails #7838

rleungx opened this issue Feb 22, 2024 · 0 comments
Labels
type/enhancement The issue or PR belongs to an enhancement.

Comments

@rleungx
Copy link
Member

rleungx commented Feb 22, 2024

Enhancement Task

We use a TTL cache to calculate the distribution of scatter, see

groupDistribution *cache.TTLString // value type: map[uint64]uint64, group -> StoreID -> count

But if the operator is created but fails, the cache won't be changed. If the client retries, it might have a skewed distribution.

@rleungx rleungx added the type/enhancement The issue or PR belongs to an enhancement. label Feb 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Development

No branches or pull requests

1 participant