Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Instability in test_prefetch #9961

Closed
Tracked by #9893
jcsp opened this issue Dec 2, 2024 · 1 comment
Closed
Tracked by #9893

Instability in test_prefetch #9961

jcsp opened this issue Dec 2, 2024 · 1 comment
Assignees
Labels
a/test Area: related to testing

Comments

@jcsp
Copy link
Collaborator

jcsp commented Dec 2, 2024

Test was added in https://github.com/neondatabase/neon/pull/9847/files

Is failing with a timeout, about 10% of the time.

The test does a tight loop of reads for many minutes: should this be in test_runner/performance instead? Even if we adjust the timeout on this test, I worry that a test like this will destabilize others when run in parallel.

@jcsp jcsp added the a/test Area: related to testing label Dec 2, 2024
github-merge-queue bot pushed a commit that referenced this issue Dec 10, 2024
## Problem

See #9961
Current implementation of prefetch buffer resize doesn't correctly
handle in-flight requests

## Summary of changes

1. Fix index of entry we should wait for if new prefetch buffer size is
smaller than number of in-flight requests.
2. Correctly set flush position

Co-authored-by: Konstantin Knizhnik <[email protected]>
github-merge-queue bot pushed a commit that referenced this issue Dec 13, 2024
## Problem

`test_prefetch` is flaky
(#9961), but if it passes,
the run time is less than 30 seconds — we don't need an extended timeout
for it.

## Summary of changes
- Remove extended test timeout for `test_prefetch`
@ololobus
Copy link
Member

Seems to be stable after the fix

Image

The test does a tight loop of reads for many minutes: should this be in test_runner/performance instead? Even if we adjust the timeout on this test, I worry that a test like this will destabilize others when run in parallel.

Discussed with @hlinnaka and @knizhnik, it's needed for correctness test at this moment. Making it less heavy will decrease the chance that it will catch the actual problem

Considering that and that it's not flaky atm, closing. Feel free to reopen if you still see a problem

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
a/test Area: related to testing
Projects
None yet
Development

No branches or pull requests

3 participants