Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor(virtual_file) make write_all_at take owned buffers #6673

Conversation

problame
Copy link
Contributor

@problame problame commented Feb 7, 2024

context: #6663

Building atop #6664, this PR switches write_all_at to take owned buffers.

The main challenge here is the EphemeralFile::mutable_tail, for which I'm picking the ugly solution of an Option that is None while the IO is in flight.

After this, we will be able to switch write_at to take owned buffers and call tokio-epoll-uring's write function with that owned buffer. That'll be done in #6378.

We can probably get rid of the entire trait, but, that's for another time.
…uilder-refactor' into problame/integrate-tokio-epoll-uring/write-path/simplify-write-at-api
…r-blob-writer' into problame/integrate-tokio-epoll-uring/write-path/refactor-virtual-file
…r-blob-writer' into problame/integrate-tokio-epoll-uring/write-path/virtual-file-write-all
…kio-epoll-uring/write-path/refactor-blob-writer
…r-blob-writer' into problame/integrate-tokio-epoll-uring/write-path/virtual-file-write-all
@problame problame requested a review from a team as a code owner February 7, 2024 23:16
@problame problame requested review from koivunej and removed request for a team February 7, 2024 23:16
@problame problame removed the request for review from koivunej February 7, 2024 23:20
@problame problame marked this pull request as draft February 7, 2024 23:20
Copy link

github-actions bot commented Feb 8, 2024

2436 tests run: 2318 passed, 0 failed, 118 skipped (full report)


Flaky tests (3)

Postgres 15

  • test_sharding_split_unsharded: release

Postgres 14

  • test_multi_attach: debug
  • test_sharding_split_unsharded: release

Code coverage (full report)

  • functions: 55.9% (12849 of 22972 functions)
  • lines: 82.5% (69346 of 84041 lines)

The comment gets automatically updated with the latest test results
6a55ac7 at 2024-02-14T14:48:40.261Z :recycle:

@problame problame added the run-no-ci Don't run any CI for this PR. label Feb 12, 2024
…-file-write-all' into problame/integrate-tokio-epoll-uring/write-path/virtual-file-write-all-at
Base automatically changed from problame/integrate-tokio-epoll-uring/write-path/virtual-file-write-all to main February 13, 2024 17:46
@problame problame removed the run-no-ci Don't run any CI for this PR. label Feb 13, 2024
@problame problame marked this pull request as ready for review February 14, 2024 09:43
Copy link
Contributor

@VladLazar VladLazar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks correct to me- just nits/suggestions

pageserver/src/tenant/ephemeral_file.rs Show resolved Hide resolved
pageserver/src/virtual_file.rs Show resolved Hide resolved
pageserver/src/tenant/ephemeral_file.rs Outdated Show resolved Hide resolved
@problame problame merged commit 774a6e7 into main Feb 14, 2024
50 checks passed
@problame problame deleted the problame/integrate-tokio-epoll-uring/write-path/virtual-file-write-all-at branch February 14, 2024 14:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants