HadoopStreams to support ByteBufferPositionedReadable input streams #3080
Labels
Comments
|
I'm implementing this, with tests. |
steveloughran
added a commit
to steveloughran/parquet-mr
that referenced
this issue
Nov 27, 2024
steveloughran
added a commit
to steveloughran/parquet-mr
that referenced
this issue
Nov 27, 2024
Based of the H2 stream test suite but * parameterized for on/off heap * expect no changes in buffer contents on out of range reads. Still one test failure.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the enhancement requested
If a stream declares in its StreamCapabilities that it supports
ByteBufferPositionedReadable, then use it for
readFully(ByteBuffer)All streams in Hadoop 3.0.0 + do declare this.
ByteBufferReadable.For detecting ByteBufferReadable, use this probe falling back to the recursive scan.
All streams in the hadoop codebase will report this via StreamCapabilities, but there
may be some third-party streams which do not.
Component(s)
No response
The text was updated successfully, but these errors were encountered: