[
https://issues.apache.org/jira/browse/ARROW-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17662452#comment-17662452
]
Rok Mihevc commented on ARROW-5428:
-----------------------------------
This issue has been migrated to [issue
#21881|https://github.com/apache/arrow/issues/21881] on GitHub. Please see the
[migration documentation|https://github.com/apache/arrow/issues/14542] for
further details.
> [C++] Add option to set "read extent" in arrow::io::BufferedInputStream
> -----------------------------------------------------------------------
>
> Key: ARROW-5428
> URL: https://issues.apache.org/jira/browse/ARROW-5428
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Wes McKinney
> Assignee: Wes McKinney
> Priority: Major
> Fix For: 0.14.0
>
>
> I'm looking at simplifying libparquet to use common IO interfaces rather than
> its own custom ones
> The {{parquet::BufferedInputStream}} interface has an option to not read
> beyond a particular number of bytes. For example, if we were reading a 32MB
> block with 1MB buffering, then we will not consume more than 32MB from the
> raw InputStream.
> This seems like a fairly trivial addition to
> {{arrow::io::BufferedInputStream}} to track total read bytes and do not read
> beyond the configured extent. We'll have to add a method like
> {{set_read_extent}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
