Steve Loughran created HADOOP-18854:
---------------------------------------
Summary: add options to disable range merging of vectored io
Key: HADOOP-18854
URL: https://issues.apache.org/jira/browse/HADOOP-18854
Project: Hadoop Common
Issue Type: Improvement
Components: fs, fs/s3
Affects Versions: 3.3.6, 3.3.5
Reporter: Steve Loughran
I'm seeing test failures in my PARQUET-2171 pr because assertions about the #of
bytes read isn't holding -small files are being read and the vector range
merging is pulling in the whole file.
```
[ERROR] TestInputOutputFormat.testReadWriteWithCounter:338 bytestotal !=
bytesread expected:<5510> but was:<11020>
```
I think for parquet i will add an option to disable vector io, but really the
filesystems which support it should allow for merging to be disabled
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
