RE: LLAP can't read ORC ZLIB files from S3

2020-06-28 Thread Aaron Grubb
PM To: user@hive.apache.org Subject: Re: LLAP can't read ORC ZLIB files from S3 Actually, it looks like LLAP is trying to get the ByteBuffer array from a direct byte buffer. Turning off direct byte buffers on read should fix the problem. .. Owen On Thu, Jun 25, 2020 at 7:27 AM A

Re: LLAP can't read ORC ZLIB files from S3

2020-06-25 Thread Owen O'Malley
Actually, it looks like LLAP is trying to get the ByteBuffer array from a direct byte buffer. Turning off direct byte buffers on read should fix the problem. .. Owen On Thu, Jun 25, 2020 at 7:27 AM Aaron Grubb wrote: > This appears to have been caused by orc.write.variable.length.blocks=true >

RE: LLAP can't read ORC ZLIB files from S3

2020-06-25 Thread Aaron Grubb
This appears to have been caused by orc.write.variable.length.blocks=true which I had set for HDFS-based tables. Setting this to false and inserting data into the S3 table appears to have fixed this problem. From: Aaron Grubb Sent: Wednesday, June 24, 2020 4:04 PM To: user@hive.apache.org Subje