Re: flink-orc or flink-orc-nohive

2020-04-14 Thread Sivaprasanna
I have created a ticket to update the ORC version. https://issues.apache.org/jira/browse/FLINK-17142 On Tue, Apr 14, 2020 at 8:18 PM Jingsong Li wrote: > Hi, yes, we can bump orc-core version to a newer. > > Best, > Jingsong Lee > > On Tue, Apr 14, 2020 at 8:16 PM Sivaprasanna > wrote: > > > O

Re: flink-orc or flink-orc-nohive

2020-04-14 Thread Jingsong Li
Hi, yes, we can bump orc-core version to a newer. Best, Jingsong Lee On Tue, Apr 14, 2020 at 8:16 PM Sivaprasanna wrote: > On a similar note, I just checked that the Flink currently uses orc 1.4.3 > in the dependencies. IMO, it is a little outdated. Can we bump the ORC > version to a slightly n

Re: flink-orc or flink-orc-nohive

2020-04-14 Thread Sivaprasanna
On a similar note, I just checked that the Flink currently uses orc 1.4.3 in the dependencies. IMO, it is a little outdated. Can we bump the ORC version to a slightly newer version - maybe 1.5.x or even 1.6.0? - Sivaprasanna On Tue, Apr 14, 2020 at 1:42 PM Jingsong Li wrote: > Hi, > > Maybe you

Re: flink-orc or flink-orc-nohive

2020-04-14 Thread Jingsong Li
Hi, Maybe you should use flink-orc. And use orc-core instead of orc-core with nohive classifier. We can provide nohive version in the future. Because orc and hive are so close, orc still relies on some classes of hive currently. Apache orc with nohive classifier is for create a variant of core an

flink-orc or flink-orc-nohive

2020-04-14 Thread Sivaprasanna
Hello, I'm working on an implementation of ORC BulkWriter[1]. As of now, I have the entire implementation in a separate module called "flink-orc-compress" under "flink-formats" since I'm not entirely sure whether it should go into the existing ORC modules i.e flink-orc & flink-orc-nohive. So my q