Re: Arrow-Parquet converters in Java

2018-01-17 Thread Li Jin
Hi Sidd, Thanks for the information. This could be a very useful tool. Li On Wed, Jan 17, 2018 at 3:05 PM, Siddharth Teotia wrote: > Hi Li, > > We do have support for Parquet <-> Arrow reader/writer in Dremio OSS. > Please take a look here: > > https://github.com/dremio/dremio-oss/tree/master/

Re: Arrow-Parquet converters in Java

2018-01-17 Thread Siddharth Teotia
Hi Li, We do have support for Parquet <-> Arrow reader/writer in Dremio OSS. Please take a look here: https://github.com/dremio/dremio-oss/tree/master/sabot/kernel/src/main/java/com/dremio/exec/store/parquet https://github.com/dremio/dremio-oss/blob/master/sabot/kernel/src/main/java/com/dremio/ex

Arrow-Parquet converters in Java

2018-01-17 Thread Li Jin
Hey folks, I know this is supported in C++, but is there a library to convert between Arrow and Parquet? (i.e., read Parquet files in Arrow format, write Arrow format to Parquet files). Jacques and Sidd, does Dremio has some library to do this? Thanks, Li