Re: Hive Iceberg writes

2020-09-01 Thread Peter Vary
Uploaded a working implementation for unpartitioned tables. Those who are interested can take a look here: https://github.com/apache/iceberg/pull/1407 > On Aug 31, 2020, at 16:34, Peter Vary wrote: > > Thanks everyone for the quick answers. > I wil

Re: Hive Iceberg writes

2020-08-31 Thread Peter Vary
Thanks everyone for the quick answers. I will post a WIP patch as Adrian suggested in the next few days. Thanks, Peter > On Aug 27, 2020, at 19:35, RD wrote: > > Our stance has been similar at LinkedIn. Hive writes are not a priority for > us as we plan to move more and more of our workloads o

Re: Hive Iceberg writes

2020-08-27 Thread RD
Our stance has been similar at LinkedIn. Hive writes are not a priority for us as we plan to move more and more of our workloads on Hive to Spark SQL -R On Thu, Aug 27, 2020 at 10:18 AM Edgar Rodriguez wrote: > Hi folks, > > We have not started to work on this either, but we've discussed this >

Re: Hive Iceberg writes

2020-08-27 Thread Edgar Rodriguez
Hi folks, We have not started to work on this either, but we've discussed this internally on whether supporting Hive writes or not. Our first priority right now is getting Hive reads in production to have read compatibility with our existing Hive clients. We'd be interested in this, however, at Ai

Re: Hive Iceberg writes

2020-08-27 Thread Mass Dosage
We're definitely interested in this too but haven't started work on it yet. It has been discussed at our community syncs as something quite a few people are interested in so if nobody else responds a good starting point would probably be an early WIP PR that everyone can follow and contribute to.

Re: Hive Iceberg writes

2020-08-26 Thread Ryan Blue
I think Edgar and Adrien who have been contributing support for ORC and Hive are interested in this as well. On Wed, Aug 26, 2020 at 9:22 AM Peter Vary wrote: > Hi Team, > > We are thinking about implementing HiveOutputFormat, so writes through > Hive can work as well. > Has anybody working on t

Hive Iceberg writes

2020-08-26 Thread Peter Vary
Hi Team, We are thinking about implementing HiveOutputFormat, so writes through Hive can work as well. Has anybody working on this? Do you know any ongoing effort related to Hive writes? Asking because we would like to prevent duplicate effort. Also if anyone has some good pointers to start for