Re: [DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

> Decoupling pyiceberg_core with iceberg-rust may be flexible, but my concern > is that this may not be scalable when we introduce more language bindings. I > think Xuanwo has a lot of experience when maintaining Apache OpenDAL > ? OpenDAL tends to release al

Re: [VOTE] Merge guidelines for committing PRs

+1 (binding) On Thu, Aug 29, 2024 at 8:59 AM Amogh Jahagirdar <2am...@gmail.com> wrote: > +1 (binding) > > On Wed, Aug 28, 2024 at 6:45 PM Yufei Gu wrote: > >> +1 (binding) >> Yufei >> >> >> On Wed, Aug 28, 2024 at 4:56 PM Anton Okolnychyi >> wrote: >> >>> +1 (binding) >>> >>> Thanks, Micah! >>

Re: [DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

Hi: Thanks Sung for driving this. Which features do we expose in the first release? I think the transformation is a good start. Should the version of the pyiceberg_core python package be aligned with the > version of iceberg-rust crate? Decoupling pyiceberg_core with iceberg-rust may be flex

Re: [ANNOUNCE] Apache Iceberg release 1.6.1

Thanks Carl for driving this release, and everyone for contributing! On Thu, Aug 29, 2024 at 12:40 AM John Zhuge wrote: > Thanks! > > John Zhuge > > > On Wed, Aug 28, 2024 at 9:37 AM Steven Wu wrote: > >> Thanks Carl for driving this release! >> >> On Wed, Aug 28, 2024 at 8:34 AM Carl Steinbach

Re: [VOTE] Merge guidelines for committing PRs

+1 (binding) On Wed, Aug 28, 2024 at 6:45 PM Yufei Gu wrote: > +1 (binding) > Yufei > > > On Wed, Aug 28, 2024 at 4:56 PM Anton Okolnychyi > wrote: > >> +1 (binding) >> >> Thanks, Micah! >> >> ср, 28 серп. 2024 р. о 16:36 Dmitri Bourlatchkov >> пише: >> >>> +1 (nb) >>> >>> Cheers, >>> Dmitri.

Re: [VOTE] Merge guidelines for committing PRs

+1 (binding) Yufei On Wed, Aug 28, 2024 at 4:56 PM Anton Okolnychyi wrote: > +1 (binding) > > Thanks, Micah! > > ср, 28 серп. 2024 р. о 16:36 Dmitri Bourlatchkov > пише: > >> +1 (nb) >> >> Cheers, >> Dmitri. >> >> On Wed, Aug 28, 2024 at 12:29 PM Micah Kornfield >> wrote: >> >>> I propose to

Re: [VOTE] Merge guidelines for committing PRs

+1 (binding) Thanks, Micah! ср, 28 серп. 2024 р. о 16:36 Dmitri Bourlatchkov пише: > +1 (nb) > > Cheers, > Dmitri. > > On Wed, Aug 28, 2024 at 12:29 PM Micah Kornfield > wrote: > >> I propose to merge https://github.com/apache/iceberg/pull/10780 as a >> starting place for describing community

Re: [VOTE] Merge guidelines for committing PRs

+1 (nb) Cheers, Dmitri. On Wed, Aug 28, 2024 at 12:29 PM Micah Kornfield wrote: > I propose to merge https://github.com/apache/iceberg/pull/10780 as a > starting place for describing community norms around merging/discussing PRs. > > We've discussed this [1] and gone through a bunch of revision

Re: [DISCUSS] Row Lineage Proposal

I went through the proposal and left comments as well. Thanks for working on it, Russell! I don't see a good solution to how row lineage can work with equality deletes. If so, I would be in favor of not allowing equality deletes at all if row lineage is enabled as opposed to treating all added dat

Re: Request to Add RisingWave to Apache Iceberg Documentation

Hi Alice, Thanks for reaching out. I'm OK with adding related docs. Can you file a PR, so that the community can take a look with more details, or suggest anything based on it. Yufei On Wed, Aug 28, 2024 at 2:05 PM timog...@proton.me.INVALID wrote: > I think they must have meant that RisingWa

Re: Request to Add RisingWave to Apache Iceberg Documentation

I think they must have meant that RisingWave has an Apache 2.0 license. :) I also was taken aback by that. "I didn't know RisingWave was an Apache project..." On Wednesday, August 28th, 2024 at 3:23 PM, Piotr Findeisen wrote: > Hi Alice, > > Thank you for your message and awesome to learn abo

Re: Request to Add RisingWave to Apache Iceberg Documentation

Hi Alice, Thank you for your message and awesome to learn about RisingWave project. Also, congratulations on your Series A funding! I’m reaching out on behalf of the Apache RisingWave team. RisingWave is an > Apache open-source project dedicated to real-time stream processing regarding the "Ap

Re: [DISCUSS] Variant Spec Location

> I think Parquet is a better place for the variant spec than Arrow. Parquet is upstream of nearly every project (other than ORC) log4j is that -but it doesn't mean that it is the right place. What is key is: what does it mean for parquet to have a variant type in there? Does it actually make se

Re: [DISCUSS] Row Lineage Proposal

Sounds good to me. Thanks for pushing this forward, Russell! On Tue, Aug 27, 2024 at 7:17 PM Russell Spitzer wrote: > I think folks have had a lot of good comments and since there haven't been > a lot of strong opinions I'm going to try to take what I think are the > least interesting options an

Request to Add RisingWave to Apache Iceberg Documentation

Dear Apache Iceberg Community, I hope this message finds you well. My name is Alice, and I’m reaching out on behalf of the Apache RisingWave team. RisingWave is an Apache open-source project dedicated to real-time stream processing, and we have invested significantly in integrating with Apache

Re: [DISCUSS] Variant Spec Location

As the discussions in the Spark community ( https://lists.apache.org/thread/0k5oj3mn0049fcxoxm3gx3d7r28gw4rj) and in the Parquet community ( https://lists.apache.org/thread/6h58hj39lhqtcyd2hlsyvqm4lzdh4b9z) continue to decide the spec location, I would like to discuss some of the implementation de

Re: [VOTE] Merge guidelines for committing PRs

+1 (non-binding) On Wed, Aug 28, 2024 at 9:36 AM Steven Wu wrote: > +1 (binding) > > On Wed, Aug 28, 2024 at 9:29 AM Micah Kornfield > wrote: > >> I propose to merge https://github.com/apache/iceberg/pull/10780 as a >> starting place for describing community norms around merging/discussing PRs.

Re: [ANNOUNCE] Apache Iceberg release 1.6.1

Thanks! John Zhuge On Wed, Aug 28, 2024 at 9:37 AM Steven Wu wrote: > Thanks Carl for driving this release! > > On Wed, Aug 28, 2024 at 8:34 AM Carl Steinbach wrote: > >> I'm pleased to announce the release of Apache Iceberg 1.6.1! >> >> Apache Iceberg is an open table format for huge analyti

Re: [ANNOUNCE] Apache Iceberg release 1.6.1

Thanks Carl for driving this release! On Wed, Aug 28, 2024 at 8:34 AM Carl Steinbach wrote: > I'm pleased to announce the release of Apache Iceberg 1.6.1! > > Apache Iceberg is an open table format for huge analytic datasets. Iceberg > delivers high query performance for tables with tens of peta

Re: [VOTE] Merge guidelines for committing PRs

+1 (binding) On Wed, Aug 28, 2024 at 9:29 AM Micah Kornfield wrote: > I propose to merge https://github.com/apache/iceberg/pull/10780 as a > starting place for describing community norms around merging/discussing PRs. > > We've discussed this [1] and gone through a bunch of revisions on the PR >

[VOTE] Merge guidelines for committing PRs

I propose to merge https://github.com/apache/iceberg/pull/10780 as a starting place for describing community norms around merging/discussing PRs. We've discussed this [1] and gone through a bunch of revisions on the PR to what is a minimal starting point for describing the merge process. The vote

Re: [DISCUSS] Guidelines for committing PRs

I think I've resolve remaining concerns. I will start a VOTE thread on merging in a little bit. On Mon, Aug 19, 2024 at 4:30 PM Anton Okolnychyi wrote: > The current state of the PR looks good to me. I feel it is a good starting > point that we will update over time. > > - Anton > > пт, 16 серп

Re: [DISCUSS] Drop Hive 2 support

Hi Anton, The goal is to drop Hive 2 dependencies across all modules. Manu On Wed, Aug 28, 2024 at 4:47 AM Anton Okolnychyi wrote: > Is the goal to get rid of the Hive 2 connector that currently lives in > Iceberg or any dependency on Hive 2 across all modules? > > - Anton > > вт, 27 серп. 202

[ANNOUNCE] Apache Iceberg release 1.6.1

I'm pleased to announce the release of Apache Iceberg 1.6.1! Apache Iceberg is an open table format for huge analytic datasets. Iceberg delivers high query performance for tables with tens of petabytes of data, along with atomic commits, concurrent writes, and SQL-compatible table evolution. This

Re: [VOTE] Merge REST Spec change to add RemovePartitionSpecsUpdate update type

+1 (binding) On Tue, Aug 27, 2024 at 5:21 AM roryqi wrote: > +1 > > Manu Zhang 于2024年8月27日周二 11:44写道： > >> +1 (non-binding) >> >> On Tue, Aug 27, 2024 at 11:00 AM xianjin wrote: >> >>> +1 (non-binding) >>> Sent from my iPhone >>> >>> On Aug 27, 2024, at 4:22 AM, Fokko Driesprong wrote: >>> >>

Re: [DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

Thanks for driving this Sung, this is very exciting! 1. The transforms are a good first thing to address. 2. I agree with Xuanwo, that for flexibility we can decouple them. 3. Automation is probably easier than doing it manually (otherwise we would have to document the steps). Kind regards, Fokko