Re: [ANNOUNCE] Release Apache Iceberg Rust v0.6.0

2025-07-31 Thread Renjie Liu
Thanks Xuanwo for driving this release, and thanks everyone for the vote and verification! On Thu, Jul 31, 2025 at 3:18 PM Xuanwo wrote: > Hi all, > > The Apache Iceberg Rust community is pleased to announce > that Apache Iceberg Rust v0.6.0 has been released! > > The notable changes since v0.6.

Re: [VOTE] Release Apache Iceberg Rust 0.6.0 RC1

2025-07-24 Thread Renjie Liu
Hi, guys: We still need at least 2 binding votes to pass the release, so please help to verify it! We have achieved some exciting progress, like new tx api, reading with deletions, and hopes this release will help more user to adopt it! On Wed, Jul 23, 2025 at 11:44 AM Renjie Liu wrote: >

Re: [VOTE] Release Apache Iceberg Rust 0.6.0 RC1

2025-07-22 Thread Renjie Liu
+1 (binding) [x] Download links are valid. (there's a typo with "Git tag for the release", I've added a fix) [x] Checksums and signatures. [x] LICENSE/NOTICE files exist [x] No unexpected binary files [] All source files have ASF headers (This is checked in ci) [x] Can compile from source I ran `

Re: [ANNOUNCE] Welcome Prashant Singh as a new Apache Iceberg Committer

2025-07-22 Thread Renjie Liu
Congrats, Prashant! On Wed, Jul 23, 2025 at 11:21 AM Prashant Singh wrote: > Thank you everyone, > > I'm truly grateful to be part of the Apache Iceberg community and excited > to continue contributing alongside you. > > Looking forward to what we’ll build together! > > Best, > Prashant Singh >

Re: [ANNOUNCE] Apache Iceberg release 1.9.2

2025-07-18 Thread Renjie Liu
Thanks Prashant for driving this effort! On Fri, Jul 18, 2025 at 4:28 PM Maximilian Michels wrote: > Thanks Prashant for managing this release! > > -Max > > On Fri, Jul 18, 2025 at 7:42 AM Manu Zhang > wrote: > > > > Thanks Prashant for driving the release. Can you also create a new > release a

Re: [announce] iceberg dev syncs are centralized in the "Iceberg Dev Events" calendar

2025-07-07 Thread Renjie Liu
Thanks Kevin for driving this, rust dev sync has been transferred to dev events. On Thu, Jul 3, 2025 at 1:16 AM Kevin Liu wrote: > Hey everyone, > > As discussed on today's sync, Dan and I helped move all the relevant > Iceberg dev syncs to the "*Iceberg Dev Events*" calendar, which is > located

Re: [DISCUSS] Standardize cross client integration tests

2025-06-10 Thread Renjie Liu
ility to evolve as >the development progresses? > > Will do some experiments with the sqllogictests offline and happy to > discuss more! > > Best, > Leon > > On Mon, Jun 9, 2025 at 2:34 AM Renjie Liu wrote: > > Hi, Leon: > > Thanks for raising this. &g

Re: [DISCUSS] Standardize cross client integration tests

2025-06-09 Thread Renjie Liu
Hi, Leon: Thanks for raising this. In rust we also have similar plan to do integration tests against rust and java implementation: https://github.com/apache/iceberg-rust/pull/581 This approach is pure data driven, as Xuanwo mentioned, motivated by sqllogictests. That's to say, we will define a s

Re: Unofficial iceberg-rust crates on crates.io

2025-06-05 Thread Renjie Liu
Hi: The author JanKaul was an early contributor of iceberg-rust, and for the reasons mentioned in above issues he still keeps maintaining his own repo. We also had a discussion about this problem in slack: https://apache-iceberg.slack.com/archives/C05HTENMJG4/p1720240171913639 , in summary the co

Re: [DISCUSS] June board report

2025-06-05 Thread Renjie Liu
Hi, Ryan: Some updates for rust part: 1. Reading/writing puffin format are both supported in 0.5.1 2. Initial support for name mapping landed On Thu, Jun 5, 2025 at 1:02 PM Russell Spitzer wrote: > Looking good! > > On Wed, Jun 4, 2025 at 4:21 PM Ryan Blue wrote: > >> Hi everyone, >> >> Here’

Re: [ANNOUNCE] Release Apache Iceberg Rust 0.5.1

2025-06-05 Thread Renjie Liu
Thanks Kevin for driving this release! On Thu, Jun 5, 2025 at 1:30 PM Kevin Liu wrote: > Hi all, > > The Apache Iceberg Rust community is pleased to announce that Apache > Iceberg Rust 0.5.1 has been released! This also includes the release of > pyiceberg-core 0.5.1, which is the rust bindings f

Re: [VOTE] Release Apache Iceberg Rust 0.5.1 RC1

2025-05-28 Thread Renjie Liu
y 2025 at 09:18, Xuanwo wrote: >>> >>>> +1 non-binding >>>> >>>> [x] Download links are valid. >>>> [x] Checksums and signatures. >>>> [x] LICENSE/NOTICE files exist >>>> [x] No unexpected binary files >>>> [x

Re: [VOTE] Release Apache Iceberg Rust 0.5.1 RC1

2025-05-26 Thread Renjie Liu
+1 (binding) [x] Download links are valid. [x] Checksums and signatures. [x] LICENSE/NOTICE files exist [x] No unexpected binary files [x] Ran `make check` to verify linter, format [x] Ran `maek test` to verify integration tests Thanks Kevin for driving this! On Tue, May 27, 2025 at 1:16 PM Kevi

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC2

2025-05-26 Thread Renjie Liu
rg.apache.org/how-to-release/#how-to-verify-a-release on how > to verify an RC. > > Thanks everyone! > > On Mon, May 26, 2025 at 9:54 AM Renjie Liu > wrote: > >> +1 binding >> >> [x] Download links are valid. >> [x] Checksums and signatures. >>

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC2

2025-05-26 Thread Renjie Liu
+1 binding [x] Download links are valid. [x] Checksums and signatures. [x] No unexpected binary files [x] Ran `make check` to check formats [x] Ran `make test` to run tests Thanks Kevin! On Sun, May 25, 2025 at 11:58 PM NOTME ZE wrote: > +1 (non-binding) > > [x] Download links are valid. > [x]

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC1

2025-05-21 Thread Renjie Liu
Thanks Fokko for this fix, I've merged this pr. Hi, Kevin: Would you help to create another rc? On Thu, May 22, 2025 at 5:44 AM Fokko Driesprong wrote: > Hey everyone, > > I wanted to check the licenses, so I ran the scripts to generate them > since the DEPENDENCIES.rust.tsv files in the repo

Re: [discuss] Iceberg Rust 0.5.0 Release

2025-05-15 Thread Renjie Liu
Thanks Xuanwo for raising this, I think we have resolved all blockers for 0.5.0 milestone, so it would be a great time to have a release! On Thu, May 15, 2025 at 6:15 PM Fokko Driesprong wrote: > Hey Xuanwo, > > Thanks for raising this, and I agree that it's time for another release. > > I've be

Re: [VOTE] Merge details about GZip metadata files to the spec.

2025-05-13 Thread Renjie Liu
+1 (binding) On Tue, May 13, 2025 at 7:12 AM Brian Hulette wrote: > +1 (non-binding) > > On Mon, May 12, 2025 at 1:25 PM Steven Wu wrote: > >> +1 (binding) >> >> On Mon, May 12, 2025 at 1:10 PM Ryan Blue wrote: >> >>> +1 (binding) >>> >>> On Mon, May 12, 2025 at 10:50 AM Szehon Ho >>> wrote:

Re: [ANNOUNCE] Apache PyIceberg release 0.9.1

2025-05-13 Thread Renjie Liu
Thanks Fokko for running the release! BTW, it would be better to update status page to reflect the latest changes. On Wed, Apr 30, 2025 at 11:45 PM Kevin Liu wrote: > Thanks for running the release, Fokko! It's great to see the number of > fixes in this patc

Re: [ANNOUNCE] Apache Iceberg release 1.9.0

2025-04-28 Thread Renjie Liu
Thanks Ajantha for driving this release! On Mon, Apr 28, 2025 at 9:07 PM Ajantha Bhat wrote: > Hi Manu, versioned site doc and Javadoc update is in progress. > > - Ajantha > > On Mon, Apr 28, 2025 at 6:27 PM Manu Zhang > wrote: > >> Thanks Ajantha for making the release. Have we updated the lat

Re: [VOTE] Simplify multi-argument field-id(s) encoding

2025-04-20 Thread Renjie Liu
+1 (binding) On Sat, Apr 19, 2025 at 8:43 AM Honah J. wrote: > +1 (binding) > > On Fri, Apr 18, 2025 at 17:42 xianjin wrote: > >> +1 (non-binding) >> Sent from my iPhone >> >> On Apr 19, 2025, at 12:19 AM, Steve Zhang >> wrote: >> >> +1 (non-binding) >> >> >> >> Thanks, >> Steve Zhang >> >> >

Re: [DISCUSS] Table Identifiers in Iceberg View Spec

2025-04-20 Thread Renjie Liu
Hi, Walaa: Thanks for the proposal. I've reviewed the doc, but in general I have some concerns with resolving catalog names on the fly with query engine defined catalog names. This introduces some flexibility at first glance, but also makes misconfiguration difficult to explain. But I agree with

Re: [DISCUSS] FileFormat API proposal

2025-04-15 Thread Renjie Liu
nts accordingly. > >> >> I would like to ask you to review the PR, so we iron out any > possible requested changes and be ready for the merge as soon as possible > after the 1.9.0 release. > >> >> > >> >> Thanks, > >> >> Peter > >> >> > &

Re: [ANNOUNCE] Apache Iceberg Go Release v0.2.0

2025-04-04 Thread Renjie Liu
Hi, Matt: Congratulations on the release. Just one reminder to update the the status page , and here is the doc file. On Thu, Mar 27, 2025 at 9:17 PM Craig Russell wrote: > Hi Matt, > > On Mar

Re: [VOTE] Row lineage required for v3

2025-04-04 Thread Renjie Liu
+1 On Tue, Apr 1, 2025 at 10:33 AM Denny Lee wrote: > +1 (non-binding) > > On Mon, Mar 31, 2025 at 7:27 PM roryqi wrote: > >> +1. >> >> Gang Wu 于2025年4月1日周二 09:30写道: >> >>> +1 (non-binding) >>> >>> On Tue, Apr 1, 2025 at 5:15 AM Russell Spitzer < >>> russell.spit...@gmail.com> wrote: >>>

Re: [discuss] iceberg-rust 0.5.0 release

2025-03-31 Thread Renjie Liu
Thanks kevin for raising this, +1 for releasing a new version. We are quite close to finishing the milestone On Sat, Mar 29, 2025 at 1:11 AM Kevin Liu wrote: > > One minor remark, for pyiceberg-core, we've aligned the versions with > Iceberg-R

Re: [DISCUSS] Change iceberg-cpp CI settings to only require approval for new contributors

2025-03-31 Thread Renjie Liu
Thanks Gang for this proposal, +1 for this change. On Mon, Mar 31, 2025 at 4:50 PM Xuanwo wrote: > Here is my +1 non-binding. > > I'm watching on this repo actively and will make sure the CI won't be > abused. > > On Mon, Mar 31, 2025, at 16:38, Gang Wu wrote: > > Hi, > > I am starting this thre

Re: [DISCUSS] Move iceberg-cpp step forward

2025-03-26 Thread Renjie Liu
e, Mar 18, 2025, at 16:56, Fokko Driesprong wrote: >> >> Hi Xuanwo, >> >> Thanks for bringing this up. I'm not a cpp expert, but following this >> with great interest. I think this is a very promising approach since the >> memory model is already the same across

Re: [DISCUSS] FileFormat API proposal

2025-03-21 Thread Renjie Liu
Hi, Peter: Thanks for the effort on this. *1. **File format filters* Do the filters include both filter expressions from both user query and delete filter? For filters from user query, I agree with you that we should keep the current behavior. For delete filters associated with data files, at

Re: [DISCUSS] Inconsistency between java implementation and spec about partition-spec and schema in v1 table

2025-03-19 Thread Renjie Liu
ing a reader imho if it’s primarily to fix >> tables. I think the only thing we really want to avoid is making implicit >> changes to the spec by normalizing completely out of spec metadata. >> >> On Tue, Mar 18, 2025 at 4:46 AM Renjie Liu >> wrote: >> >>&

Re: [VOTE] Minor simplifications for Geo Spec

2025-03-19 Thread Renjie Liu
+1 (binding) On Wed, Mar 19, 2025 at 9:30 AM Gang Wu wrote: > Makes sense. > > +1 (non-binding) > > On Wed, Mar 19, 2025 at 8:07 AM Jia Yu wrote: > >> +1 (non-binding) >> >> Thank you! >> >> On 2025/03/19 00:01:00 Szehon Ho wrote: >> > Hi everyone, >> > >> > While working on the reference imple

Re: [DISCUSS] Inconsistency between java implementation and spec about partition-spec and schema in v1 table

2025-03-18 Thread Renjie Liu
>>> Thanks for raising this! For context, here's the iceberg-rust PR >>> <https://github.com/apache/iceberg-rust/pull/1087> where we found the >>> inconsistency. >>> I am also in favor of approach 2 for backwards compatibility reasons. >>> Per

[DISCUSS] Inconsistency between java implementation and spec about partition-spec and schema in v1 table

2025-03-17 Thread Renjie Liu
Hi: We found an inconsistency between java implementation and spec about partition-spec and schema in v1 table. In spec, it says in v1 table partition-spec and schema are required but deprecated: https://iceberg.apache.org/spec/#table-metadata While in java implementation, they are both optional

Re: [DISCUSS] FileFormat API proposal

2025-03-14 Thread Renjie Liu
Hi, Peter: Sorry for the late reply. I took a review of the code again and left some minor comments. Generally I'm fine with the current approach, looking forward to seeing it moving forward. If we see success in the java library, I'm looking forward to introducing similar things in the iceberg-r

Re: [DISCUSS] March board report

2025-03-12 Thread Renjie Liu
Hi, Ryan: Thanks for driving this, here is the rust implementation updates: 1. Add StrictMetricsEvaluator 2. Add `add_existing_parquet` to `FastAppendAction` 3. Add ViewMetadataBuilder 4. Add puffin file reader On Thu, Mar 13, 2025 at 4:42 AM Kevin Liu wrote: > Hey Ryan, > > Thanks for putting

Re: [DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

2025-02-28 Thread Renjie Liu
Cargo.lock with > dependabot) > - Have a wider range of versions support, to allow users to choose their > dep version (by not updating Cargo.toml too often). Perhaps need to add a > CI to test against oldest version. > > On Thu, Feb 27, 2025 at 2:03 PM Renjie Liu > wrote: >

Re: [ANNOUNCE] Apache Iceberg release 1.8.1

2025-02-28 Thread Renjie Liu
Thanks Eduard’s effort for driving this release! On Sat, Mar 1, 2025 at 00:50 Kevin Liu wrote: > Great to see this :) Thanks for running the release! > > On Fri, Feb 28, 2025 at 12:06 AM Eduard Tudenhöfner < > etudenhoef...@apache.org> wrote: > >> I'm pleased to announce the release of Apache Ic

Re: [DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

2025-02-26 Thread Renjie Liu
fix it. > Alternatively, we may need to migrate to other libraries. > > My point is to let users make this decision themselves. If we now know > iceberg-rust doesn't work with lib A versions lower than 0.1.11. We can set > it to 0.1.11 to prevent users from relying on the outdat

Re: [VOTE] Release Apache Iceberg 1.8.1 RC1

2025-02-24 Thread Renjie Liu
+1 binding. Did following check: 1. Verified sha512 2. Verified signature 3. Run test and build 4. Run dev/check-license On Tue, Feb 25, 2025 at 7:46 AM Yuya Ebihara wrote: > +1 (non-binding) > > I verified that Trino CI is green with Iceberg 1.8.1. > Thanks for your work, Edward. > > BR, > Yuy

Re: [DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

2025-02-24 Thread Renjie Liu
; > - iceberg 0.3 > - lib A 0.1 > - lib A 0.2 > > Which means the two version of lib A can coexists in the same app B. > > However, if iceberg depends on lib A 0.1.10, but app B depends on lib A > 0.1.9, users will finally get: > > - iceberg 0.3 > - lib A 0.1.1

Re: [VOTE] Java implementation notes around current-snapshot-id

2025-02-24 Thread Renjie Liu
+1 On Tue, Feb 25, 2025 at 7:00 AM Szehon Ho wrote: > +1 > > Thanks > Szehon > > On Mon, Feb 24, 2025 at 2:52 PM rdb...@gmail.com wrote: > >> +1 >> >> On Mon, Feb 24, 2025 at 12:26 PM Daniel Weeks wrote: >> >>> +1 >>> >>> On Mon, Feb 24, 2025, 11:00 AM Russell Spitzer < >>> russell.spit...@gma

Re: [DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

2025-02-24 Thread Renjie Liu
cy we want to adopt. (BTW, we've > once also discussed this in avro-rs, and they prefer the first one > https://github.com/apache/avro-rs/issues/4) > Although this is a little off-topic, but it seems similar to the MSRV > problem. Dependency policy may also conflict with MSRV policy

Re: [DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

2025-02-23 Thread Renjie Liu
Hi, xxchan: In fact, datafusion is not a consumer of iceberg-rust, in fact, `datafusion-iceberg` is a consumer of both `iceberg` and `datafusion`, which is maintained in `iceberg-rust` repo, so a more aggressive msrv policy will not break `datafusion-iceberg`. On Sun, Feb 23, 2025 at 8:40 PM xxc

Re: [DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

2025-02-23 Thread Renjie Liu
Hi, I want to explain why we need to upgrade msrv from time to time: 1. Use new(not latest) features in stable rust as rust is still evolving. 2. Use newer versions of iceberg-rust's dependencies, which may include important bug fixes and performance improvements. I've seen dependent bot auto upg

Re: [DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

2025-02-20 Thread Renjie Liu
Personally I prefer a longer gap(like three months) so that we don't need to force users to upgrade to the rust version. But this may not be a big problem in the rust world as rust's release is usually quite stable and backward compatible. On Fri, Feb 21, 2025 at 11:30 AM Renjie Liu wr

[DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

2025-02-20 Thread Renjie Liu
Hi: As discussed in this issue , we have landed support for using unstable rust for tooling, while stable rust for publishing libraries. Also we enforced checking of msrv(minimum supported rust version) in our ci. However, there is one thing undet

Re: [DISCUSS] Introduce C FFI for iceberg rust

2025-02-17 Thread Renjie Liu
Hi: Thanks Xuanwo for raising this. As xuanwo mentioned, rust implementation + c binding will provide a good foundation for cross lang implementation of iceberg spec, including cpp implementation. Looking forward to see more opinions from community! On Tue, Feb 18, 2025 at 2:52 PM Xuanwo wrote

Re: [DISCUSS] FileFormat API proposal

2025-02-14 Thread Renjie Liu
Hi, Peter: Thanks for raising this, and this proposal sounds quite interesting to me. I've reviewed the doc but it still seems too abstract to understand, do you mind to submit a pr so that it would be more clear what's changed? On Wed, Feb 12, 2025 at 12:46 AM Péter Váry wrote: > Hi Team, > >

Re: [VOTE] Add RemoveSchemas update type to REST spec

2025-02-12 Thread Renjie Liu
+1 On Wed, Feb 12, 2025 at 1:40 PM Gang Wu wrote: > +1 (non-binding) > > On Wed, Feb 12, 2025 at 6:17 AM Amogh Jahagirdar <2am...@gmail.com> wrote: > >> +1 thanks for driving this Gabor! >> >> On Wed, Feb 12, 2025 at 2:35 AM rdb...@gmail.com >> wrote: >> >>> +1 >>> >>> On Tue, Feb 11, 2025 at 1

Re: Welcome Huaxin Gao as a committer!

2025-02-06 Thread Renjie Liu
Congratulations! On Thu, Feb 6, 2025 at 7:35 PM Fokko Driesprong wrote: > Congratulations Huaxin! > > Op do 6 feb 2025 om 12:21 schreef Russell Spitzer < > russell.spit...@gmail.com>: > >> Congratulations! >> >> On Thu, Feb 6, 2025 at 11:35 AM Péter Váry >> wrote: >> >>> Congratulations! >>> >>

Re: [VOTE] Update partition stats spec for V3

2025-02-05 Thread Renjie Liu
>Make delete counts required to avoid ambiguity w.r.t NULL vs unknown. Thanks Anton for driving this. Does this mean that we can't upgrade v2 table to v3 table in a lazy approach? That means it's not a mere table metadata upgrade, but we need to upgrade all partition statistics? On Thu, Feb 6, 20

Re: [DISCUSS] Use pr title + pr description as default git commit title + message in iceberg-rust

2025-01-22 Thread Renjie Liu
Hi, everyone: The infra team has enabled this setting, and I've verified them manually. On Wed, Jan 22, 2025 at 10:42 AM Renjie Liu wrote: > Thanks everyone for joining the discussion, I'll submit a jira ticket to > enable it for iceberg-rust, iceberg-cpp, iceberg-go, and pyice

Re: [DISCUSS, VOTE] OpenAPI Metadata Update for EnableRowLineage

2025-01-22 Thread Renjie Liu
+1, thanks Russell for driving this! On Thu, Jan 23, 2025 at 8:12 AM Russell Spitzer wrote: > That was a bit of what we discussed at the sync this morning. Whether we > should have a generic enable feature update for one way features that we > don’t have the ability to disable. We couldn’t come

Re: [DISCUSS] Use pr title + pr description as default git commit title + message in iceberg-rust

2025-01-21 Thread Renjie Liu
t; Regards > Junwang Zhao > > > On Wed, Jan 15, 2025 at 21:16 Renjie Liu wrote: > >> Hi, Raul: >> >> Adding a pull request template sounds like a good idea to me, and I'll >> fire a pr for it. >> >> Hi, Kevin: >> >> I'm happy to

Re: [Discuss][Vote] Spec Change - Add optional field added-rows to Snapshot for Row Lineage

2025-01-15 Thread Renjie Liu
+1 On Thu, Jan 16, 2025 at 2:53 PM huaxin gao wrote: > +1 (non-binding) > > On Wed, Jan 15, 2025 at 10:51 PM Gang Wu wrote: > >> +1 (non-binding) >> >> On Thu, Jan 16, 2025 at 2:30 PM Péter Váry >> wrote: >> >>> +1 >>> >>> Steven Wu ezt írta (időpont: 2025. jan. 16., Cs, >>> 0:46): >>> +

Re: [DISCUSS] Use pr title + pr description as default git commit title + message in iceberg-rust

2025-01-15 Thread Renjie Liu
mmits >>> during reviews, resulting in overly lengthy and less useful commit >>> messages. Using the PR description as the default merge commit message >>> seems like a more helpful and effective approach. >>> >>> Best regards, >>> Honah >>

[DISCUSS] Use pr title + pr description as default git commit title + message in iceberg-rust

2025-01-13 Thread Renjie Liu
Hi, all: I want to propose to change the github option in iceberg-rust to use pr title + pr description as default git commit title and message, and github already has support for this

Re: [DISCUSS] REST Catalog bulk object lookup

2025-01-07 Thread Renjie Liu
Hi, Vladimir: Thanks for raising this. I think your proposal is mixing two things up: 1. Add an endpoint for loading a catalog object by name without knowing its type. This is reasonable to me. 2. Make the endpoint a bulk load operation. I'm hesitating with this option since it makes error handlin

Re: [ANNOUNCE] Release Apache Iceberg Rust v0.4.0

2024-12-23 Thread Renjie Liu
Thanks for driving this release! Have a nice holiday! On Tue, Dec 24, 2024 at 1:31 PM Fokko Driesprong wrote: > Thanks for driving this release, Sung, and thanks to everyone who > contributed! > > Kind regards, > Fokko > > Op di 24 dec 2024 om 05:22 schreef Xuanwo : > >> Thank you for building t

Re: [DISCUSS] Add a implementation status page for iceberg

2024-12-23 Thread Renjie Liu
Hi: Thanks everyone for the review and discussion, we have status page landed: https://iceberg.apache.org/status/ On Fri, Dec 13, 2024 at 11:04 AM Renjie Liu wrote: > Hi: > Sorry for delay, here is the pr: > https://github.com/apache/iceberg/pull/11772 > > The status ma

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

2024-12-21 Thread Renjie Liu
Thanks Sung Yun for driving this release. +1 binding [x] Download links are valid. [x] Checksums and signatures. [x] LICENSE/NOTICE files exist [x] No unexpected binary files [x] All source files have ASF headers [x] Can compile from source Ran `make test` on ubuntu 24.04 + docker. On Fri, Dec

Re: [DISCUSS] Relocate Parquet to Iceberg Core

2024-12-18 Thread Renjie Liu
Hi: > Third, the use case has expanded from stats files to other metadata. I would +1 for this reason to move the parquet module to the core module. But I think the right direction is that we still keep interfaces in the core module so that data file format is pluggable. Moving parquet to core

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC2

2024-12-17 Thread Renjie Liu
+1 binding. Did following verification: [*] Download links are valid. [*] Checksums and signatures. [*] LICENSE/NOTICE files exist [*] No unexpected binary files [*] All source files have ASF headers [*] Can compile from source Running `make test` in following platforms and it works! - macos + m

Re: [DISCUSS] Add a implementation status page for iceberg

2024-12-12 Thread Renjie Liu
the matrix! :) > > Best, > Kevin Liu > > On Wed, Nov 13, 2024 at 10:51 PM Renjie Liu > wrote: > >> Hi: >> >> Thanks for everyone's comments. I think we reached agreement on the >> design, and I'll send a pr for it. >> >> On Tu

Re: [DISCUSS] December board report

2024-12-11 Thread Renjie Liu
For rust, we have added support parquet data file writer, and support for other writers are undergoing. On Thu, Dec 12, 2024 at 9:26 AM Gang Wu wrote: > For C++, I think it is aimed for a full featured C++ library (not for > puffin implementation only). > > On Thu, Dec 12, 2024 at 6:14 AM rdb..

Re: New committer: Matt Topol

2024-12-10 Thread Renjie Liu
Congratulations, Matt! On Wed, Dec 11, 2024 at 9:20 AM Manu Zhang wrote: > Congratulations, Matt! > > Thanks, > Manu > > On Wed, Dec 11, 2024 at 6:16 AM Steve Zhang > wrote: > >> Congrats Matt! >> >> Thanks, >> Steve Zhang >> >> >> >> On Dec 10, 2024, at 7:24 AM, Gang Wu wrote: >> >> Congrats

New committer: Scott Donnelly

2024-12-10 Thread Renjie Liu
Hey everyone, The Project Management Committee (PMC) for Apache Iceberg has invited Scott Donnelly to become a committer. Scott did a lot of impressive work in iceberg-rust, and we are pleased to announce that he has accepted. Please join us in welcoming Scott to hist new role and responsibility

Re: [DISCUSS] Apache Iceberg Summit 2025 - Selection Committee

2024-11-26 Thread Renjie Liu
Hi, JB: Thanks for driving this. Happy to help! On Wed, Nov 27, 2024 at 9:13 AM Bill Zhang wrote: > Hi JB, > > Happy to help. > > Bill > > > On Nov 26, 2024, at 4:42 AM, Jean-Baptiste Onofré > wrote: > > > > Hi everyone, > > > > As you probably know, we've been having discussions about the Ic

Re: [VOTE] Deprecate and remove last-column-id

2024-11-19 Thread Renjie Liu
+1, thanks Fokko! On Wed, Nov 20, 2024 at 8:45 AM Steve Zhang wrote: > +1 nb > > Thanks, > Steve Zhang > > > > On Nov 19, 2024, at 12:18 AM, Fokko Driesprong wrote: > > Hi everyone, > > Based on the positive feedback on the [DISCUSS] thread >

Re: [DISCUSS] Removal of last-column-id of public API

2024-11-18 Thread Renjie Liu
+1 for deprecating and removing this. I don't think it makes sense to ask users to pass this while we can infer it from existing arguments. Also I see java code

Re: [DISCUSS] Add a implementation status page for iceberg

2024-11-13 Thread Renjie Liu
Hi: Thanks for everyone's comments. I think we reached agreement on the design, and I'll send a pr for it. On Tue, Nov 12, 2024 at 1:13 AM Yufei Gu wrote: > LGTM. Thanks Renjie! > Yufei > > > On Mon, Nov 11, 2024 at 5:38 AM Renjie Liu > wrote: > >> Hi: &

Re: [DISCUSS] Duplicate KEYS files

2024-11-11 Thread Renjie Liu
+1 (binding) for merging. On Tue, Nov 12, 2024 at 1:56 AM Kevin Liu wrote: > +1 (non-binding) > Here are some places in the code base we would need to update. > https://grep.app/search?q=dist.apache.org/repos/dist/.%2A/iceberg/KEYS®exp=true > I also double-checked against the "/KEYS" search, see

Re: [DISCUSS] Add a implementation status page for iceberg

2024-11-11 Thread Renjie Liu
s instead > of check marks, but all good :) > > Thanks ! > > Regards > JB > > On Fri, Nov 8, 2024 at 3:33 PM Russell Spitzer > wrote: > > > > Sounds like a great idea to me > > > > On Fri, Nov 8, 2024 at 7:58 AM Renjie Liu > wrote: > >

[DISCUSS] Add a implementation status page for iceberg

2024-11-08 Thread Renjie Liu
Hi: As iceberg evolved to a multi-lang project, I would like to propose to maintain a status page for iceberg. For more details, please refer to this doc . Welcome to join the discussion and comment o

Re: [VOTE] Iceberg Rust Sync Meeting Time

2024-11-08 Thread Renjie Liu
Hi, all: I've create a calendar for this: https://calendar.google.com/calendar/u/0?cid=NzU4MDlhY2YwMTc2NjA2ODQwZjRhZjUxNjk0NjMzNjNlMTFiYzM5NWI3YzI2YmEyZGQxZDRjNjJhZjQyZjFkY0Bncm91cC5jYWxlbmRhci5nb29nbGUuY29t On Fri, Nov 8, 2024 at 5:10 PM Renjie Liu wrote: > Hi: > > Thanks ev

Re: [VOTE] Iceberg Rust Sync Meeting Time

2024-11-08 Thread Renjie Liu
gt;> *Gesendet:* Friday, October 25, 2024 2:13:49 AM >>> *An:* dev@iceberg.apache.org >>> *Betreff:* Re: [VOTE] Iceberg Rust Sync Meeting Time >>> >>> Hi, >>> >>> My time is somewhat flexible from 19:00 to 01:00 at UTC+8, so I'm okay >&g

[VOTE] Iceberg Rust Sync Meeting Time

2024-10-25 Thread Renjie Liu
Hi: Following discussion on this thread , we want to start a vote for Iceberg Rust Sync Meeting Time, and here are the options gathered: 1. From Xuanwo: One week before Iceberg Sync Meeting, From 00:00 to 01:00 GTM+8 2. From Renji

Re: [DISCUSS] Iceberg Rust Sync Meeting

2024-10-24 Thread Renjie Liu
Cool, I'll start a vote later. On Thu, Oct 24, 2024 at 2:48 PM Xuanwo wrote: > Looks good to me. Would you like to start a poll for this? > > On Thu, Oct 24, 2024, at 14:25, Renjie Liu wrote: > > Seems that there is no objection about this meeting, but we have different &g

Re: [DISCUSS] Iceberg Rust Sync Meeting

2024-10-24 Thread Renjie Liu
Seems that there is no objection about this meeting, but we have different options about timing. Should we start a poll for timing? On Fri, Oct 11, 2024 at 11:27 PM Sung Yun wrote: > Thank you for starting this thread Xuanwo, I'm +1 for a Iceberg Rust > meeting. > > Regarding the meeting time, I

Re: [Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

2024-10-16 Thread Renjie Liu
Hi: Here's what I propose as a middle-ground. > >1. We replace the Hadoop catalog example with a JDBC catalog backed by >an in-memory datastore. This allows users to get started without needing >additional infrastructure, which was one of the main benefits of the Hadoop >catalog. >

Re: [Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

2024-10-09 Thread Renjie Liu
I would also vote for jdbc catalog, ideally using sqlite as backend as it doesn't require setting up other databases. On Thu, Oct 10, 2024 at 8:42 AM Manu Zhang wrote: > I'd vote for JDBC catalog as it's simple for a quick-start guide. Setting > up a REST Service with docker image could be cumbe

Re: [DISCUSS] Iceberg Rust Sync Meeting

2024-10-09 Thread Renjie Liu
+1 for sync meeting for iceberg rust. These meetings will not be recorded. I think we have meeting records for catalog meetings and community sync, so we should also record this? For time, I would suggest moving it one hour ahead, e.g. 23:00 to 00:00 GTM+8, so that it's a little more friendly t

Re: [DISCUSS] Additional language implementations for Iceberg Puffin reader/writer

2024-08-29 Thread Renjie Liu
Hi: I think it is reasonable to start a new C++ sub-project even if it will > only contain Puffin writers/readers initially. Are there any alternatives? > We could add a separate repo for Puffin but we previously concluded it is > not a good idea to support multiple languages in one repo. I'm no

Re: [DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

2024-08-29 Thread Renjie Liu
AL <https://github.com/apache/opendal> ? > > OpenDAL tends to release all packages simultaneously but with different > versions. We can try this approach as well. > > It's also fine for me to release pyiceberg_core separately for the first > time. > > On Thu, Aug 2

Re: [VOTE] Merge guidelines for committing PRs

2024-08-28 Thread Renjie Liu
+1 (binding) On Thu, Aug 29, 2024 at 8:59 AM Amogh Jahagirdar <2am...@gmail.com> wrote: > +1 (binding) > > On Wed, Aug 28, 2024 at 6:45 PM Yufei Gu wrote: > >> +1 (binding) >> Yufei >> >> >> On Wed, Aug 28, 2024 at 4:56 PM Anton Okolnychyi >> wrote: >> >>> +1 (binding) >>> >>> Thanks, Micah! >>

Re: [DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

2024-08-28 Thread Renjie Liu
Hi: Thanks Sung for driving this. Which features do we expose in the first release? I think the transformation is a good start. Should the version of the pyiceberg_core python package be aligned with the > version of iceberg-rust crate? Decoupling pyiceberg_core with iceberg-rust may be flex

Re: [ANNOUNCE] Apache Iceberg release 1.6.1

2024-08-28 Thread Renjie Liu
Thanks Carl for driving this release, and everyone for contributing! On Thu, Aug 29, 2024 at 12:40 AM John Zhuge wrote: > Thanks! > > John Zhuge > > > On Wed, Aug 28, 2024 at 9:37 AM Steven Wu wrote: > >> Thanks Carl for driving this release! >> >> On Wed, Aug 28, 2024 at 8:34 AM Carl Steinbach

Re: [VOTE] Release Apache Iceberg 1.6.1 RC2

2024-08-26 Thread Renjie Liu
+1 (binding) - Verified signatures, checksums - Ran `./gradlew build` and all tests passed, jdk 17 On Sun, Aug 25, 2024 at 1:52 AM Fokko Driesprong wrote: > +1 (binding) > > - Verified signatures, checksums and ran the tests locally > > Kind regards, > Fokko > > Op vr 23 aug 2024 om 20:51 schre

Re: [ANNOUNCE] Release Apache Iceberg Rust v0.3.0

2024-08-20 Thread Renjie Liu
Thanks Xuanwo for driving this release! Thanks to all contributors! On Wed, Aug 21, 2024 at 1:06 PM Xuanwo wrote: > Hi all, > > The Apache Iceberg Rust community is pleased to announce > that Apache Iceberg Rust v0.3.0 has been released! > > Iceberg is an open table format for analytic datasets,

Re: [VOTE] Release Apache Iceberg 1.6.1 RC1

2024-08-19 Thread Renjie Liu
Hi, Carl: Thanks for driving this. I tried to run `./gradlew build` and one test failed: > Task :iceberg-core:test TestHadoopCommits > testConcurrentFastAppends(File) FAILED org.awaitility.core.ConditionTimeoutException: Condition with lambda expression in org.apache.iceberg.hadoop.TestHadoo

Re: [VOTE] Release Apache Iceberg Rust 0.3.0 RC1

2024-08-18 Thread Renjie Liu
update the > verify script to run tests by default since I'd imagine most users want to > run tests by default as part of release verification? Do let me know if I'm > missing something. > > Thanks, > Amogh Jahagirdar > > On Sat, Aug 17, 2024 at 7:24 AM Renjie Liu &

Re: [VOTE] Release Apache Iceberg Rust 0.3.0 RC1

2024-08-17 Thread Renjie Liu
Hi: Kindly reminder that we still need 2 binding votes. Please help to verify. On Wed, Aug 14, 2024 at 23:56 Xuanwo wrote: > Hello, Apache Iceberg Rust Community, > > This is a call for a vote to release Apache Iceberg rust version 0.3.0. > > The tag to be voted on is 0.3.0. > > The release can

Re: [DISCUSS] Iceberg-rust based Ruby bindings

2024-08-17 Thread Renjie Liu
ng into limitations when it comes to >>> performance and limited parallelism. >>> >>> Kind regards, >>> Fokko >>> >>> Op ma 5 aug 2024 om 14:14 schreef Xuanwo : >>> >>>> Hi, Chris >>>> >>>> I love t

Re: [VOTE] Release Apache Iceberg Rust 0.3.0 RC1

2024-08-16 Thread Renjie Liu
+1 (binding) [*] Download links are valid. [*] Checksums and signatures Seems we miss how to verify page, and I follow instructions here: https://iceberg.apache.org/how-to-release/#validating-a-source-release-candidate [*] LICENSE/NOTICE files exist [*] No unexpected binary files [ ] All source fi

Re: [VOTE] Merge REST spec clarification on how servers should handle unknown updates/requirements

2024-08-14 Thread Renjie Liu
+1 On Thu, Aug 15, 2024 at 10:10 AM Jack Ye wrote: > +1 > > -Jack > > On Wed, Aug 14, 2024 at 8:39 AM Daniel Weeks wrote: > >> +1 >> >> On Tue, Aug 13, 2024 at 7:34 PM xianjin wrote: >> >>> +1 >>> >>> On Aug 14, 2024, at 2:24 AM, Ryan Blue >>> wrote: >>> >>>  >>> +1 >>> >>> On Tue, Aug 13, 2

Re: [DISCUSS] Start iceberg-rust 0.3.0 release process

2024-08-14 Thread Renjie Liu
Thanks Xuanwo for driving this! I'm ready to help anytime! On Wed, Aug 14, 2024 at 3:09 PM Fokko Driesprong wrote: > Thanks Xuanwo for driving this, very excited to see this happening. Let me > know if there is anything I can help with! > > Kind regards, > Fokko > > Op wo 14 aug 2024 om 08:58 sc

Re: Welcome Péter, Amogh and Eduard to the Apache Iceberg PMC

2024-08-13 Thread Renjie Liu
Congratulations, everyone! On Wed, Aug 14, 2024 at 11:14 AM roryqi wrote: > Congrats! > > Steven Wu 于2024年8月14日周三 11:12写道: > >> Congratulations! >> >> On Tue, Aug 13, 2024 at 7:18 PM Kevin Liu wrote: >> >>> Congratulations all! >>> >>> On Wed, Aug 14, 2024 at 9:38 AM Jun H. wrote: >>> Co

Re: [DISCUSS] How about setup a iceberg meetup in Beijing?

2024-08-11 Thread Renjie Liu
+1 On Sun, Aug 11, 2024 at 16:53 Junwang Zhao wrote: > On Sun, Aug 11, 2024 at 3:59 PM Xiaojing Fang > wrote: > > > > Cool, I’d like to join the meetup. > > > > > 2024年8月11日 13:24,Xuanwo 写道: > > > > > > Hello, everyone > > > > > > I'm starting this thread to discuss the possibility of organizi

Re: [DISCUSS] Iceberg-rust based Ruby bindings

2024-08-06 Thread Renjie Liu
Hi, Chris: Seems duplicated with this thread On Tue, Aug 6, 2024 at 12:54 AM Chris Atkins wrote: > Hi there, > > I'm following up on a discussion > from >

[VOTE] Vote for a logo of iceberg-rust

2024-08-05 Thread Renjie Liu
Hi: Following prior discussions[1, 2], I want to start a vote for the logo of iceberg-rust. I've started a poll on github actions, so that more people could get involved. Prior Discussions 1. https://apache-iceberg.slack.com/archives/C05

  1   2   3   >