Re: Iceberg Help

Hi Sun, Thanks for reaching out. It looks like you're Hive metastore is not running or is not reachable. The Hive metastore acts as a catalog to keep track of all the tables that you've created. You can spin up a metastore using docker . It is rec

Re: [VOTE] Release Apache Iceberg 1.2.0 RC1

+1 (non-binding) * Validated signature and checksum * Ran license check * Built using Java 8 * Checked using the docker-spark-iceberg setup, and all the example notebooks ran fine . Cheers, Fokko Op za 18 mrt 2023 om 21:09 schreef Rya

Re: C++/Rust SDK sync

Hi Jan, Thanks for raising this, and I'd love to join the sync. I did quite a bit of work on the Python implementation, and I'm happy to help with the Rust/C++ SDK as well. I'm neither a Rust nor C++ programmer (did some C++ in the past), but happy to help with the implementation by providing cont

Re: [DISCUSS] Dropping Spark 2.4 support

Thanks all for the response, much appreciated. That said, I'd love to hear from more people on this. I think it would be > great to drop support, but I don't know how many people still use it. Is > upgrading Hadoop a good reason to drop support for an engine? Hadoop seems > like a minor concern to

Re: Java 1.3.0 around mid May?

Hey Anton, I think that's a great idea. Would be great to get Spark 3.4 and Flink 1.7 support out. I saw some questions on the Apache Slack today and also noticed that Spark supports timestamps without timezone from Spark 3.4 onward and went ahead and created an issue for that

Re: [VOTE] Release PyIceberg 0.4.0 RC1

Thank you Dan, great catch! I've pinned the version of pyparsing. It looks like it switched to non-greedy matching. The first commit updates the tests, which exposes the issue, and the second commit locks pyparsing to <3.1.0. It looks like the pyparsin

Re: [VOTE] Release PyIceberg 0.4.0 RC2

Sorry about that. Looks like I didn't properly clean up my dist/ folder. I've updated the SVN location. I'll update the how-to-release guide to make sure that this won't happen again. Kind regards, Fokko Op di 27 jun 2023 om 23:04 schreef Ryan Blue : > Any idea why there are rc1 artifacts here?

Re: [VOTE] Release Apache PyIceberg 0.5.0

Hey everyone, After an issue on Github , I noticed a bug in PyIceberg that the filesystem isn't being reused . I think there is more room for improvement (both in the long and short term), but I don't think

Re: [VOTE] Release Apache Iceberg 1.4.0 RC2

+1 (binding) Thanks Anton for running the release, and everyone for contributing! - Ran license checks - Validated signature and checksum - Ran notebooks against 1.4.0 with iceberg-aws-bundle - Tested against Trino

Re: [PROPOSAL] Apache Iceberg 1.4.3 release

Hey JB, Late to the party here, but 1.4.3 sounds like a great idea. Let me know if you need any help with any release steps. Kind regards, Fokko Driesprong Op ma 20 nov 2023 om 08:16 schreef Jean-Baptiste Onofré : > Hi > > As there's no objection, I will move forward and prepare the release to

Re: [PROPOSAL] Apache Iceberg 1.4.3 release

I took the liberty and created a 1.4.3 milestone <https://github.com/apache/iceberg/milestone/43> to track any issues that we want to backport. Kind regards, Fokko Driesprong Op ma 20 nov 2023 om 08:50 schreef Driesprong, Fokko : > Hey JB, > > Late to the party here, but 1.4.

Re: Apache Iceberg Slack Invitation Required

Hey Trilok, Thanks for reaching out. I'll make sure to update the Slack URL. Can you check using: https://join.slack.com/t/apache-iceberg/shared_invite/zt-27f22riz7-o8nCsl5Vbc_2h6~3DF6qlw Kind regards, F

Re: [VOTE] Release Apache Iceberg 1.4.3 RC0

+1 (Binding) Thanks JB for running this release! - Checked the signature and checksums - Ran the license check - Ran the tests locally - Tested against Trino: https://github.com/trinodb/trino/pull/20207 Kind regards, Fokko Op do 21 dec 2023 om 16:53 schreef Jean-Baptiste Onofré : > Hi Everyone

[ANNOUNCE] Release Apache Iceberg Rust 0.2.0

Hi all, The Apache Iceberg Rust community is pleased to announce that Apache Iceberg Rust 0.2.0 has been released! Iceberg is a data access layer that allows users to easily and efficiently retrieve data from various storage services in a unified way. This first release provides integration with

Re: [VOTE] Fix property names in REST spec for statistics / partition statistics

+1 (binding) Op wo 10 jul 2024 om 07:47 schreef Renjie Liu > +1 (non binding) > > On Wed, Jul 10, 2024 at 1:45 PM Daniel Weeks wrote: > >> +1 (binding) >> >> On Tue, Jul 9, 2024, 8:35 PM Eduard Tudenhöfner >> wrote: >> >>> Hey everyone, >>> >>> I propose to fix the property names in the REST s

Re: [Vote] Deprecate oauth tokens endpoint

+1 (binding) Op wo 10 jul 2024 om 10:14 schreef Jean-Baptiste Onofré : > +1 (non binding) > > NB: a few comments in the PR should be "addressed", but it's OK. > > Regards > JB > > On Mon, Jul 8, 2024 at 6:15 PM Robert Stupp wrote: > > > > Hi Everyone, > > > > I propose that we merge PR to "Depre

Re: [VOTE] Release Apache PyIceberg 0.7.0rc2

Huge thanks Sung for running this, that's a long list of new features. +1 (binding) - Validated signatures/checksums/license - Ran tests locally and identified two minor issues (#979 , #980 )

Re: [DISCUSS] Iceberg 1.6.1 release

Hey Piotr, The Avro release still has to be done. We have 1.12.0 which has been released, but that also drops Java 8 support, so we can't backport it. We still have to run the 1.11.4 Avro release to backport the CVE fix. Kind regards, Fokko Op wo 7

Re: [ANNOUNCE] Release Apache Iceberg Rust v0.3.0

Thanks Xuanwo! This is exciting and a big milestone, thanks everyone for working on this! Kind regards, Fokko Op wo 21 aug 2024 om 07:49 schreef Renjie Liu : > Thanks Xuanwo for driving this release! Thanks to all contributors! > > On Wed, Aug 21, 2024 at 1:06 PM Xuanwo wrote: > >> Hi all, >> >

Re: Welcome new committer and PPMC member Ratandeep Ratti

Well deserved Ratandeep! Cheers, Fokko Op ma 17 feb. 2020 om 20:43 schreef Sud : > Congratulations Ratandeep!! Keep up the good work! > > On Mon, Feb 17, 2020 at 6:26 AM Anjali Norwood > wrote: > >> Congratulations Ratandeep!! >> >> regards. >> Anjali. >> >> On Mon, Feb 17, 2020 at 12:19 AM Man

Re: [DISCUSS] Graduating from the Apache Incubator

+1 I'm excited about Iceberg as well. I see a lot of companies that benefit from from Iceberg, or I'm sure they will in the future. One concern I would be the set of committers: Mentors: * Ryan Blue, 408 commits, rdblue * Julien Le Dem, 1 commit, julienledem * Owen O'Malley, 4

Re: [DISCUSS] Graduating from the Apache Incubator

y also includes not > just our (active!) mentors, but also several other ASF members. And our > contributor base is even more diverse because of the number of people and > companies interested in the project. > > So while I agree that we would ideally have more committers, I think it

Re: [VOTE] Graduate to a top-level project

+1 Op wo 13 mei 2020 om 08:58 schreef jiantao yu > +1 for graduation. > > > 在 2020年5月13日，下午12:50，Jun H. 写道： > > +1 for graduation. > > > On Tue, May 12, 2020 at 9:41 PM 李响 wrote: > > > +1 non-binding. My honor to be a part of this. > > On Wed, May 13, 2020 at 10:16 AM OpenInx wrote: > > > +1

Re: New committer: Shardul Mahadik

Congrats Shardul! Great work! Cheers, Fokko Op do 23 jul. 2020 om 07:46 schreef Miao Wang : > Congratulations! > > Miao > > Sent from my iPhone > > > On Jul 22, 2020, at 8:08 PM, 俊杰陈 wrote: > > > > Congrats! Good job! > > > >> On Thu, Jul 23, 2020 at 11:01 AM Saisai Shao > wrote: > >> > >> Co

Re: implementation in other languages

Hi Casey, 1. Personally I don't know any other implementation than in the repository itself, so JVM and Python. 2. There aren't any limitations. Most of the underlying tech used is compatible with many languages. One thing to keep in mind is that you should be able to read Avro files, which are al

Re: Welcoming Peter Vary as a new committer!

Congratulations! Op ma 25 jan. 2021 om 21:16 schreef Mass Dosage > Nice one, well done Peter! > > On Mon, 25 Jan 2021 at 19:46, Daniel Weeks wrote: > >> Congratulations, Peter! >> >> On Mon, Jan 25, 2021, 11:27 AM Jungtaek Lim >> wrote: >> >>> Congratulations Peter! Well deserved! >>> >>> On T

Re: Welcome Fokko Driesprong as a committer!

Thanks, everyone for the kind words. Honored to be a committer on the Iceberg project and be part of this great community. Looking forward to contributing more in the future! Kind regards, Fokko Op di 23 aug. 2022 om 09:30 schreef Omar Al-Safi : > Congrats! > > On Mon, Aug 22, 2022 at 11:13 PM S

Re: Welcome Yufei Gu as a committer

Awesome! Congrats Yufei! Cheers, Fokko Op vr 26 aug. 2022 om 09:27 schreef Gidon Gershinsky : > Congratulations, Yufei! > > Cheers, Gidon > > > On Fri, Aug 26, 2022 at 7:30 AM Christiano Anderson > wrote: > >> Congrats, Yufei! >> >> >> >> >> --- Original Message --- >> On Friday, August

[VOTE] Release Apache PyIceberg 0.1.0rc1

Hi Everyone, I'm thrilled to propose that we release the following RC as the official Apache PyIceberg 0.1.0 release. The commit ID is 804c93cf1bf5a516556cad4eadbdf31d878069ce This corresponds to the tag: pyiceberg-0.1.0rc1 (3e314eb0a0c6ec7c45490afd1a88c7a2cc985f69) - https://github.com/apac

[VOTE] Release Apache PyIceberg 0.1.0 RC2

Hi Everyone, Thanks everyone for giving it a try and for the feedback. Much appreciated! I'm canceling RC1 because the version of the package itself was tagged with RC1. This doesn't allow us to release the code as is since we would have to remove the RC postfix. Other things to make the release

Re: [VOTE] Release Apache PyIceberg 0.1.0 RC2

poetry.lock file is not excluded if you >create it) >- Ran tests >- Installed the CLI and ran basic commands with a REST metastore > > Issues: > > - pyiceberg.__version__ returns 0.1.0rc2 instead of 0.1.0 > > > On Sat, Sep 24, 2022 at 12:51 PM Driespron

Re: [VOTE] Release Apache PyIceberg 0.1.0 RC2

RC version from what was published > as an RC on PyPI! Since we will publish a final artifact with the right > version and none of the files in the release candidate are affected (it's > correct in the tarball and whl files) then I'll change my vote to +1. > > Ryan > > On Mo

Re: [VOTE] Release Apache Iceberg 1.0.0 RC0

+1 (non-binding) - Ran the license and checksum - Ran test suite of Trino against 1.0.0 and didn't see any issues Cheers, Fokko Op ma 10 okt. 2022 om 08:00 schreef Ajantha Bhat : > +1 (non-binding) > > >- Verified the Spark runtime jar contents. >- Checked license docs, ran RAT checks.

Re: [VOTE] Release Apache Iceberg 1.1.0 RC2

-1 (non-binding) For testing the release I plugged in the latest RC2 in Trino and found out that we have regression: https://github.com/trinodb/trino/pull/15079/files It throws this exception: java.lang.UnsupportedOperationException: hash(value) is not supported on the base Bucket class at o

Re: [VOTE] Release Apache Iceberg 1.1.0 RC2

Hey everyone, Wanted to let you know that I got a working fix for the breaking API: https://github.com/apache/iceberg/pull/6220 Let me know what you think. Kind regards, Fokko Driesprong Op za 19 nov. 2022 om 14:20 schreef leilei hu : > +1(non-binding) > verified(java 8): > > - Create table usi

Re: [VOTE] Release Apache Iceberg 1.1.0 RC2

2 at 3:30 PM Ryan Blue wrote: > >> Thanks, Fokko! I just reviewed the PR and it's almost ready to go. >> >> On Sat, Nov 19, 2022 at 3:01 PM Driesprong, Fokko >> wrote: >> >>> Hey everyone, >>> >>> Wanted to let you know that I got a

Re: [VOTE] Release Apache Iceberg 1.1.0 RC2

Hey everyone, Unfortunately, I caught another issue that introduces regression: https://github.com/apache/iceberg/pull/6242 Once that's in, we can cut another RC. Kind regards, Fokko Driesprong Op ma 21 nov. 2022 om 11:31 schreef Gabor Kaszab : > Hi Everyone, > > I propose that we release the f

Re: [VOTE] Release Apache Iceberg 1.1.0 RC4

Hey everyone! First of all, happy thanksgiving! +1 (non-binding) It looks good now on the Trino side. Still some tests are failing , but that's explainable. As an example, the following test is still failing: https://github.com/trinodb/trino/blob/ed2f

Re: [VOTE] Release Apache Iceberg 1.1.0 RC4

Hi Piotr, Thanks for asking. It is indeed the creation time as Ajantha already indicated. I released the RC4 artifact as the final version earlier today after Gabor concluded the vote. The tag and release are published on Github, a

Re: [VOTE] Release Apache PyIceberg 0.2.0

Hey Jun, Ryan, Thanks Jun for sending out the first RC, and thanks Ryan for giving it a try right away. * RAT checks were difficult to read and included the downloaded RAT Jar > file (we should use the Iceberg script) Created a PR: https://github.com/apache/iceberg/pull/6348 * pip install faile

Re: In Remembrance of Kyle

Sad to hear this awful news. I remember Kyle as someone that always took the time to help everyone out. I've learned a lot from him, and it was a privilege to work with him. Each time I work on the open-api spec, he puts a smile on my face.

Re: [VOTE] Release Apache PyIceberg 0.2.0

+1 (non-binding) Checked the signatures, checksums, and licenses. Ran a couple of scans which worked fine. The test_missing_uri test failing is likely as Ryan mentioned, it picks up your local config file. I run the tests using a fresh docker container, but would be nice to isolate this in the fu

[VOTE] Release Apache PyIceberg 0.2.1

Hi Everyone, First of all, I hope y'all had a great Christmas! Last week we fixed an issue in PyIceberg that breaks filtering (and partitioning) on date fields. As discussed in the Iceberg sync, I prop

Re: [VOTE] Release Apache PyIceberg 0.2.1

Hey everyone! First of all, happy new year! Best wishes for 2023 to you and your family. Just a gentle reminder to see if can release this RC to fix some critical bugs in 0.2.0. Thanks! Fokko Driesprong Op di 27 dec. 2022 om 09:17 schreef Driesprong, Fokko : > Hi Everyone, > > >

Re: [VOTE] Release Apache PyIceberg 0.2.1

led during 'make install' and tests failed > - tests fail if you have a ~/.pyiceberg.yaml configuration (we should > probably fix this, but is not a blocker) > > -Dan > > On Mon, Jan 2, 2023 at 12:22 AM Driesprong, Fokko > wrote: > >> Hey everyone! >>

Re: [VOTE] Release Apache PyIceberg 0.2.1

>> >>> +1 (binding) >>> >>> Verified: >>> - sigs/sums/license/tests >>> - removal of hard dependency on pyarrow >>> >>> I don't believe the following should block this release unless they were >>> introduced in this

[ANNOUNCE] Apache PyIceberg release 0.2.1

I'm pleased to announce the release of Apache PyIceberg 0.2.1! Apache Iceberg is an open table format for huge analytic datasets. Iceberg delivers high query performance for tables with tens of petabytes of data, along with atomic commits, concurrent writes, and SQL-compatible table evolution. Th

[VOTE] Release Apache PyIceberg 0.3.0

Hi Everyone, I propose that we release the following RC as the official PyIceberg 0.3.0 release. The commit ID is 2671621565cde8adda27b81d1699663f71d9b3d4 * This corresponds to the tag: pyiceberg-0.3.0rc1 (cf941fe6ae30fbfe98235d3799448cb9f717e1e6) * https://github.com/apache/iceberg/releases

Re: [VOTE] Release Apache PyIceberg 0.3.0

eberg-0.3.0/tests/test_transforms.py:423: > PytestCollectionWarning: cannot collect test class 'TestType' because it > has a __init__ constructor (from: tests/test_transforms.py) > class TestType(IcebergBaseModel): > > -- Docs: https://docs.pytest.org/en/stable/how

Re: [VOTE] Release Apache PyIceberg 0.3.0

> is what you had in mind. > > > > Thanks, > > > > Amogh Jahagirdar > > > > *From: *"Driesprong, Fokko" > *Reply-To: *"dev@iceberg.apache.org" > *Date: *Sunday, January 29, 2023 at 10:19 PM > *To: *"dev@iceberg.apache.org&quo

Re: [VOTE] Release Apache PyIceberg 0.3.0

, Fokko Op ma 30 jan. 2023 om 15:05 schreef Driesprong, Fokko : > Perfect, and I agree that a branch is a great idea. There is some work on > the current master branch that needs a bit more testing before releasing > that to the public. I've created a branch called pyiceberg-0.

Re: [VOTE] Release Apache PyIceberg 0.3.0

/6704 > > PR against the master branch: https://github.com/apache/iceberg/pull/6705 > > > > Thanks, > > > > Amogh Jahagirdar > > > > *From: *"Driesprong, Fokko" > *Reply-To: *"dev@iceberg.apache.org" > *Date: *Monday, January 30, 20

[VOTE] Release Apache PyIceberg 0.3.0

Hi Everyone, I propose that we release the following RC as the official PyIceberg 0.3.0 release. This RC ships the fixes to run the tests locally, and fixes the warning when running the test. Ran the tests from the tar and I can confirm that it is working. Please consider this my +1 (non-binding)

Re: [VOTE] Release Apache PyIceberg 0.3.0

ease this as PyIceberg 0.3.0 >>>>> >>>>> Verified signatures, checksums, RAT checks. Ran the unit and >>>>> integration tests as per https://py.iceberg.apache.org/verify-release/ >>>>> >>>>> >>>>> Regards, >>>>

[ANNOUNCE] Apache PyIceberg release 0.3.0

Hi there, I'm pleased to announce the release of Apache PyIceberg 0.3.0! Apache Iceberg is an open table format for huge analytic datasets. Iceberg delivers high query performance for tables with tens of petabytes of data, along with atomic commits, concurrent writes, and SQL-compatible table evo

[DISCUSS] Removing python_legacy from the repo

Hi all, I'd want to discuss removing the python_legacy codebase from the repository. I think we've reached the point where the new library has feature parity with the legacy one, so I think that this would be a good time to remove the legacy one. The main reason for me is to avoid confusion for ne

Re: [DISCUSS] Removing python_legacy from the repo

Zhang >>> >>> >>> >>> On Feb 17, 2023, at 8:29 AM, Ryan Blue wrote: >>> >>> +1 for removing it. And it's great to see the new one reaching feature >>> parity! >>> >>> On Fri, Feb 17, 2023 at 1:37 AM Driespro

Re: [VOTE] Release Apache Iceberg 1.6.1 RC1

It was not correctly backported, I do think we want to add this since it fixes a CVE as mentioned earlier. I've created a PR: https://github.com/apache/iceberg/pull/10988 Kind regards, Fokko Op do 22 aug 2024 om 11:35 schreef Jean-Baptiste Onofré : > Hi guys, > > FYI, the reason I mentioned ORC

Re: [DISCUSS] PyIceberg 0.8.1 release

Thanks Kevin for cleaning that up, and generating the nice overview. I have another candidate PR for 0.8.1: https://github.com/apache/iceberg-python/pull/1383 Kind regards, Fokko Op ma 25 nov 2024 om 18:41 schreef Kevin Liu : > Hey folks, > > I started working on the 0.8.1 release, using the up

Re: [VOTE] Release Apache Iceberg 1.7.1 RC1

Hey Bryan, Thanks for running the release! +1 binding from my end. Checked signature and checksum, ran license checks, and built against JDK17. Kind regards, Fokko Op di 3 dec 2024 om 03:16 schreef Bryan Keller : > The 1.7.1 RC1 release is still up for a vote! The PR merged was to fix the > re

[DISCUSS] Simplify multi-arg table metadata

Hi everyone, While I was looking to add the V3 partition-spec (de/en)coder to PyIceberg, I noticed that it allows for backporting the multi-arg transforms to V1 and V2 tables as well. I think it would be good to avoid doing this and keep it simple by only allowing this with V3 tables. I've raised

[VOTE] Simplify multi-arg table metadata

Hey everyone, After the positive responses on the devlist , I would like to raise a vote to simplify the multi-argument transforms metadata, and make it exclusve A vote to simplify the

Re: [DISCUSS] PyIceberg 0.9.0 release

Hey everyone, Thanks everyone for being on top of 0.9.0. I've done some testing and found a few more small improvements that would be great to get into 0.9.0. Kind regards, Fokko Op do 20 feb 2

Re: [VOTE] Release Apache Iceberg 1.8.1 RC1

+1 (binding) - Checked signatures and checksum - Checked licenses - Spotchecked NOTICE/LICENSE Kind regards, Fokko Op di 25 feb 2025 om 16:56 schreef Kevin Liu : > +1 (non-binding) > > I followed "How to Verify a Release" >