Thanks for starting this thread!
Along with the 2 issues listed above, I propose this issue as well
* Ignore tables with missing table_type parameter in HMS and Glue (#1331
<https://github.com/apache/iceberg-python/issues/1331>)
Best,
Kevin Liu
On Thu, Nov 21, 2024 at 5:18 AM Jean-Ba
Thanks for adding that PR to the patch release! This should only affect
the release script, and only this once :).
I see that the documentation site has already been updated.
https://iceberg.apache.org/how-to-release/#setup
Best,
Kevin Liu
On Fri, Nov 22, 2024 at 6:36 AM Bryan Keller wrote
yone’s thoughts on this!
Best regards,
Kevin Liu
On Fri, Nov 22, 2024 at 6:06 AM Jean-Baptiste Onofré
wrote:
> Hi folks,
>
> I created the iceberg repo on DockerHub (in the Apache org):
>
> https://hub.docker.com/r/apache/iceberg
>
> I created an "Iceberg team" on Do
he artifacts. I can generate a new PyPI token using
my own PyPI account, or we could request one from ASF Infra.
Thanks again for your help!
Best,
Kevin Liu
[1] https://reproducible-builds.org/
[2] https://github.com/wimglenn/setuptools-reproducible
On Tue, Dec 3, 2024 at 1:31 AM Fokko Driesprong
conflicting port, I was able to successfully build
and run the tests using Java 21.
Best,
Kevin Liu
[1]
https://github.com/apache/iceberg/blob/6501d29b2d46c8d57f46ad646e2daf7d8865f646/kafka-connect/kafka-connect-runtime/docker/docker-compose.yml#L29-L49
On Tue, Dec 3, 2024 at 4:31 PM Yufei Gu wrote
tainerLaunchException: Container startup
failed for image docker:24.0.2
```
and I double-checked that `docker` is indeed running on my laptop.
Best,
Kevin Liu
On Tue, Dec 3, 2024 at 7:31 AM Jean-Baptiste Onofré wrote:
> +1 (non binding)
>
> Regards
> JB
>
> On Thu, Nov 2
table
evolution.
This Python release can be downloaded from:
https://pypi.org/project/pyiceberg/0.8.1/
Thanks to everyone for contributing!
Best,
Kevin Liu
Hi Honah and Eduard,
Following up on the test failures you both encountered, I opened
apache/iceberg-python
issues #1409 <https://github.com/apache/iceberg-python/issues/1409> to
track this.
Thanks for taking the time to verify the release!
Best,
Kevin Liu
On Fri, Dec 6, 2024 at 9:41 AM
out
once all artifacts are published.
Best,
Kevin liu
On Fri, Dec 6, 2024 at 7:49 AM Eduard Tudenhöfner
wrote:
> +1 (binding) but I've also had the same tests fail that Honah mentioned
> earlier (which are due to deprecated dependencies)
>
> On Wed, Dec 4, 2024 at 3:52 A
+1 non-binding
Third time's the charm! :)
On Wed, Jan 22, 2025 at 4:44 AM Jean-Baptiste Onofré
wrote:
> +1 (non binding)
>
> Regards
> JB
>
> On Tue, Jan 21, 2025 at 9:19 PM Honah J. wrote:
> >
> > Hi everyone,
> >
> > In the last VOTE thread on documenting snapshot summary optional fields,
>
use of the `py-` prefix for
Python-specific configurations and extending this naming scheme to other
languages, such as Rust, Go, and C++. This would create a consistent,
predictable pattern for language-specific configuration parameters across
the project.
Looking forward to hearing your thoughts!
Best,
Kevin Liu
+1 (non-binding)
Thanks Christian!
I also created an issue to track the deprecation for the pyiceberg side
https://github.com/apache/iceberg-python/issues/1556
Best,
Kevin Liu
On Tue, Jan 21, 2025 at 8:39 AM Eduard Tudenhöfner
wrote:
> +1
>
> On Tue, Jan 21, 2025 at 5:34 PM M
+1 (non-binding)
Thanks Dan! I double-checked that it aligns with V3 default value as
described by the spec, https://iceberg.apache.org/spec/#default-values
Best,
Kevin Liu
On Fri, Jan 24, 2025 at 8:14 AM Daniel Weeks wrote:
> Everyone,
>
> I'd like to hold a quick vote for a
e
and SF/Bay Area events.
Call to Action
I’d love to hear your thoughts and feedback on this proposal. If you’re
interested in starting a local event, please post on the dev list or reach
out to me directly.
Best,
Kevin Liu
is up.
Best,
Kevin Liu
On Fri, Jan 24, 2025 at 5:10 PM Yuya Ebihara wrote:
> Hi Kevin,
>
> I believe such a section is beneficial. I started planning a local event
> in Japan recently, but the recommended actions were unclear even though I
> read https://iceberg.apache.org/community/#
nds$3(TestHadoopCommits.java:455)
```
Best,
Kevin Liu
On Tue, Jan 28, 2025 at 10:40 AM Jean-Baptiste Onofré
wrote:
> Just to be clear: we are working on new changes on NOTICE/LICENSE that
> would be great to include in 1.7.x.
>
> See https://github.com/apache/polaris/pull/903
>
>
for that?
Best,
Kevin Liu
On Wed, Jan 29, 2025 at 1:56 AM Jean-Baptiste Onofré
wrote:
> Hi folks,
>
> I'm very happy to share that the registration for the Iceberg Summit
> 2025 is officially live!
>
> https://www.icebergsummit2025.com/
>
> We are looking forward t
Thanks for driving the release Sung! Excited to see the new rust library
release and the new pyiceberg_core
<https://pypi.org/project/pyiceberg-core/> python library powered by rust :)
Happy holidays!
Best,
Kevin Liu
On Mon, Dec 23, 2024 at 9:56 PM Renjie Liu wrote:
> Thanks for dri
Thanks for driving this Renjie! The new page looks great and we'll refine
it more over time :)
Happy holidays!
Best,
Kevin Liu
On Mon, Dec 23, 2024 at 7:52 PM Manu Zhang wrote:
> Thanks Renjie for landing the page and others for the review!
>
> M
apache/iceberg-rust/blob/main/CONTRIBUTING.md#install-docker-or-podman
and apache/iceberg-rust/#748
<https://github.com/apache/iceberg-rust/pull/748>
Best,
Kevin Liu
On Mon, Dec 23, 2024 at 1:41 PM Christian Thiel
wrote:
> +1 non-binding
>
> [x] Download links are valid.
> [x] Checks
+1 non-binding.
Already +1 and reviewed the PR. Thanks for adding this! It's very useful as
a reference.
Best,
Kevin Liu
On Tue, Jan 14, 2025 at 12:05 PM Russell Spitzer
wrote:
> +1
>
> On Tue, Jan 14, 2025 at 2:00 PM Honah J. wrote:
>
>> Hi everyone,
>>
>
r `iceberg-python` and possibly
for `iceberg-go` as well.
Best,
Kevin Liu
On Mon, Jan 13, 2025 at 9:03 PM Honah J. wrote:
> Hi everyone,
>
> +1
>
> I remember that I manually copy-pasting PR descriptions into merge commit
> messages multiple times. PRs often accumulate numer
mple/ pyiceberg --pre
```
A big thank you to Fokko for reviewing the changes and helping to set up
the infra.
Cheers,
Kevin Liu
On Wed, Dec 4, 2024 at 12:35 AM Fokko Driesprong wrote:
> Hey Kevin,
>
> I agree with your reasoning. Having reproducible builds would be nice, but
> it does
ou're
interested, you can submit a proposal through the Call for Proposals (CFP)
link on the Luma page.
Looking forward to seeing you there! Talks from both events will also be
uploaded to the YouTube channel afterward:
https://www.youtube.com/@IcebergMeetup.
Best,
Kevin Liu
ssage and
throw an error when the table reference is used.
For the second and third issue, I think we should push back the removal to
the next release since we don't have a good solution yet.
Would love to hear what others think about this approach. Please let us
know if there are any conce
:)
Onwards to 0.9.0 RC!
Best,
Kevin Liu
On Fri, Feb 21, 2025 at 8:13 AM Driesprong, Fokko
wrote:
> Hey everyone,
>
> Thanks everyone for being on top of 0.9.0. I've done some testing and found
> a few more small improvements
> <https://github.com/apache/iceberg-python/pu
th the WARNING log line when
resolving s3 region, #1705
<https://github.com/apache/iceberg-python/issues/1705>.
We have not sent out the email for RC1. I would like to fix this issue
first.
Please let me know what you think!
Best,
Kevin Liu
On Fri, Feb 21, 2025 at 8:51 AM Kevin Liu wro
eral model of Catalog Federation in Apache Polaris - Dennis Huo
* Iceberg + Delta: Collaborating Across Table Formats - Kevin Liu
For SF, we have a diverse batch of topics, including
* Building Iceberg S3Table Support for Daft - Conner Howell
* The State of Iceberg Catalogs - Arsham Eslami
* Securing
ith Python 3.12.8 on M1 and
Orbstack
BTW, email for RC1 was not sent because we found an issue right away. More
details can be found in this devlist thread,
https://lists.apache.org/thread/rr8lcf96jl6079dz6vfkwr5spbvlxzpm
Thanks for driving the release, Drew!
Best,
Kevin Liu
On Mon, Feb 24,
the release manager, Drew! Third time's a charm! :)
Best,
Kevin Liu
On Wed, Feb 26, 2025 at 11:17 AM Drew wrote:
> Hi Everyone,
>
> I propose that we release the following RC as the official PyIceberg 0.9.0
> release.
>
> A summary of the high level features:
will
write to `data//` directory.
I created an issue at https://github.com/apache/iceberg-python/issues/1721
and the fix at https://github.com/apache/iceberg-python/pull/1722
I'll follow up and cut a new RC.
Thanks,
Kevin Liu
On Tue, Feb 25, 2025 at 1:43 PM Fokko Driesprong wrote:
> +1
7;m also continuing to see the flakey test for `iceberg-core`'s
`testConcurrentFastAppends` test. I believe this is a local issue with my
machine.
Thanks for running the release, Eduard!
Best,
Kevin Liu
On Tue, Feb 25, 2025 at 4:23 AM Jean-Baptiste Onofré
wrote:
> +1 (non binding
sion
there or share your thoughts in this thread about the upcoming release.
Best,
Kevin Liu
uidelines>.
In general, the main site is where folks new and old to the project gather.
I'm happy to help drive the effort to make it easier to navigate.
Best,
Kevin Liu
On Mon, Feb 17, 2025 at 1:01 AM Fokko Driesprong wrote:
> I've left some comments on the PR, thanks for clean
/apache/iceberg/pull/2965
Best,
Kevin Liu
On Mon, Feb 17, 2025 at 2:06 PM Yufei Gu wrote:
> +1 to remove them.
> Yufei
>
>
> On Mon, Feb 17, 2025 at 1:26 PM Steve Zhang
> wrote:
>
>> Thanks Fokko for removing deprecated properties!
>>
>> Just want to highl
+1, json with no whitespace sounds like a reasonable default. But if saving
storage space and network is the main goal, then setting
`write.metadata.compression-codec` to `gzip` is way more impactful. Perhaps
this is a good default on the catalog side when creating new metadata json.
Best,
Kevin
hime in here if there are other PRs that
you think should be part of this upcoming release.
Best,
Kevin Liu
On Mon, Feb 17, 2025 at 9:35 AM Drew wrote:
> Hey Kevin,
>
> Thanks for kicking this off. It’s exciting to see how much PyIceberg has
> been evolving! I’d be happy to take on t
Woot! Thanks for running the release, Drew! And thanks for verifying,
everyone. We'll work on getting the final artifact published.
Best,
Kevin Liu
On Mon, Mar 3, 2025 at 1:32 PM Drew wrote:
> Thanks everyone for voting!!
>
> The 72 hours have passed, and a minimum of 3 binding v
Hey Hussein,
Sorry for the delay, I wanted to take some time and add some highlights to
the release note. We'll publish it today :)
Best,
Kevin Liu
On Wed, Mar 5, 2025 at 5:49 AM Hussein Awala wrote:
> Hi Drew,
>
> It seems that the pyiceberg-0.9.0 tag has not been created, nor
Thanks for being the release manager, Drew!
Please check out the 0.9.0 release notes
<https://github.com/apache/iceberg-python/releases/tag/pyiceberg-0.9.0> on
github to see more about this release.
Best,
Kevin Liu
On Thu, Mar 6, 2025 at 9:05 PM Drew wrote:
> I'm pleased t
Amazing! Thanks for putting this together. See you there :)
On Mon, Mar 10, 2025 at 3:17 PM Russell Spitzer
wrote:
> I'm flying in early enough to join as well!
>
> On Mon, Mar 10, 2025 at 4:38 PM Fokko Driesprong wrote:
>
>> Nice, thanks for organizing this Sung, and thanks to Bloomberg for
>>
Great to see this :) Thanks for running the release!
On Fri, Feb 28, 2025 at 12:06 AM Eduard Tudenhöfner <
etudenhoef...@apache.org> wrote:
> I'm pleased to announce the release of Apache Iceberg 1.8.1!
>
> Apache Iceberg is an open table format for huge analytic datasets. Iceberg
> delivers high
eetup
Youtube channel, https://www.youtube.com/@IcebergMeetup
Best,
Kevin Liu
On Tue, Mar 11, 2025 at 2:30 PM Ryan Blue wrote:
> Hi everyone,
>
> It’s time for a board report again. Here’s my current draft. Thanks to Dan
> for helping put it together while I’m unexpectedly out of the
+1 (non-binding)
Verified signature, checksum, and license. Tested against JDK 17
(`17.0.6-zulu`).
Thanks for running the release!
Best,
Kevin Liu
On Wed, Mar 12, 2025 at 5:01 AM Péter Váry
wrote:
> +1
>
> checked the signatures and run some tests
>
> Fokko Driesprong ezt írta
pendix E: Format version
changes" <https://iceberg.apache.org/spec/#version-2>, under the "Reading
v1 metadata for v2" section.
Best,
Kevin Liu
On Mon, Mar 17, 2025 at 7:17 PM Renjie Liu wrote:
> Hi:
>
> We found an inconsistency between java implementation and spec
+1 (non-binding)
Verified signature, checksum, and license. Tested against JDK 17
(`17.0.6-zulu`).
Also ran against pyiceberg's integration tests
<https://github.com/kevinjqliu/iceberg-python/pull/12>.
Thanks for running the release!
Best,
Kevin Liu
On Tue, Mar 18, 2025 at 6:
ple times on the devlist. It's the
general approach the java (reference) implementation has taken. I'm in
favor of following this approach in other implementations. In order to fix
the invalid table metadata, we'd need to be able to read it first.
Best,
Kevin Liu
On Tue, Mar 1
+1 (non-binding)
Ran verification script `dev/release/verify_rc.sh 0.2.0 0`.
Built and tested examples using the CLI.
Best,
Kevin Liu
On Wed, Mar 19, 2025 at 8:55 AM Matt Topol wrote:
> Hi,
>
> I would like to propose the following release candidate (RC0) of
> Apache Iceberg Go ve
101 - 148 of 148 matches
Mail list logo
