Re: [DISCUSS] December board report

Hi Ryan, Thanks for putting this together! For Java/Flink we could mention that ExpireSnapshots TableMaintenance is available now. On Thu, Dec 12, 2024, 04:47 Ajantha Bhat wrote: > At Java side, I would add > > - Core util to compute partition stats has been merged. > https://github.com/apache/i

Re: New committer: Scott Donnelly

Congratulations Scott! huaxin gao 于2024年12月12日周四 06:12写道： > Congratulations Scott! > > On Wed, Dec 11, 2024 at 9:07 AM Steve Zhang > wrote: > >> Congratulations Scott! >> >> Thanks, >> Steve Zhang >> >> >> >> On Dec 11, 2024, at 4:47 AM, Fokko Driesprong wrote: >> >> Congratulations Scott! >>

Re: [DISCUSS] December board report

At Java side, I would add - Core util to compute partition stats has been merged. https://github.com/apache/iceberg/pull/11146 - REST catalog TCK has been merged and docker image is published under ` *apache/iceberg-rest-fixture`*Also, > Spark: Removed Spark 3.3 support We just deprecated it

Re: [DISCUSS] December board report

For rust, we have added support parquet data file writer, and support for other writers are undergoing. On Thu, Dec 12, 2024 at 9:26 AM Gang Wu wrote: > For C++, I think it is aimed for a full featured C++ library (not for > puffin implementation only). > > On Thu, Dec 12, 2024 at 6:14 AM rdb..

Re: [DISCUSS] December board report

For C++, I think it is aimed for a full featured C++ library (not for puffin implementation only). On Thu, Dec 12, 2024 at 6:14 AM rdb...@gmail.com wrote: > I'll update it. Thanks! > > (By the way, the Avro default value support was in the Java section) > > On Wed, Dec 11, 2024 at 2:00 PM Matt T

Re: [DISCUSS] Hive Support

Thanks all for sharing your thoughts. It looks there's a consensus on upgrading to Hive 4 and dropping hive-runtime. I've submitted a PR[1] as the first step. Please help review. 1. https://github.com/apache/iceberg/pull/11750 Thanks, Manu On Thu, Nov 28, 2024 at 11:26 PM Shohei Okumiya wrote:

Re: New committer: Scott Donnelly

Congratulations Scott! On Wed, Dec 11, 2024 at 9:07 AM Steve Zhang wrote: > Congratulations Scott! > > Thanks, > Steve Zhang > > > > On Dec 11, 2024, at 4:47 AM, Fokko Driesprong wrote: > > Congratulations Scott! > > >

Re: [Discuss] Document Snapshot Summary Optional Fields for Standardization

I want to float this back up, I think this is a really good idea for cross engine support. I don't think we have to tie this to any specific Spec version since they are just recommendations so I think we can do this at any time On Wed, Nov 27, 2024 at 1:31 PM Szehon Ho wrote: > This makes sense

Re: [DISCUSS] Spark Catalog - Drop vs Drop with Purge

That plan sounds good to me. Thanks, Russell! On Wed, Dec 11, 2024 at 1:43 PM Yufei Gu wrote: > +1 on adding a flag to support the Spark REST client behavior change > between v1.8 and v2.0. > > At the same time, we may clarify further more on the behavior of DropTable > REST API, > https://githu

Re: [DISCUSS] December board report

I'll update it. Thanks! (By the way, the Avro default value support was in the Java section) On Wed, Dec 11, 2024 at 2:00 PM Matt Topol wrote: > For the Go release, can we please point out that it supports reading the > data too, not just metadata? > > It produces a stream of Arrow record batch

Re: New committer: Matt Topol

Congratulations, Matt! On Tue, Dec 10, 2024 at 11:13 PM Eduard Tudenhöfner < etudenhoef...@apache.org> wrote: > Congrats Matt! > > On Wed, Dec 11, 2024 at 6:41 AM Honah J. wrote: > >> Congratulations, Matt! >> >> On Tue, Dec 10, 2024 at 7:51 PM Fenil Jain wrote: >> >>> Congratulations Matt! >>>

Re: [DISCUSS] December board report

For the Go release, can we please point out that it supports reading the data too, not just metadata? It produces a stream of Arrow record batches. On Wed, Dec 11, 2024, 4:22 PM Walaa Eldin Moustafa wrote: > Hi Ryan, > > For Table Format V3, we could point out that the default value support for

Re: [DISCUSS] Spark Catalog - Drop vs Drop with Purge

+1 on adding a flag to support the Spark REST client behavior change between v1.8 and v2.0. At the same time, we may clarify further more on the behavior of DropTable REST API, https://github.com/apache/iceberg/blob/feed4e2544b5839fbc2fe040965af3906d053302/open-api/rest-catalog-open-api.yaml#L1099

Re: [DISCUSS] December board report

Hi Ryan, For Table Format V3, we could point out that the default value support for Avro has been merged and support for other formats is ongoing. Thanks, Walaa. On Wed, Dec 11, 2024 at 12:51 PM rdb...@gmail.com wrote: > Hi everyone, > > It’s time to report to the board again. Great to see al

Re: Contributor guidelines for becoming a committer

Material contributions that show expertise can easily be documentation or helping answer questions, right? This was one of the intended ways to interpret that point. The same goes for stable and maintainable. Although those are attributes we commonly think about for code, it's important that contr

[DISCUSS] December board report

Hi everyone, It’s time to report to the board again. Great to see all the progress here, and awesome to have our first go release this quarter! My draft is below. Please reply if there’s anything you’d like to add or change. Thanks! Ryan Description: Apache Iceberg is a table format for huge an

Re: Contributor guidelines for becoming a committer

Hi Ryan, Thanks. I think the confusion is about what you describe like "contributions and reviews", reading the page: " .. * Has the candidate made independent material contributions to the community that show expertise? ... * Have the candidate’s contributions been stable and maintainable? ... "

[DISCUSS] Spark Catalog - Drop vs Drop with Purge

Hi Y'all! Today we had a little discussion on the Apache Iceberg Catalog Community Sync about DROP and DROP WITH PURGE. Currently the SparkCatalog implementation inside of the reference library has a unique method of DROP WITH PURGE vs other implementations. The pseudo code is essentially ``` us

Re: Contributor guidelines for becoming a committer

I want to make a clarification. I did comment on that PR that we are describing how the community is operating today, but that was in response to suggestions to reference the comdev project, lower the requirements, and add a requirement for loving the project and helping the community. My intent is

Re: New committer: Scott Donnelly

Congratulations Scott! Thanks, Steve Zhang > On Dec 11, 2024, at 4:47 AM, Fokko Driesprong wrote: > > Congratulations Scott! >

Re: New committer: Scott Donnelly

Congrats! -Bryan > On Dec 11, 2024, at 3:47 AM, Fokko Driesprong wrote: > > Congratulations Scott! > > Kind regards, > Fokko > > Op wo 11 dec 2024 om 11:56 schreef Manu Zhang >: >> Congratulations Scott! >> >> Thanks, >> Manu >> >> On Wed, Dec 11, 2024 at 3:2

Re: New committer: Scott Donnelly

Congratulations Scott! Kind regards, Fokko Op wo 11 dec 2024 om 11:56 schreef Manu Zhang : > Congratulations Scott! > > Thanks, > Manu > > On Wed, Dec 11, 2024 at 3:21 PM Eduard Tudenhöfner < > etudenhoef...@apache.org> wrote: > >> Congrats Scott! >> >> On Wed, Dec 11, 2024 at 7:35 AM roryqi wr

Re: New committer: Scott Donnelly

Congratulations Scott! Thanks, Manu On Wed, Dec 11, 2024 at 3:21 PM Eduard Tudenhöfner wrote: > Congrats Scott! > > On Wed, Dec 11, 2024 at 7:35 AM roryqi wrote: > >> Congrats! >> >> Fenil Jain 于2024年12月11日周三 14:26写道： >> >>> Congratulations Scott! >>> >>> On Wed, Dec 11, 2024 at 8:56 AM Renji

Re: Contributor guidelines for becoming a committer

Hi Justin For reference, here's the original PR: https://github.com/apache/iceberg/pull/11670 I agree with you, and I commented in the PR about the same points: - considering non code contributions (also referring com dev page https://community.apache.org/pmc/adding-committers.html as "example")