Golang iceberg support

2023-07-13 Thread Matt Topol
Hey all! For a while now I've been working on a native Golang Iceberg library, heavily inspired by pyiceberg. I figured it would make sense for it to live in the official iceberg repo, but rather than just filing a huge PR I wanted to ask if there was actually any interest from the community for t

Re: [PROPOSAL] Preparing first Apache Iceberg Summit

2023-08-21 Thread Matt Topol
I don't think I'll have much time to contribute to help, but I would absolutely help if possible. That said, I'll definitely want to give a talk / speak at this summit when it happens :) On Mon, Aug 21, 2023 at 1:38 AM Jean-Baptiste Onofré wrote: > Hi guys, > > I'm back from vacation and I'm re

Re: [DISCUSS] Iceberg community summit

2024-01-16 Thread Matt Topol
I'd also like to help out if possible On Tue, Jan 16, 2024, 8:15 PM Steve Zhang wrote: > I am also happy to contribute here! > > Thanks, > Steve Zhang > > > > On Jan 16, 2024, at 4:17 PM, Bill Zhang > wrote: > > Same here. We'd like to volunteer and help out with this summit. > > On Mon, Jan 15

Re: [Discuss] Change iceberg-python and iceberg-go CI Settings to only require approval for first time contributors

2024-02-01 Thread Matt Topol
+1 (non-binding) On Thu, Feb 1, 2024, 10:48 PM Renjie Liu wrote: > +1 > > On Fri, Feb 2, 2024 at 11:45 AM Jack Ye wrote: > >> +1 >> >> -Jack >> >> On Thu, Feb 1, 2024 at 5:35 PM Honah J. wrote: >> >>> Hello everyone >>> >>> Inspired by our recent discussion regarding iceberg-rust's CI setting,

Re: [ANNOUNCE] Welcoming new committers and PMC members

2024-07-23 Thread Matt Topol
Congrats!! On Tue, Jul 23, 2024, 9:52 AM Xuanwo wrote: > Thank you so much for the recognition! I'm thrilled to join as an Iceberg > Committer. > > I'm currently working hard on the iceberg rust project. If you're > interested in rust, feel free to join us! > > On Tue, Jul 23, 2024, at 21:03, Fo

Re: [DISCUSS] September board report

2024-09-10 Thread Matt Topol
There's one additional point to add for the Go implementation, we implemented file scan planning. It returns the list of file scan tasks needed for a given table, partitions and filter expression. --Matt On Tue, Sep 10, 2024, 5:43 PM rdb...@gmail.com wrote: > Hi everyone, > > It’s time for anot

Re: [Discuss] Iceberg View Interoperability

2024-11-04 Thread Matt Topol
ll/185/files#diff-81cfac9f2e1dcf6265c569d0a3397964f0b78e07f45bb9dcdd3effe0623aaf73 > > That converts an Iceberg expression into a substrate one, pretty exciting > stuff > > Kind regards, > Fokko > > Op ma 4 nov 2024 om 14:03 schreef Jean-Baptiste Onofré : > >> Hi Ajantha, &

Re: [DISCUSS] Duplicate KEYS files

2024-11-11 Thread Matt Topol
+1 (non-binding) for merging, I can update the docs on the iceberg Go release README after it's done! On Mon, Nov 11, 2024, 12:20 PM Yufei Gu wrote: > +1 merging sounds good. It should still work for previous releases. > > Yufei > > > On Mon, Nov 11, 2024 at 7:46 AM Xuanwo wrote: > >> Hi >> >>

[VOTE][Go] Release Apache Iceberg Go v0.1.0 RC0

2024-11-11 Thread Matt Topol
Hi, I would like to propose the following release candidate (RC0) of Apache Iceberg Go version v0.1.0. This release candidate is based on commit: adc8193de3299b04c9763c2fba529a7b94d080ce [1] The source release rc0 is hosted at [2]. Please download, verify checksums and signatures, run the unit

Re: [DISCUSS][Go] First release of iceberg-go

2024-11-08 Thread Matt Topol
:) >> >> Regards >> JB >> >> On Fri, Nov 8, 2024 at 2:14 PM Matt Topol wrote: >> > >> > Hey all, >> > >> > With the merging of basic read support [1] among other features, I >> propose we've hit a minimum threshold that

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC0

2024-11-13 Thread Matt Topol
; The rest looks good: >> - NOTICE is OK >> - hash and signature are OK >> - ASF header present >> >> Regards >> JB >> >> On Mon, Nov 11, 2024 at 11:12 PM Matt Topol >> wrote: >> > >> > Hi, >> > >> > I would like to

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC1

2024-11-13 Thread Matt Topol
Slight fix to the previous email: the text should say "The source release *rc1* is hosted at [2]" The link is correct, it's only the text that needed to be updated. On Wed, Nov 13, 2024 at 11:43 AM Matt Topol wrote: > Hi, > > I would like to propose the following re

[VOTE][Go] Release Apache Iceberg Go v0.1.0 RC1

2024-11-13 Thread Matt Topol
Hi, I would like to propose the following release candidate (RC1) of Apache Iceberg Go version v0.1.0. This release candidate is based on commit: 8ca0bb7bdf7868bac4aca83f50db047d9bf0277c [1] The source release rc0 is hosted at [2]. Please download, verify checksums and signatures, run the unit

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC0

2024-11-12 Thread Matt Topol
ist/release/iceberg/KEYS but not in >>> https://dist.apache.org/repos/dist/dev/iceberg/KEYS which the script >>> uses. >>> >>> After making the change locally, >>> ``` >>> ICEBERG_DIST_BASE_URL=" >>> https://dist.apache.org/r

Re: [DISCUSS] Iceberg Summit 2025 ?

2024-09-28 Thread Matt Topol
+1 from me as well, I would love to attend an in person/hybrid iceberg summit. Workshops seem like a perfect way to help the community. On Sat, Sep 28, 2024, 7:11 PM Honah J. wrote: > +1 on hosting another Iceberg Summit in 2025! We had many great talks last > time, and I think it will be even b

Re: [DISCUSS] Apache Iceberg Summit 2025 - Selection Committee

2024-11-28 Thread Matt Topol
I'm also happy to volunteer in any way I can JB! On Thu, Nov 28, 2024, 10:35 AM Amogh Jahagirdar <2am...@gmail.com> wrote: > Thanks JB, happy to help in any way I can! > > On Thu, Nov 28, 2024 at 12:08 AM Eduard Tudenhöfner < > etudenhoef...@apache.org> wrote: > >> Thanks for organizing this and

[ANNOUNCE] Apache Iceberg Go release v0.1.0

2024-11-18 Thread Matt Topol
Hi everyone, I'm pleased to announce the release of Apache Iceberg Go v0.1.0! Apache Iceberg is an open table format for huge analytic datasets, Iceberg delivers high query performance for tables with tens of petabytes of data, along with atomic commits, concurrent writes, and SQL-compatible tabl

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC2

2024-11-18 Thread Matt Topol
_rc.sh 0.1.0 2 >>>> ``` >>>> >>>> Best, >>>> Kevin Liu >>>> >>>> On Thu, Nov 14, 2024 at 11:45 AM Jean-Baptiste Onofré >>>> wrote: >>>> >>>>> +1 (non binding) >>>>>

[DISCUSS][Go] First release of iceberg-go

2024-11-08 Thread Matt Topol
Hey all, With the merging of basic read support [1] among other features, I propose we've hit a minimum threshold that it makes sense to do a v0.1.0 release of the Go implementation of Iceberg. Would anyone be opposed to this idea? Since I'm not a committer, someone else (likely Fokko or Eduard)

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC1

2024-11-13 Thread Matt Topol
b1ccefeb91f8486744532214e44R94 > [3] https://github.com/apache/iceberg-go/pull/202 > > On Wed, Nov 13, 2024 at 8:46 AM Matt Topol wrote: > >> Slight fix to the previous email: the text should say "The source release >> *rc1* is hosted at [2]" >> >> T

[VOTE][Go] Release Apache Iceberg Go v0.1.0 RC2

2024-11-13 Thread Matt Topol
Hi, I would like to propose the following release candidate (RC2) of Apache Iceberg Go version v0.1.0. This release candidate is based on commit: 0921b84b53e3184a1867481bf1e1a22f5a059b5c [1] The source release rc2 is hosted at [2]. Please download, verify checksums and signatures, run the unit

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC2

2024-11-14 Thread Matt Topol
ASF standpoint, that's the only strictly required artifact. > > Thanks ! > Regards > JB > > On Thu, Nov 14, 2024 at 12:06 AM Matt Topol > wrote: > > > > Hi, > > > > I would like to propose the following release candidate (RC2) of Apache >

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC2

2024-11-13 Thread Matt Topol
Ugh, Gmail messed up the link. [2] should be https://github.com/apache/iceberg-go/releases/v0.1.0-rc2 Sorry. On Wed, Nov 13, 2024, 6:06 PM Matt Topol wrote: > Hi, > > I would like to propose the following release candidate (RC2) of Apache > Iceberg Go version v0.1.0. > > This

Re: Welcome Huaxin Gao as a committer!

2025-02-06 Thread Matt Topol
Congrats! Welcome! On Thu, Feb 6, 2025, 10:19 AM Raúl Cumplido wrote: > Congrats Huaxin! > > El jue, 6 feb 2025 a las 10:16, Gang Wu () escribió: > >> Congrats Huaxin! >> >> Best, >> Gang >> >> On Thu, Feb 6, 2025 at 5:10 PM Szehon Ho wrote: >> >>> Hi everyone, >>> >>> The Project Management Co

Re: [DISCUSS] December board report

2024-12-11 Thread Matt Topol
For the Go release, can we please point out that it supports reading the data too, not just metadata? It produces a stream of Arrow record batches. On Wed, Dec 11, 2024, 4:22 PM Walaa Eldin Moustafa wrote: > Hi Ryan, > > For Table Format V3, we could point out that the default value support for

Re: New committer: Matt Topol

2024-12-10 Thread Matt Topol
gt;> > >> >> > >> On Tue, Dec 10, 2024 at 05:28 Fokko Driesprong >> wrote: >> > >> >> > >>> Hey everyone, >> > >>> >> > >>> The Project Management Committee (PMC) for Apache Iceberg has >

Re: [DISCUSS] Additional language implementations for Iceberg Puffin reader/writer

2024-11-22 Thread Matt Topol
I will also help out with the iceberg-cpp effort, please include me on the channel. While my focus will still be on iceberg-go, I'll happily review and contribute to the C++ implementation. I do also plan on eventually implementing puffin in the iceberg-go repo lol --Matt On Fri, Nov 22, 2024 at

Re: [discuss] Standardizing Naming Schemes for Language-Specific Configurations

2025-01-23 Thread Matt Topol
My initial comment on this is that neither Go nor Rust, to my knowledge, support dynamic loading in this way. So formalization of rs-, cpp- or go- prefixes like this wouldn't be useful in any meaningful way as they would need to be linked in ahead of time for it to work. There are probably very ha

Re: [VOTE] Drop Hive runtime

2025-01-04 Thread Matt Topol
+1 (non-binding) On Sat, Jan 4, 2025, 11:20 PM Manu Zhang wrote: > Happy New Year everyone! Wish you all the best! > Please kindly review the PR and cast your votes here. > > Thanks, > Manu > > On Sat, Dec 21, 2024 at 7:03 AM Daniel Weeks wrote: > >> +1 >> >> On Wed, Dec 18, 2024 at 10:41 PM Je

Re: [VOTE] Simplify multi-arg table metadata

2025-02-09 Thread Matt Topol
+1 (non-binding) Will definitely make it easier for iceberg-go to support v3 :) On Sun, Feb 9, 2025, 12:14 PM Szehon Ho wrote: > +1 (binding) > > Thanks Fokko! > Szehon > > > On Feb 9, 2025, at 8:14 AM, Jean-Baptiste Onofré > wrote: > > > > +1 (non binding) > > > > Thanks to the cat :) > > >

Re: [VOTE] Java implementation notes around current-snapshot-id

2025-02-25 Thread Matt Topol
+1 (non-binding) On Tue, Feb 25, 2025 at 12:49 PM Huang-Hsiang Cheng wrote: > +1 (non binding) > > > On Feb 25, 2025, at 8:27 AM, Jean-Baptiste Onofré > wrote: > > > > +1 (non binding) > > > > Regards > > JB > > > > On Mon, Feb 24, 2025 at 6:53 PM Fokko Driesprong > wrote: > >> > >> Hi everyon