As Micah said, this would be pretty cool to use in Arrow datasets. I can't
make any promises about helping develop it but if it were developed I could
help integrate into Arrow datasets / Acero and provide some proof of
concept.
On Wed, Jun 8, 2022, 6:35 AM Ryan Blue wrote:
> While I understand
Yes, you can write Flink change streams directly to Iceberg tables. There's
an option to support incoming CDC with different RowKinds and an option to
support upserts.
On Mon, Jun 6, 2022 at 12:15 PM Hailu, Andreas wrote:
> Thanks, Ryan, that’s helpful.
>
>
>
> I’m curious – is there a Flink-nat
While I understand Kyle's concerns, I'm all for a C++ or Rust
implementation.
We know that this is going to help a lot of people that want to integrate
Iceberg in engines that are outside the JVM ecosystem. I think it would be
great to work with anyone that is interested and build up the community
As a cloud-native table format standard for the big-data ecosystem, I
believe supporting multiple languages is the correct direction so that
different languages can connect to the apache iceberg table format.
But I can also get Kyle's point about lacking enough resources(developers
and reviewers
