Re: Iceberg old partition gc

Ryan, One use case is the user might need to time travel to a certain snapshot. However, such a snapshot is expired due to the snapshot expiration that only retains the latest snapshot operation, and this operation's only intent is to remove the gc partition. It seems a little overkill to me. I h

Re: Iceberg old partition gc

Pucheng, What is the use case around keeping the snapshot longer? We don't often have people ask to keep snapshots that can't be read, so it sounds like you might have something specific in mind? Ryan On Wed, May 31, 2023 at 8:19 PM Pucheng Yang wrote: > Hi community, > > In my organization, a

Re: How to use Apache Iceberg cli

Hi Arvind, Iceberg itself doesn't have a Web UI or a CLI. However, there is pyiceberg that allows you to interact with Iceberg from python. This blog contains an overview of how to get started with pyiceberg. On Thu, Jun 1, 202

Re: How to use Apache Iceberg cli

Iceberg does not have its own cli or a web ui. The spark-shell (spark cli) or Trino are usually recommended for early testing. The instructions for interacting are in the other spark doc pages where you found the getting started docs. Sent from my iPhone > On Jun 1, 2023, at 9:40 AM, Arvind Di

Re: How to use Apache Iceberg cli

Any solution on this?? From: Arvind Dige Sent: Thursday, June 1, 2023 11:21 AM To: dev@iceberg.apache.org Subject: How to use Apache Iceberg cli Hi Team, I am using the open source iceberg-1.2.1 for development purposes. where I have successfully build the icebe

Re: [DISCUSS] Flink range partitioner/shuffle

Good point. Stick to the conventions then Steven Wu ezt írta (időpont: 2023. máj. 31., Sze, 17:14): > Peter, > > I also thought about that. Didn't go with `StructTransformation.schema()`, > because I was hoping to stick with the `StructLike` interface which > doesn't expose `schema()`. Trying to