Re: Iceberg python library sync

2024-04-28 Thread Jun H.
Hi everyone, FYI, the next community python library sync meeting will be on Tuesday (04/30) at 9 AM (US/Pacific). Here is the meeting agenda for the topics to discuss: https://docs.google.com/document/d/1oMKodaZJrOJjPfc8PDVAoTdl02eGQKHlhwuggiw7s9U/edit#bookmark=id.sewae6ia5coh. Please feel free to

Re: FlinkFileIO implementation

2024-04-28 Thread Ryan Blue
I agree that there are cases where different implementations can be better than others. But what I'm trying to say is that the contract for FileIO is that the engine must use the one provided by the Table API. The engine doesn't know what is configured correctly and can't swap them out. And catalog

How to use Data Lake Optimization With Apache Amoro

2024-04-28 Thread ConradJam
Hi iceberg community: I'm from Apache Amoro development. I would like to recommend a data lake optimization and integration tool : *Apache Amoro [1]* Apache Amoro is builds lake-native data warehouse and architecture for users, platforms and products It provides Self-optimizing, Multiple Formats,