Re: [DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

2024-08-29 Thread Renjie Liu
> > OpenDAL tends to release all packages simultaneously but with different > versions. We can try this approach as well. I think it's a good approach. But I also agree that we could release pyiceberg_core separately for now, and rethink the workflow when we actually have more bindings. On Thu,

Re: [DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

2024-08-28 Thread Xuanwo
> Decoupling pyiceberg_core with iceberg-rust may be flexible, but my concern > is that this may not be scalable when we introduce more language bindings. I > think Xuanwo has a lot of experience when maintaining Apache OpenDAL > ? OpenDAL tends to release al

Re: [DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

2024-08-28 Thread Renjie Liu
Hi: Thanks Sung for driving this. Which features do we expose in the first release? I think the transformation is a good start. Should the version of the pyiceberg_core python package be aligned with the > version of iceberg-rust crate? Decoupling pyiceberg_core with iceberg-rust may be flex

Re: [DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

2024-08-28 Thread Fokko Driesprong
Thanks for driving this Sung, this is very exciting! 1. The transforms are a good first thing to address. 2. I agree with Xuanwo, that for flexibility we can decouple them. 3. Automation is probably easier than doing it manually (otherwise we would have to document the steps). Kind regards, Fokko

Re: [DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

2024-08-27 Thread Xuanwo
Thanks a lot for carrying this! > 1. Which features do we expose in the first release? No further comments on this. Pyiceberg is currently the sole user of pyiceberg_core. I'm willing to meet whatever pyiceberg's needs. > 2. Should the version of the pyiceberg_core python package be aligned wit

[DISCUSS] iceberg-rust: pyiceberg_core 0.1.0 Release

2024-08-27 Thread Sung Yun
Hi folks, We’ve recently had a few discussion threads on components we wanted to expose as Python Bindings from the iceberg-rust project in the form of the "pyiceberg_core" package. Now that the Python bindings for the Transforms have been implemented, I wanted to open this thread to discuss the