Re: 【Feature】Request support for c++ sdk

2022-06-22 Thread Joshua Howard
+1 for Rust. On Wed, Jun 22, 2022 at 4:21 AM LuNing Wang wrote: > +1 for Rust > > Best Regards, > LuNing Wang > > Nan Zhu 于2022年6月22日周三 14:15写道: > >> +1 for using rust as the backbone for new language bindings >> >> On Sun, Jun 12, 2022 at 23:52 OpenInx wrote: >> >>> Thanks Kyle for sharing yo

Re: 【Feature】Request support for c++ sdk

2022-06-22 Thread LuNing Wang
+1 for Rust Best Regards, LuNing Wang Nan Zhu 于2022年6月22日周三 14:15写道: > +1 for using rust as the backbone for new language bindings > > On Sun, Jun 12, 2022 at 23:52 OpenInx wrote: > >> Thanks Kyle for sharing your context. >> >> Recently, I also spent some time practicing my Rust skills. Gene

Re: 【Feature】Request support for c++ sdk

2022-06-21 Thread Nan Zhu
+1 for using rust as the backbone for new language bindings On Sun, Jun 12, 2022 at 23:52 OpenInx wrote: > Thanks Kyle for sharing your context. > > Recently, I also spent some time practicing my Rust skills. Generally, > I'm +1 for adding Rust SDK support for native language. > > > On Mon, Jun

Re: 【Feature】Request support for c++ sdk

2022-06-12 Thread OpenInx
Thanks Kyle for sharing your context. Recently, I also spent some time practicing my Rust skills. Generally, I'm +1 for adding Rust SDK support for native language. On Mon, Jun 13, 2022 at 12:51 PM Kyle Bendickson wrote: > Thanks for starting this discussion. > > I know I was the first to men

Re: 【Feature】Request support for c++ sdk

2022-06-12 Thread Kyle Bendickson
Thanks for starting this discussion. I know I was the first to mention some of my concerns (which I still have and would apply to any new major change), but I also think that this is an avenue that should be explored. Specifically a native integration would have many benefits for read paths (in a

Re: 【Feature】Request support for c++ sdk

2022-06-12 Thread OpenInx
Hi Tao Wu. I think the apache iceberg community is very consistent in providing the Iceberg SDK for native languages. I am very happy to offer my perspective and help if needed when you try to move this thing forward. On Mon, Jun 13, 2022 at 11:04 AM Wu Tao wrote: > Hi, everyone, I'm Tao. I'm

Re: 【Feature】Request support for c++ sdk

2022-06-12 Thread Wu Tao
Hi, everyone, I'm Tao. I'm currently working on a commercial streaming system that is written in Rust. Actually, I'm planning to implement an Iceberg Rust SDK so that we can have better integration with the existing Iceberg ecosystem. Initially I found https://github.com/oliverdaff/iceberg-rs,

Re: 【Feature】Request support for c++ sdk

2022-06-08 Thread Weston Pace
As Micah said, this would be pretty cool to use in Arrow datasets. I can't make any promises about helping develop it but if it were developed I could help integrate into Arrow datasets / Acero and provide some proof of concept. On Wed, Jun 8, 2022, 6:35 AM Ryan Blue wrote: > While I understand

Re: 【Feature】Request support for c++ sdk

2022-06-08 Thread Ryan Blue
While I understand Kyle's concerns, I'm all for a C++ or Rust implementation. We know that this is going to help a lot of people that want to integrate Iceberg in engines that are outside the JVM ecosystem. I think it would be great to work with anyone that is interested and build up the community

Re: 【Feature】Request support for c++ sdk

2022-06-08 Thread OpenInx
As a cloud-native table format standard for the big-data ecosystem, I believe supporting multiple languages is the correct direction so that different languages can connect to the apache iceberg table format. But I can also get Kyle's point about lacking enough resources(developers and reviewers

Re: 【Feature】Request support for c++ sdk

2022-06-06 Thread Micah Kornfield
> > There’s also the question of how useful this would be in practice given > the complexity of using C++ (or Rust etc) within some of the major > frameworks. > One place this would be useful is for the Arrow's DataSet API [1]. An option the Arrow community might be open to is hosting parts of th

Re: 【Feature】Request support for c++ sdk

2022-06-05 Thread Kyle Bendickson
Hi caneGuy, I personally don’t dislike this idea. I understand the performance benefits. But this would be a huge undertaking for the community. We’d need to ensure we had sufficient developer support for reviews (likely one of the biggest issues), as well as a number of other things. Particularl

Re: 【Feature】Request support for c++ sdk

2022-06-05 Thread Sam Redai
Currently there is no existing effort to develop a C++ package. That being said I think it would be awesome to have one! If anyone is willing to start that development effort, I can help with some of the ground work to kickstart it. I would say the first step would be for someone to prepare a high