Re: A new project focused on serialized algebra

2021-09-10 Thread Jacques Nadeau
There are also some good conversations happening in on the Github discussion forum [1]. We're trying to drive consensus around the type system to start [2]. Would love the Iceberg community members to weigh in as the contributors are fairly Arrow heavy atm. Thanks, Jacques [1] https://github.co

Re: A new project focused on serialized algebra

2021-09-10 Thread Ryan Blue
Nevermind, I see there's a Substrait Slack community. Here's the invite link for anyone else that's interested: https://join.slack.com/t/substrait/shared_invite/zt-vivbux2c-~B1jEWcR0wYhq5k4LHuoLQ On Fri, Sep 10, 2021 at 9:16 AM Ryan Blue wrote: > Thanks, Jacques! I think it's a great idea to hav

Re: A new project focused on serialized algebra

2021-09-10 Thread Ryan Blue
Thanks, Jacques! I think it's a great idea to have this as an external project so that it doesn't get tied to a particular set of goals for an existing project. Where is a good place to discuss this? Should we create a #substrait room on Iceberg Slack? ASF Slack? On this thread? Ryan On Wed, Sep

A new project focused on serialized algebra

2021-09-08 Thread Jacques Nadeau
Hey all, For some time I've been thinking that having a common serialized representation of query plans would be helpful across multiple related projects. I started working on something independently in this vein several months ago. Since then, Arrow has started exploring "Arrow IR" and in Iceberg