Re: [RUST][DataFusion][Arrow] Switching DataFusion to use arrow2 implementation and the future of arrow

2022-01-16 Thread Micah Kornfield
I agree, Jorge's point of view (and anyone else who has contributed to arrow2) is important here. One thing that isn't exactly clear to me from the linked issue is how much interest there is in the community for maintaining arrow-rs? How much is a donation of arrow2 a factor here? Also, the last

Re: [RUST][DataFusion][Arrow] Switching DataFusion to use arrow2 implementation and the future of arrow

2022-01-16 Thread QP Hou
Hi Wes, I believe what you mentioned is the plan, i.e. move arrow2 to ASF in the long run when it stabalize on its design/API and could benefit from a more rigorous release process. From what I have seen, the project is still undergoing major API changes on a monthly basis, so quick releases and f

Re: [RUST][DataFusion][Arrow] Switching DataFusion to use arrow2 implementation and the future of arrow

2022-01-16 Thread Benjamin Blodgett
Why don’t we gift the whole arrow project to Jorge if he’s the one pushing the tech forward? I’d say the governance would be better Sent from my iPhone > On Jan 16, 2022, at 2:42 PM, Wes McKinney wrote: > > Is there a possibility of donating arrow2 to the Arrow project (at > some point)? The

Re: [RUST][DataFusion][Arrow] Switching DataFusion to use arrow2 implementation and the future of arrow

2022-01-16 Thread Benjamin Blodgett
Jorge did such a great job making THE new and better columnar in mem format. Arrow 2 is just better and the future, but it should stay under Jorge’s clearly more capable hands. We should all be thanking him. I had a such a a good belly laugh at ‘is there a possibility of donating’. Pleaser do

Re: [RUST][DataFusion][Arrow] Switching DataFusion to use arrow2 implementation and the future of arrow

2022-01-16 Thread Wes McKinney
Is there a possibility of donating arrow2 to the Arrow project (at some point)? The main impact to development would be holding votes on releases, but this is probably a good thing long term from a governance standpoint. The answer may be "not right now" and that's fine. Having many of the same peo