Re: [Rust] [DataFusion] Topic for next Rust Sync Call

Regarding https://github.com/jorgecarleitao/arrow2 — please (looking at the PMC members who work on Rust) be careful about IP provenance considerations with code developed outside the Foundation. On Wed, Mar 10, 2021 at 11:15 AM Dominik Moritz wrote: > > I have a talk prepared to talk about my A

Re: [Rust] [DataFusion] Topic for next Rust Sync Call

I have a talk prepared to talk about my Arrow implementation in WebAssembly. On Mar 10, 2021 at 04:38:21, Andrew Lamb wrote: > Reminder that today is the next Rust sync call > > Potential topics for discussion: > * Ballista / DataFusion / etc > * I remember that someone else was going to demo t

Re: [Rust] [DataFusion] Topic for next Rust Sync Call

Hi, If there is time available, I would like to present the status of the experimental arrow2 repo, and gather feedback on what would be the best way to proceed. 10-15m? Best, Jorge On Wed, Mar 10, 2021 at 1:57 PM Andrew Lamb wrote: > Also: > * sema

Re: [Rust] [DataFusion] Topic for next Rust Sync Call

Also: * semantics for CAST and what to do on failure (return NULL or error) [Mike S] On Wed, Mar 10, 2021 at 7:38 AM Andrew Lamb wrote: > Reminder that today is the next Rust sync call > > Potential topics for discussion: > * Ballista / DataFusion / etc > * I remember that someone else was goin

Re: [Rust] [DataFusion] Topic for next Rust Sync Call

Reminder that today is the next Rust sync call Potential topics for discussion: * Ballista / DataFusion / etc * I remember that someone else was going to demo the use of Arrow but I can't remember exactly what that was now On Tue, Feb 16, 2021 at 10:59 AM Dominik Moritz wrote: > Somewhat relat

Re: [Rust] [DataFusion] Topic for next Rust Sync Call

Somewhat related, I tried to compile DataFusion to WASM and it didn’t work because of some dependencies: https://issues.apache.org/jira/projects/ARROW/issues/ARROW-11615. I wonder whether DataFusion could have a feature flag for only shipping what is WASM compatible? On Feb 15, 2021 at 12:13:04,

Re: [Rust] [DataFusion] Topic for next Rust Sync Call

> Also, unrelated, is there a schedule for the sync calls? Will try and carve out some free time for the next one :) It is every other Wednesday at noon EST. Here is the original announcement with more details: https://lists.apache.org/thread.html/raa72e1a8a3ad5dbb8366e9609a041eccca87f85545c3bc3d8

Re: [Rust] [DataFusion] Topic for next Rust Sync Call

I think it's a great idea to make default / dev compile times faster and have clear guidelines for how to use dependencies. Some low-hanging fruit could be moving some development dependencies under different crates to reduce compile times and bigger dependencies, i.e. those needed for criterion.

RE: [Rust] [DataFusion] Topic for next Rust Sync Call

I'd be interested in helping spec this out, it's especially tricky atm to track down issues when integrating DataFusion into the same binary as other medium/large dependencies. Recently hit a really specific issue where DataFusion depends on Parquet, which supports various compression algs, inc