Re: [Rust] DataFusion TPCH benchmark overview

2021-02-03 Thread Andrew Lamb
This is awesome, thank you Daniel. I agree that focusing on enough SQL for TPCH queries would be a great idea and way to focus our efforts. Subqueries may be the largest remaining outstanding item that I see -- I have some ideas of how to implement them on the planner side if others are interested

Re: Arrow sync call February 3 at 12:00 US/Eastern, 17:00 UTC

2021-02-03 Thread Neal Richardson
Attendees: Andy Grove Todd Hendricks Jonathan Keane Kirill Lykov Weston Pace Prudhvi Porandla Neal Richardson Charlene Solonynka Discussion: * 3.0 release happened; we should follow up on any release-process improvements now so that we can release more easily in the future * If there's anything

Re: [Rust] DataFusion TPCH benchmark overview

2021-02-03 Thread Andy Grove
Thanks for the update on this, Daniël. It is great to see the progress with this! Perhaps it is worth creating one JIRA issue per failing query detailing the errors and we can link these to the issues that are causing the failures? On Wed, Feb 3, 2021 at 1:57 PM Mike Seddon wrote: > Hi Daniël,

Re: [Rust] DataFusion TPCH benchmark overview

2021-02-03 Thread Mike Seddon
Hi Daniël, I am working on 22 as part of https://github.com/apache/arrow/pull/9243 We also need to convert all the Float64 schema types to Decimal(n). Cheers, Mike On Thu, Feb 4, 2021 at 5:44 AM Daniël Heres wrote: > Hey all, > > Quite some features have been added to DataFusion in the last c

[Rust] DataFusion TPCH benchmark overview

2021-02-03 Thread Daniël Heres
Hey all, Quite some features have been added to DataFusion in the last couple of months. One test of the functionality we support this is the TPC-H benchmark. We now can run 7 out of 22 queries without errors. I think a nice goal would be having complete support for the full suite, as it means a

[NIGHTLY] Arrow Build Report for Job nightly-2021-02-03-0

2021-02-03 Thread Crossbow
Arrow Build Report for Job nightly-2021-02-03-0 All tasks: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-02-03-0 Failed Tasks: - conda-linux-gcc-py36-aarch64: URL: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-02-03-0-drone-conda-linux