Andy Grove created ARROW-4681: --------------------------------- Summary: [Rust] [DataFusion] Implement parallel query execution using threads Key: ARROW-4681 URL: https://issues.apache.org/jira/browse/ARROW-4681 Project: Apache Arrow Issue Type: Improvement Components: Rust, Rust - DataFusion Affects Versions: 0.12.0 Reporter: Andy Grove Assignee: Andy Grove Fix For: 0.13.0
I am planning on tackling this soon. The basic plan is to change the table scan() method to return multiple scanners (one per partition) so that the query execution can process each partition on a separate thread. This will involve changing some of the DataFusion APIs to use Arc instead of Rc. -- This message was sent by Atlassian JIRA (v7.6.3#76005)