Re: scheduler() and aync_scheduler() on QueryContext

2023-07-26 Thread Weston Pace
Also, if you haven't seen it yet, the 13.0.0 release adds considerably more documentation around Acero, including the scheduler: https://arrow.apache.org/docs/dev/cpp/acero/developer_guide.html#scheduling-and-parallelism On Wed, Jul 26, 2023 at 10:13 AM Li Jin wrote: > Thanks Weston! Very helpf

Re: scheduler() and aync_scheduler() on QueryContext

2023-07-26 Thread Li Jin
Thanks Weston! Very helpful explanation. On Tue, Jul 25, 2023 at 6:41 PM Weston Pace wrote: > 1) As a rule of thumb I would probably prefer `async_scheduler`. It's more > feature rich and simpler to use and is meant to handle "long running" tasks > (e.g. 10s-100s of ms or more). > > The schedul

Re: scheduler() and aync_scheduler() on QueryContext

2023-07-25 Thread Weston Pace
1) As a rule of thumb I would probably prefer `async_scheduler`. It's more feature rich and simpler to use and is meant to handle "long running" tasks (e.g. 10s-100s of ms or more). The scheduler is a bit more complex and is intended for very fine-grained scheduling. It's currently only used in