Re: [Rust][DataFusion] profiling TPC-H benchmarks with flamegraphs

2022-04-06 Thread Andrew Lamb
I am going to try and make profiling in datafusion a bit easier. Feel free to comment on the ticket[1] Andrew [1] https://github.com/apache/arrow-datafusion/issues/2174 On Mon, Mar 21, 2022 at 7:39 PM Bob Tinsman wrote: > Wow, hotspot looks very cool! However, I was only able to download v1.

Re: C++ Helpers for Row and Arrow conversions

2022-04-06 Thread Will Jones
Hello, I've fleshed out the ideas in the doc in this draft PR: https://github.com/apache/arrow/pull/12775 Feedback on the API design is still welcome. Best, Will Jones On Thu, Mar 24, 2022 at 10:25 AM Will Jones wrote: > Antoine, > > That's a good question. I think there's a critical part th

Re: storing per record batch metadata in arrow IPC file

2022-04-06 Thread Yue Ni
Hi Weston, > The C++ implementation does not expose this today that I can tell. So if you want to use this then some C++ changes will be needed. There is already a JIRA ticket for this at [2]. Thanks for pointing this out, it seems the ticket ARROW-16131 I logged above duplicates with ARROW-6940