Re: C++ optimize stream output

2018-03-26 Thread Rares Vernica
Hi Wes, Thanks so much for the feedback. On Thu, Mar 15, 2018 at 5:38 PM, Wes McKinney wrote: > > Per ARROW-2189 -- do you get these problems if you build from source? > I'm trying to understand if this is a packaging issue or a code issue I plan to try building from source. I will update the i

Re: C++ optimize stream output

2018-03-15 Thread Wes McKinney
I opened https://issues.apache.org/jira/browse/ARROW-2319 per the buffered output point On Thu, Mar 15, 2018 at 8:38 PM, Wes McKinney wrote: > hi Rares, > > sorry for the delay in writing back. To your questions > >- Does this look good decent? Could the API be used in more efficient >way

Re: C++ optimize stream output

2018-03-15 Thread Wes McKinney
hi Rares, sorry for the delay in writing back. To your questions - Does this look good decent? Could the API be used in more efficient ways in order to achieve the same goal? This seems perfectly reasonable with the API as it is now - On each node side, do steps #3 and #7 copy data? S

C++ optimize stream output

2018-02-26 Thread Rares Vernica
Hello, I am using the C++ API to serialize and centralize data over the network. I am wondering if I am using the API in an efficient way. I have multiple nodes and a coordinator communicating over the network. I do not have fine control over the network communication. Individual nodes write one