Support of more manipulation for Record Batch

Hi all, I am working on a distributed sorting program which runs on multiple computation nodes. In this sorting program, data is represented as pandas DataFrames and key operations are groupby, concat, and sort_values. For shuffling data among the computation nodes, the DataFrames are converte

Re: Support of more manipulation for Record Batch

ting time or money to this effort I'd > be happy to speak with you offline about it. If you would like to > contribute we would be glad to have you aboard. > > Thanks > Wes > > On Thu, Apr 2, 2020 at 6:50 AM Chengxin Ma c...@protonmail.ch.invalid > wrote: &g

Re: Flight benchmark question

Hi Yibo, Your discovery is impressive. Did you consider the `num_streams` parameter [1] as well? If I understood correctly, this parameter is used for setting the conceptual concurrent streams between the client and the server, while `num_threads` is used for setting the size of the thread p

Re: [jira] [Created] (ARROW-7434) [GLib] Homebrew packages seem not working

It works. Thanks! Sent with ProtonMail Secure Email. ‐‐‐ Original Message ‐‐‐ On Wednesday, December 18, 2019 2:52 PM, Jeroen Ooms wrote: > Try this: > > gcc -o hello_world hello_world.c $(pkg-config --libs --cflags arrow-glib) > > On Wed, Dec 18, 2019 at 1:07 PM Cheng

Trouble with building Arrow GLib

Hi All, I am building Arrow GLib on a system where I'm not the admin. In the installation instructions (https://github.com/apache/arrow/tree/master/c_glib) there are two options for building GLib: "How to build by users" and "How to build by developers". I followed the "by users" section and me

Re: Trouble with building Arrow GLib

-- > > kou > > In > DIVG0Hqiw9iory_bs1T6A_cf5etWsPJ0-lbAFxaJ4H2hrTm87EGUED3ztGenYN6EjVzW5_oYL1KIH4V3F_BE1dMQyu4EtbBflin-m-iGC_Q=@protonmail.ch > &q

Re: Trouble with building Arrow GLib

; tSWuBtndqpJhkCaHTDcHDaE3za0pbqK-8fnqKT99Vv6QGVxYAjKuZUUSZ4A94U6DiZaWxc8wYc5JXiu9EoZublUwbXhlq8kar_sguY6onWI=@protonmail.ch > "Re: Trouble with building Arrow GLib" on Fri, 20 Dec 2019 09:59:27 +, > Chengxin Ma c...@protonmail.ch.INVALID wrote: > > > Hi Kou,

[jira] [Created] (ARROW-8587) Compilation error when linking arrow-flight-perf-server

Chengxin Ma created ARROW-8587: -- Summary: Compilation error when linking arrow-flight-perf-server Key: ARROW-8587 URL: https://issues.apache.org/jira/browse/ARROW-8587 Project: Apache Arrow

[jira] [Created] (ARROW-8861) Memory not released until Plasma process is killed

Chengxin Ma created ARROW-8861: -- Summary: Memory not released until Plasma process is killed Key: ARROW-8861 URL: https://issues.apache.org/jira/browse/ARROW-8861 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7200) Running Arrow Flight benchmark on two hosts doesn't work

Chengxin Ma created ARROW-7200: -- Summary: Running Arrow Flight benchmark on two hosts doesn't work Key: ARROW-7200 URL: https://issues.apache.org/jira/browse/ARROW-7200 Project: Apache

[jira] [Created] (ARROW-7320) Target arrow-type-benchmark failed to be built on bullx Linux

Chengxin Ma created ARROW-7320: -- Summary: Target arrow-type-benchmark failed to be built on bullx Linux Key: ARROW-7320 URL: https://issues.apache.org/jira/browse/ARROW-7320 Project: Apache Arrow

[jira] [Created] (ARROW-7411) [C++][Flight] Incorrect Arrow Flight benchmark output

Chengxin Ma created ARROW-7411: -- Summary: [C++][Flight] Incorrect Arrow Flight benchmark output Key: ARROW-7411 URL: https://issues.apache.org/jira/browse/ARROW-7411 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7434) [GLib] Homebrew packages seem not working

Chengxin Ma created ARROW-7434: -- Summary: [GLib] Homebrew packages seem not working Key: ARROW-7434 URL: https://issues.apache.org/jira/browse/ARROW-7434 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-7522) Broken Record Batch returned from a function call

Chengxin Ma created ARROW-7522: -- Summary: Broken Record Batch returned from a function call Key: ARROW-7522 URL: https://issues.apache.org/jira/browse/ARROW-7522 Project: Apache Arrow Issue