Re: Introducing myself

2018-03-07 Thread Jacques Nadeau
Welcome, happy to have you as part of the community! On Wed, Mar 7, 2018 at 7:41 AM, Krisztián Szűcs wrote: > Hey Andy! > > In the last couple of days I was digging arrow and iron-arrow ( > https://link.getmailspring.com/link/local-f599f61d-1722- > v1.1.4-22d9f20d@kszucs-mbp.local/0?redirect=htt

Re: Arrow sync call today - March 7

2018-03-07 Thread Li Jin
I would also be interested in the Java <-> Python/C++ in-process API. Agree we can discuss offline. On Wed, Mar 7, 2018 at 9:20 AM, Uwe L. Korn wrote: > I would like to talk about having a Java <-> Python/C++ in-process API and > what base requirements for that would be but I can raise that on t

Re: Making a bugfix Arrow JS release

2018-03-07 Thread Wes McKinney
Seems like a good idea -- we could make a lerna monorepo under the js/ directory as it stands now On Wed, Mar 7, 2018 at 11:13 AM, Brian Hulette wrote: > Naveen, > > Yes I think when we initially discussed adding the JS dataframe ops we > argued that it could be a separate library within the Apac

Re: Making a bugfix Arrow JS release

2018-03-07 Thread Brian Hulette
Naveen, Yes I think when we initially discussed adding the JS dataframe ops we argued that it could be a separate library within the Apache Arrow monorepo, since some users will just want the ability to read/write arrow data, and we shouldn't force them to pull in a dataframe API they won't b

Re: Using Plasma with xnd

2018-03-07 Thread Wes McKinney
Where are you going to make Plasma requests, in Python or in C? * If in Python, use the buffer protocol to access the memory in C https://docs.python.org/3/c-api/buffer.html#bufferobjects * If in C, then I would suggest adding extern "C" APIs directly in libplasma.so so you can connect to the Plas

Re: Using Plasma with xnd

2018-03-07 Thread Saul Shanabrook
Hey Wes, Since all our logic for writing and reading the data is written in C, we need to be get access to the memory in C as well. I think it makes sense then for me to work on creating a C++ wrapper around Plasma that exports what is necessary in C. Should that be in Arrow GLib? Best, Saul On

Re: Introducing myself

2018-03-07 Thread Krisztián Szűcs
Hey Andy! In the last couple of days I was digging arrow and iron-arrow (https://link.getmailspring.com/link/local-f599f61d-1722-v1.1.4-22d9f20d@kszucs-mbp.local/0?redirect=https%3A%2F%2Fgithub.com%2Fjihoonson%2Firon-arrow&recipient=dev%40arrow.apache.org) in order to create a rust impl for arro

Introducing myself

2018-03-07 Thread Andy Grove
Hi, I just wanted to introduce myself to the group before I start asking lots of questions. I'm a software engineer mostly working with Scala/Spark/Kudu/Parquet in my day job and in my spare time I have been working on a POC of a distributed data platform implemented in Rust. The project is called

Re: Making a bugfix Arrow JS release

2018-03-07 Thread Naveen Michaud-Agrawal
Hi Brian, Any thoughts on splitting out the dataframe like parts into a separate library, keeping arrowjs to just handle loading data out of the arrow buffer? Regards, Naveen Michaud-Agrawal

Re: Arrow sync call today - March 7

2018-03-07 Thread Uwe L. Korn
I would like to talk about having a Java <-> Python/C++ in-process API and what base requirements for that would be but I can raise that on the mailing list (as it's also a topic where I would value Sidd's opinion). For me it's ok to skip and focus on the release. On Wed, Mar 7, 2018, at 3:17 P

Re: Arrow sync call today - March 7

2018-03-07 Thread Wes McKinney
I suggest we skip this sync as the major pending item is closing out 0.9.0. If others would like to have a short call please chime in. Wes On Mar 7, 2018 6:25 AM, "Siddharth Teotia" wrote: > I will be at Strata conference today and won't be able to join the call. > > Thanks > Sidd >

[jira] [Created] (ARROW-2287) [Python] chunked array not iterable, not indexable

2018-03-07 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2287: - Summary: [Python] chunked array not iterable, not indexable Key: ARROW-2287 URL: https://issues.apache.org/jira/browse/ARROW-2287 Project: Apache Arrow Iss

[jira] [Created] (ARROW-2286) [Python] Allow subscripting pyarrow.lib.StructValue

2018-03-07 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2286: - Summary: [Python] Allow subscripting pyarrow.lib.StructValue Key: ARROW-2286 URL: https://issues.apache.org/jira/browse/ARROW-2286 Project: Apache Arrow Is

[jira] [Created] (ARROW-2285) [Python] Can't convert Numpy string arrays

2018-03-07 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2285: - Summary: [Python] Can't convert Numpy string arrays Key: ARROW-2285 URL: https://issues.apache.org/jira/browse/ARROW-2285 Project: Apache Arrow Issue Type:

Arrow sync call today - March 7

2018-03-07 Thread Siddharth Teotia
I will be at Strata conference today and won't be able to join the call. Thanks Sidd

[jira] [Created] (ARROW-2284) [Python] test_plasma error on plasma_store error

2018-03-07 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2284: - Summary: [Python] test_plasma error on plasma_store error Key: ARROW-2284 URL: https://issues.apache.org/jira/browse/ARROW-2284 Project: Apache Arrow Issue

Re: [VOTE] Accept donation of Arrow Go implementation

2018-03-07 Thread Philipp Moritz
+1 On Wed, Mar 7, 2018 at 12:12 AM, Julian Hyde wrote: > +1 > > > > On Mar 6, 2018, at 3:49 PM, Kouhei Sutou wrote: > > > > +1 > > > > In > > "Re: [VOTE] Accept donation of Arrow Go implementation" on Tue, 6 Mar > 2018 15:46:31 -0500, > > Li Jin wrote: > > > >> +1 > >> > >> On Tue, Mar 6, 2

Re: [VOTE] Accept donation of Arrow Go implementation

2018-03-07 Thread Julian Hyde
+1 > On Mar 6, 2018, at 3:49 PM, Kouhei Sutou wrote: > > +1 > > In > "Re: [VOTE] Accept donation of Arrow Go implementation" on Tue, 6 Mar 2018 > 15:46:31 -0500, > Li Jin wrote: > >> +1 >> >> On Tue, Mar 6, 2018 at 3:31 PM, Uwe L. Korn wrote: >> >>> +1 >>> >>> On Tue, Mar 6, 2018, at