Re: [Python] Retrieving a RecordBatch from plasma inside a function

2018-02-21 Thread Philipp Moritz
30 > > A: dev@arrow.apache.org<mailto:dev@arrow.apache.org> > > Oggetto: Re: [Python] Retrieving a RecordBatch from plasma inside a > function > > > > Thanks! I can indeed reproduce this problem. I'm a bit busy right now and > > plan to look into it on the

Re: [Python] Retrieving a RecordBatch from plasma inside a function

2018-02-21 Thread Wes McKinney
vance, > Alberto > Da: Philipp Moritz<mailto:pcmor...@gmail.com> > Inviato: venerdì 9 febbraio 2018 00:30 > A: dev@arrow.apache.org<mailto:dev@arrow.apache.org> > Oggetto: Re: [Python] Retrieving a RecordBatch from plasma inside a function > > Thanks! I can indeed reproduc

R: [Python] Retrieving a RecordBatch from plasma inside a function

2018-02-21 Thread ALBERTO Bocchinfuso
ailto:dev@arrow.apache.org> Oggetto: Re: [Python] Retrieving a RecordBatch from plasma inside a function Thanks! I can indeed reproduce this problem. I'm a bit busy right now and plan to look into it on the weekend. Here is the preliminary backtrace for everybody interested: CESS (code=1, ad

Re: [Python] Retrieving a RecordBatch from plasma inside a function

2018-02-08 Thread Philipp Moritz
eam, batch.schema) > writer.write_batch(batch) > client.seal(pid) > > batch = retrieve1() > print(batch) > print(batch.schema) > print(batch[0]) > > I hope this helps, > thank you > > Da: Philipp Moritz<mailto:pcmor...@gmail.com> > Inviato: martedì 6 febbraio 20

R: [Python] Retrieving a RecordBatch from plasma inside a function

2018-02-06 Thread ALBERTO Bocchinfuso
thank you Da: Philipp Moritz<mailto:pcmor...@gmail.com> Inviato: martedì 6 febbraio 2018 00:00 A: dev@arrow.apache.org<mailto:dev@arrow.apache.org> Oggetto: Re: [Python] Retrieving a RecordBatch from plasma inside a function Hey Alberto, Thanks for your message! I'm trying t

Re: [Python] Retrieving a RecordBatch from plasma inside a function

2018-02-05 Thread Philipp Moritz
Hey Alberto, Thanks for your message! I'm trying to reproduce it. Can you attach the code you use to write the batch into the store? Also can you say which version of Python and Arrow you are using? On my installation, I get ``` In [*5*]: plasma.ObjectID(bytearray("keynumber1keynumber1", "UTF-

[Python] Retrieving a RecordBatch from plasma inside a function

2018-02-05 Thread ALBERTO Bocchinfuso
Good morning, I am experiencing problems with the RecordBatches stored in plasma in a particular situation. If I return a RecordBatch as result of a python function, I am able to read just the metadata, while I get an error when reading the columns. For example, the following code def retrieve