[jira] [Created] (ARROW-3304) JS stream reader should yield all messages

2018-09-23 Thread Paul Taylor (JIRA)
Paul Taylor created ARROW-3304: -- Summary: JS stream reader should yield all messages Key: ARROW-3304 URL: https://issues.apache.org/jira/browse/ARROW-3304 Project: Apache Arrow Issue Type: Impro

[jira] [Created] (ARROW-3303) [C++] Enable example arrays to be written with a simplified JSON representation

2018-09-23 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3303: --- Summary: [C++] Enable example arrays to be written with a simplified JSON representation Key: ARROW-3303 URL: https://issues.apache.org/jira/browse/ARROW-3303 Project:

Re: [NEWBIE QUESTION] Test not resolving correct Array from Datum

2018-09-23 Thread Atri Sharma
Hi Wes, Thanks for your reply. I agree, the implementation of the kernel is not the most optimal one. However, I was not sure how to initialize a hash table of an Arrow data type (STL wouldnt be able to help, since it needs a fixed type, I believe). I vaguely figured that i needed thr E Arrow nat

Re: [NEWBIE QUESTION] Test not resolving correct Array from Datum

2018-09-23 Thread Wes McKinney
hi Atri, You're pushing one buffer for each element in the left array: https://github.com/atris/arrow/commit/1dcce9b2f34818760df29fdf8767fc1619257ea9#diff-4459cb59122bbce0553230b6638f6d5eR100 (gdb) p out->buffers.size() $23 = 3 The first buffer in out->buffers is the validity bitmap, which is b

[NEWBIE QUESTION] Test not resolving correct Array from Datum

2018-09-23 Thread Atri Sharma
Hi All, While adding a new test, I am facing an issue where a Datum of Array type returned by a function in compute layer does not match the expected value. I manually checked the buffers of the returned Datum's Array's contained ArrayData, and they look to be the correct values, but on printing t