[jira] [Comment Edited] (ARROW-664) Make C++ Arrow serialization deterministic

2017-03-19 Thread Philipp Moritz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932087#comment-15932087 ] Philipp Moritz edited comment on ARROW-664 at 3/20/17 2:44 AM: --

[jira] [Commented] (ARROW-664) Make C++ Arrow serialization deterministic

2017-03-19 Thread Philipp Moritz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932087#comment-15932087 ] Philipp Moritz commented on ARROW-664: -- As a result of the PR, the Ray determinism tes

[jira] [Commented] (ARROW-664) Make C++ Arrow serialization deterministic

2017-03-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932086#comment-15932086 ] Wes McKinney commented on ARROW-664: No, it is simply an oversight. Since we run the un

[jira] [Commented] (ARROW-664) Make C++ Arrow serialization deterministic

2017-03-19 Thread Philipp Moritz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932084#comment-15932084 ] Philipp Moritz commented on ARROW-664: -- Thanks [~wesmckinn], I created a PR https://gi

[jira] [Commented] (ARROW-664) Make C++ Arrow serialization deterministic

2017-03-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932057#comment-15932057 ] Wes McKinney commented on ARROW-664: To fix this, I recommend adding an option to {{arr

[jira] [Commented] (ARROW-664) Make C++ Arrow serialization deterministic

2017-03-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932056#comment-15932056 ] Wes McKinney commented on ARROW-664: [~pcmoritz] independent of the discussion about th

[jira] [Comment Edited] (ARROW-602) C++: Provide iterator access to primitive elements inside a Column/ChunkedArray

2017-03-19 Thread Johan Mabille (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929991#comment-15929991 ] Johan Mabille edited comment on ARROW-602 at 3/20/17 1:19 AM: --

[jira] [Created] (ARROW-664) Make C++ Arrow serialization deterministic

2017-03-19 Thread Philipp Moritz (JIRA)
Philipp Moritz created ARROW-664: Summary: Make C++ Arrow serialization deterministic Key: ARROW-664 URL: https://issues.apache.org/jira/browse/ARROW-664 Project: Apache Arrow Issue Type: Imp

[jira] [Assigned] (ARROW-655) Implement DecimalArray

2017-03-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-655: -- Assignee: Phillip Cloud > Implement DecimalArray > -- > > Ke

[jira] [Commented] (ARROW-661) [C++] Add a Flatbuffer metadata type that supports array data over 2^31 - 1 elements

2017-03-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932013#comment-15932013 ] Wes McKinney commented on ARROW-661: PR: https://github.com/apache/arrow/pull/404 > [C

Re: Arrow based data access

2017-03-19 Thread Todd Lipcon
Hi folks, I'm not sure Kudu integration is a high priority yet for most of us working on the project, but we'd be happy to have contributions from the Arrow community. My worry about the "standard network interface" approach is that it's going to be rather hard to keep it efficient while also giv

Re: Arrow based data access

2017-03-19 Thread Wes McKinney
hi Julien, Having standard RPC/REST messaging protocols for systems to implement sounds like a great idea to me. Some systems might choose to pack Arrow files or streams into a Protocol Buffer or Thrift message, but it would be good to have a "native" protocol for the streaming file format in part