[jira] [Resolved] (ARROW-382) Python: Extend API documentation

2016-11-21 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-382. Resolution: Fixed Issue resolved by pull request 208 [https://github.com/apache/arrow/pull/208] > Py

Question about MapWriter implementation

2016-11-21 Thread Jingyuan Wang
Hi, I have a question about this portion of code: https://github.com/apache/arrow/blob/bae33d622421e6377ab3e9c81dd054c796ab48a3/java/vector/src/main/codegen/templates/MapWriters.java#L174 Why converting all field names to lower case? My testing code ran into problem when the schema has two colum

Re: Question about MapWriter implementation

2016-11-21 Thread Hanifi GUNES
The default behavior seems case insensitive. I think casing should be application dependent though. I would like to know what others think though. In the meantime, feel free to go ahead and file a JIRA. Thanks. -Hanifi 2016-11-21 11:48 GMT-08:00 Jingyuan Wang : > Hi, > > I have a question about

Java-C++ integration tests -- on the home stretch

2016-11-21 Thread Wes McKinney
hi folks, After a long road, we're getting very close to having tests proving that the Java and C++ Arrow implementations are binary compatible -- this will be an exciting major milestone for the project. If you haven't been following along recent JIRAs, the way these tests work is as follows: 1)

[jira] [Resolved] (ARROW-383) [C++] Implement C++ version of ARROW-367 integration test validator

2016-11-21 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-383. Resolution: Fixed Issue resolved by pull request 209 [https://github.com/apache/arrow/pull/209] > [C

Re: Java-C++ integration tests -- on the home stretch

2016-11-21 Thread Julien Le Dem
Great! Looking at your PR and opening JIRAs. On Mon, Nov 21, 2016 at 2:05 PM, Wes McKinney wrote: > hi folks, > > After a long road, we're getting very close to having tests proving > that the Java and C++ Arrow implementations are binary compatible -- > this will be an exciting major milestone

[jira] [Created] (ARROW-384) Align Java and C++ RecordBatch data and metadata layout

2016-11-21 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-384: --- Summary: Align Java and C++ RecordBatch data and metadata layout Key: ARROW-384 URL: https://issues.apache.org/jira/browse/ARROW-384 Project: Apache Arrow Issu

[jira] [Commented] (ARROW-384) Align Java and C++ RecordBatch data and metadata layout

2016-11-21 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685108#comment-15685108 ] Julien Le Dem commented on ARROW-384: - Here is a 3rd suggestion: {noformat} {noform

Re: Weld

2016-11-21 Thread Hanifi GUNES
Looks interesting. I see some commonalities. I hope the original work (in progress?) will make references to Arrow so that we will all know the distinguishing points better. 2016-11-20 8:31 GMT-08:00 Donald E. Foss : > Thanks Julian. Sounds worth a listen. > > Donald E. Foss (mobile-US ET) > > >

[jira] [Commented] (ARROW-384) Align Java and C++ RecordBatch data and metadata layout

2016-11-21 Thread Jacques Nadeau (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685289#comment-15685289 ] Jacques Nadeau commented on ARROW-384: -- +1 on this approach. > Align Java and C++ Re

Re: Java-C++ integration tests -- on the home stretch

2016-11-21 Thread Ted Dunning
Wes, This is awesome. Does it, however, imply that to run the tests that a C programmer will need a working Java environment and a Java programmer will need a C environment? Is there any way around that? Possibly by storing golden bits for the in-memory images somewhere? On Mon, Nov 21, 201

Re: Java-C++ integration tests -- on the home stretch

2016-11-21 Thread Wes McKinney
hey Ted On Mon, Nov 21, 2016 at 8:20 PM, Ted Dunning wrote: > Wes, > > This is awesome. > > Does it, however, imply that to run the tests that a C programmer will need > a working Java environment and a Java programmer will need a C environment? > > Is there any way around that? Possibly by stori

[jira] [Created] (ARROW-385) Refactor metrics system

2016-11-21 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-385: Summary: Refactor metrics system Key: ARROW-385 URL: https://issues.apache.org/jira/browse/ARROW-385 Project: Apache Arrow Issue Type: Improvement

[jira] [Commented] (ARROW-384) Align Java and C++ RecordBatch data and metadata layout

2016-11-21 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685423#comment-15685423 ] Wes McKinney commented on ARROW-384: This seems reasonable, and saves you from always r

[jira] [Comment Edited] (ARROW-384) Align Java and C++ RecordBatch data and metadata layout

2016-11-21 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685423#comment-15685423 ] Wes McKinney edited comment on ARROW-384 at 11/22/16 2:08 AM: --