Re: Arrow client C++ Samples with Arrow APIs for Research work

2016-08-09 Thread Wes McKinney
Critically, the data structures offer APIs to access to the internal contiguous memory buffers in each array: e.g. https://github.com/apache/arrow/blob/master/cpp/src/arrow/types/primitive.h#L89 That the library operates with contiguous arrays as primitive unit of data is what makes the access pa

[jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-09 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414445#comment-15414445 ] Wes McKinney commented on ARROW-81: --- A couple more notes on this: While creating the Feat

Re: Discussion: Should we make string/binary types first class Arrow Array types?

2016-08-09 Thread Wes McKinney
hi Micah I'm sorry for dropping the ball on this discussion. copying Julien as he's been looking at the metadata recently. My thinking is that we should indicate in the format document that the String and Binary logical types, as a matter of cross-implementation convention, will have List memory

Re: Building 64 bit Arrow

2016-08-09 Thread Wes McKinney
It's possible that on your platform that something like "-m64" may need to be passed when compiling / linking gbenchmark. I'm assuming this in on SPARC? Not many developers have access to this architecture for testing. Note you can examine the ELF headers of a .a or .so file using readelf readelf

Re: Arrow client C++ Samples with Arrow APIs for Research work

2016-08-09 Thread Philip
Hi Sanjay, Vectorized access is in many places. Just poke around the source and have a look! You can see examples of the use of std::vector, if that's what you mean, in the implementation of Column in https://github.com/apache/arrow/blob/master/cpp/src/arrow/column.cc Another answer is that hard

Re: regular arrow sync up

2016-08-09 Thread Uwe L. Korn
+1 for bi-weekly and europeen friendly times: CET (GMT+1) > Am 09.08.2016 um 00:39 schrieb Julien Le Dem : > > Also to all who are responding let me know your timezone as well. > > On Mon, Aug 8, 2016 at 3:30 PM, Micah Kornfield > wrote: > >> Sounds good to me as well. Biweekly would be prefe

Building 64 bit Arrow

2016-08-09 Thread Sanjay Rao
Hi, I am in process of building 64 bit Arrow CPP version, I could get all thridparties compiled, now facing below error [ 63%] Built target arrow_benchmark_mainLinking CXX executable ../../debug/column-benchmarkld: warning: file ../../../thirdparty/benchmark-1.0.0/libbenchmark.a(benchmark.cc.o):

RE: Arrow client C++ Samples with Arrow APIs for Research work

2016-08-09 Thread Sanjay Rao
Thanks Julien, Can you please point me in source code(or name of CPP file) where can I see what Vectorized access is currently in place for Arrow ? Thanks,Sanjay > From: jul...@dremio.com > Date: Mon, 8 Aug 2016 15:49:35 -0700 > Subject: Re: Arrow client C++ Samples with Arrow APIs for Research