Re: [QUESTION] Best way to attach debugger to CPP tests?

2018-09-21 Thread Wes McKinney
This seems to be a known issue with Xcode https://stackoverflow.com/questions/39680320/printing-debugging-libc-stl-with-xcode-lldb There might be a way to configure Xcode to emit more debug symbols but the best way is probably to develop on Linux in Docker or in a VM On Sep 21, 2018 9:00 PM, "A

Re: [QUESTION] Best way to attach debugger to CPP tests?

2018-09-21 Thread Atri Sharma
MacOS High Sierra. If you do a build (/debug, make) and then attach lldb to a test (lldb -- compute_test), then try to access a class's members (e.g. ArrayData's buffers), the error pops up. On Sat, Sep 22, 2018 at 9:26 AM Wes McKinney wrote: > > What platform are you developing on (OS, compiler,

Re: [QUESTION] Best way to attach debugger to CPP tests?

2018-09-21 Thread Wes McKinney
What platform are you developing on (OS, compiler, etc)? Can you show exact steps to arrive at the error? Thanks On Fri, Sep 21, 2018, 8:46 PM Atri Sharma wrote: > Hi Wes. > > Thanks, your command worked and I am able to attach a debugger. > However, I get the following error for some operation

Re: [QUESTION] Best way to attach debugger to CPP tests?

2018-09-21 Thread Atri Sharma
Hi Wes. Thanks, your command worked and I am able to attach a debugger. However, I get the following error for some operations: error: Couldn't lookup symbols: __ZNKSt3__110shared_ptrIN5arrow5ArrayEEptEv It seems that not all symbols are being loaded. I did a debug build (according to README)

[jira] [Created] (ARROW-3299) [C++] Appveyor builds failing

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3299: --- Summary: [C++] Appveyor builds failing Key: ARROW-3299 URL: https://issues.apache.org/jira/browse/ARROW-3299 Project: Apache Arrow Issue Type: Bug C

[jira] [Created] (ARROW-3298) [C++] Move murmur3 hash implementation to arrow/util

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3298: --- Summary: [C++] Move murmur3 hash implementation to arrow/util Key: ARROW-3298 URL: https://issues.apache.org/jira/browse/ARROW-3298 Project: Apache Arrow Issue

[jira] [Created] (ARROW-3297) [Python] Python bindings for Flight C++ client

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3297: --- Summary: [Python] Python bindings for Flight C++ client Key: ARROW-3297 URL: https://issues.apache.org/jira/browse/ARROW-3297 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-3296) [Python] Add Flight support to manylinux1 wheels

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3296: --- Summary: [Python] Add Flight support to manylinux1 wheels Key: ARROW-3296 URL: https://issues.apache.org/jira/browse/ARROW-3296 Project: Apache Arrow Issue Typ

[jira] [Created] (ARROW-3295) [Packaging] Package gRPC libraries in conda-forge for use in builds, packaging

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3295: --- Summary: [Packaging] Package gRPC libraries in conda-forge for use in builds, packaging Key: ARROW-3295 URL: https://issues.apache.org/jira/browse/ARROW-3295 Project: A

[jira] [Created] (ARROW-3292) [C++] Test Flight RPC in Travis CI

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3292: --- Summary: [C++] Test Flight RPC in Travis CI Key: ARROW-3292 URL: https://issues.apache.org/jira/browse/ARROW-3292 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-3293) [C++] Test Flight RPC in Travis CI

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3293: --- Summary: [C++] Test Flight RPC in Travis CI Key: ARROW-3293 URL: https://issues.apache.org/jira/browse/ARROW-3293 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-3294) [C++] Test Flight RPC on Windows / Appveyor

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3294: --- Summary: [C++] Test Flight RPC on Windows / Appveyor Key: ARROW-3294 URL: https://issues.apache.org/jira/browse/ARROW-3294 Project: Apache Arrow Issue Type: Im

[jira] [Created] (ARROW-3291) [C++] Convenience API for constructing arrow::io::BufferReader from std::string

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3291: --- Summary: [C++] Convenience API for constructing arrow::io::BufferReader from std::string Key: ARROW-3291 URL: https://issues.apache.org/jira/browse/ARROW-3291 Project:

[jira] [Created] (ARROW-3290) [C++] Toolchain support for secure gRPC

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3290: --- Summary: [C++] Toolchain support for secure gRPC Key: ARROW-3290 URL: https://issues.apache.org/jira/browse/ARROW-3290 Project: Apache Arrow Issue Type: Impro

[jira] [Created] (ARROW-3289) [C++] Implement DoPut command for Flight on client and server side

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3289: --- Summary: [C++] Implement DoPut command for Flight on client and server side Key: ARROW-3289 URL: https://issues.apache.org/jira/browse/ARROW-3289 Project: Apache Arro

[jira] [Created] (ARROW-3288) [GLib] Add new API index for 0.11.0

2018-09-21 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-3288: --- Summary: [GLib] Add new API index for 0.11.0 Key: ARROW-3288 URL: https://issues.apache.org/jira/browse/ARROW-3288 Project: Apache Arrow Issue Type: Improvemen

[jira] [Created] (ARROW-3287) [C++] "redeclared without dllimport attribute after being referenced with dll linkage" with MinGW

2018-09-21 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-3287: --- Summary: [C++] "redeclared without dllimport attribute after being referenced with dll linkage" with MinGW Key: ARROW-3287 URL: https://issues.apache.org/jira/browse/ARROW-3287

[jira] [Created] (ARROW-3286) [C++] ARROW_EXPORT for RecordBatchBuilder is missing

2018-09-21 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-3286: --- Summary: [C++] ARROW_EXPORT for RecordBatchBuilder is missing Key: ARROW-3286 URL: https://issues.apache.org/jira/browse/ARROW-3286 Project: Apache Arrow Issue

[jira] [Created] (ARROW-3285) [GLib] Add arrow_cpp_build_type and arrow_cpp_build_dir Meson options

2018-09-21 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-3285: --- Summary: [GLib] Add arrow_cpp_build_type and arrow_cpp_build_dir Meson options Key: ARROW-3285 URL: https://issues.apache.org/jira/browse/ARROW-3285 Project: Apache Arr

[jira] [Created] (ARROW-3284) [R] Adding R Error in Status

2018-09-21 Thread JIRA
Romain François created ARROW-3284: -- Summary: [R] Adding R Error in Status Key: ARROW-3284 URL: https://issues.apache.org/jira/browse/ARROW-3284 Project: Apache Arrow Issue Type: New Feature

Re: Getting some more eyes on the R bindings work

2018-09-21 Thread Romain François
Some of those lines are generated automatically by roxygen, and some of them are the license headers ;-) Still the pr is substantial, esp compared to the previous one. Let me know if I can help the process, e.g. write some notes about how R6 is used, the very low level bindings is quite mecha

Re: [JAVA] Total row count of an Arrow file

2018-09-21 Thread Wes McKinney
It would be nice to have an API to look at the file footer (we don't have one in C++ either), I opened https://issues.apache.org/jira/browse/ARROW-3283 On Fri, Sep 21, 2018 at 10:32 AM Li Jin wrote: > > Hi Michael, > > I think ArrowFileReader takes SeekableByteChannel so it's possible to only > r

[jira] [Created] (ARROW-3283) [Java] Provide API for inspecting IPC file footer metadata

2018-09-21 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3283: --- Summary: [Java] Provide API for inspecting IPC file footer metadata Key: ARROW-3283 URL: https://issues.apache.org/jira/browse/ARROW-3283 Project: Apache Arrow

Getting some more eyes on the R bindings work

2018-09-21 Thread Wes McKinney
Romain just submitted a ~4500 line R patch https://github.com/apache/arrow/pull/2596 I am going to do my best to give feedback, particularly at the C++ binding level, but it would be great to get some more eyes on the R-level API. As one detail, R6 classes are being used to create the wrapper int

[jira] [Created] (ARROW-3282) initial R functionality

2018-09-21 Thread JIRA
Romain François created ARROW-3282: -- Summary: initial R functionality Key: ARROW-3282 URL: https://issues.apache.org/jira/browse/ARROW-3282 Project: Apache Arrow Issue Type: New Feature

Re: [JAVA] Total row count of an Arrow file

2018-09-21 Thread Li Jin
Hi Michael, I think ArrowFileReader takes SeekableByteChannel so it's possible to only read the metadata for each record batches and skip the data. However it is not implemented. If the input Channel is not seekable (for example, a socket channel) then you would need to read the body for each rec

[JAVA] Total row count of an Arrow file

2018-09-21 Thread Michael Knopf
Hi all, I am looking for a quick way to look up the total row count of a data set stored in Arrow’s random access file format using the Java API. Basically, a quicker way to do this: // The reader is in an instance of ArrowFileReader List blocks = reader.getRecordBlocks(); int nRows = 0; for (A

[jira] [Created] (ARROW-3281) [Java] Make sure that WritableByteChannel in WriteChannel writes out complete bytes

2018-09-21 Thread Animesh Trivedi (JIRA)
Animesh Trivedi created ARROW-3281: -- Summary: [Java] Make sure that WritableByteChannel in WriteChannel writes out complete bytes Key: ARROW-3281 URL: https://issues.apache.org/jira/browse/ARROW-3281