[jira] [Created] (ARROW-3323) [Java] checkstyle - fix naming

2018-09-24 Thread Bryan Cutler (JIRA)
Bryan Cutler created ARROW-3323: --- Summary: [Java] checkstyle - fix naming Key: ARROW-3323 URL: https://issues.apache.org/jira/browse/ARROW-3323 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-3322) [CI] Rust job always runs on AppVeyor

2018-09-24 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-3322: - Summary: [CI] Rust job always runs on AppVeyor Key: ARROW-3322 URL: https://issues.apache.org/jira/browse/ARROW-3322 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-3321) [C++] Improve integer parsing performance

2018-09-24 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-3321: - Summary: [C++] Improve integer parsing performance Key: ARROW-3321 URL: https://issues.apache.org/jira/browse/ARROW-3321 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-3320) [C++] Improve float parsing performance

2018-09-24 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-3320: - Summary: [C++] Improve float parsing performance Key: ARROW-3320 URL: https://issues.apache.org/jira/browse/ARROW-3320 Project: Apache Arrow Issue Type: Im

[jira] [Created] (ARROW-3319) [GLib] Expose AlignStream methods in InputStream, OutputStream classes

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3319: --- Summary: [GLib] Expose AlignStream methods in InputStream, OutputStream classes Key: ARROW-3319 URL: https://issues.apache.org/jira/browse/ARROW-3319 Project: Apache Ar

[jira] [Created] (ARROW-3318) [C++] Convenience method for reading all batches from an IPC stream or file as arrow::Table

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3318: --- Summary: [C++] Convenience method for reading all batches from an IPC stream or file as arrow::Table Key: ARROW-3318 URL: https://issues.apache.org/jira/browse/ARROW-3318

[jira] [Created] (ARROW-3317) [R] Test/support conversions from data.frame with a single character column exceeding 2GB capacity of BinaryArray

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3317: --- Summary: [R] Test/support conversions from data.frame with a single character column exceeding 2GB capacity of BinaryArray Key: ARROW-3317 URL: https://issues.apache.org/jira/browse

[jira] [Created] (ARROW-3316) [R] Multi-threaded conversion from R data.frame to Arrow table / record batch

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3316: --- Summary: [R] Multi-threaded conversion from R data.frame to Arrow table / record batch Key: ARROW-3316 URL: https://issues.apache.org/jira/browse/ARROW-3316 Project: Ap

[jira] [Created] (ARROW-3315) [R] Support for multi-threaded conversions from RecordBatch, Table to R data.frame

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3315: --- Summary: [R] Support for multi-threaded conversions from RecordBatch, Table to R data.frame Key: ARROW-3315 URL: https://issues.apache.org/jira/browse/ARROW-3315 Projec

[jira] [Created] (ARROW-3314) [R] Set -rpath using pkg-config when building

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3314: --- Summary: [R] Set -rpath using pkg-config when building Key: ARROW-3314 URL: https://issues.apache.org/jira/browse/ARROW-3314 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-3313) [R] Run clang-format, cpplint checks on R C++ code

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3313: --- Summary: [R] Run clang-format, cpplint checks on R C++ code Key: ARROW-3313 URL: https://issues.apache.org/jira/browse/ARROW-3313 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-3312) [R] Use same .clang-format file for both R binding C++ code and main C++ codebase

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3312: --- Summary: [R] Use same .clang-format file for both R binding C++ code and main C++ codebase Key: ARROW-3312 URL: https://issues.apache.org/jira/browse/ARROW-3312 Project

[jira] [Created] (ARROW-3311) [R] Functions for deserializing IPC components from arrow::Buffer or from IO interface

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3311: --- Summary: [R] Functions for deserializing IPC components from arrow::Buffer or from IO interface Key: ARROW-3311 URL: https://issues.apache.org/jira/browse/ARROW-3311 Pr

[jira] [Created] (ARROW-3310) [R] Create wrapper classes for various Arrow IO interfaces

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3310: --- Summary: [R] Create wrapper classes for various Arrow IO interfaces Key: ARROW-3310 URL: https://issues.apache.org/jira/browse/ARROW-3310 Project: Apache Arrow

[jira] [Created] (ARROW-3309) [JS] Missing links from DEVELOP.md

2018-09-24 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-3309: -- Summary: [JS] Missing links from DEVELOP.md Key: ARROW-3309 URL: https://issues.apache.org/jira/browse/ARROW-3309 Project: Apache Arrow Issue Type: Impro

[jira] [Created] (ARROW-3307) [R] Convert chunked arrow::Column to R vector

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3307: --- Summary: [R] Convert chunked arrow::Column to R vector Key: ARROW-3307 URL: https://issues.apache.org/jira/browse/ARROW-3307 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-3308) [R] Convert R character vector with data exceeding 2GB to chunked array

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3308: --- Summary: [R] Convert R character vector with data exceeding 2GB to chunked array Key: ARROW-3308 URL: https://issues.apache.org/jira/browse/ARROW-3308 Project: Apache A

[jira] [Created] (ARROW-3306) [R] Objects and support functions different kinds of arrow::Buffer

2018-09-24 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3306: --- Summary: [R] Objects and support functions different kinds of arrow::Buffer Key: ARROW-3306 URL: https://issues.apache.org/jira/browse/ARROW-3306 Project: Apache Arrow

[jira] [Created] (ARROW-3305) [JS] Incorrect development documentation link in javascript readme

2018-09-24 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-3305: -- Summary: [JS] Incorrect development documentation link in javascript readme Key: ARROW-3305 URL: https://issues.apache.org/jira/browse/ARROW-3305 Project: Apache

Re: Timeline for 0.11 Arrow release

2018-09-24 Thread Wes McKinney
hi all, The 0.11 release push seems to be winding down. I just put up a fairly high priority C++ patch (https://github.com/apache/arrow/pull/2615) containing a bunch of interrelated IPC fixes, careful review requested Out of the remaining issues, I have questions about: * ARROW-3175 -- upgrading

Re: [JAVA] Total row count of an Arrow file

2018-09-24 Thread Michael Knopf
Hi Li, Thanks for the explanation! I’ll keep the code as is for now (and an eye on ARROW-3283). As you pointed out, I’ll need another solution for streaming the table over a socket anyway. To clarify, my code does read the actual data in a second pass. However, doing so without knowing how m