[jira] [Created] (ARROW-6143) [Java] Unify the copyFrom and copyFromSafe methods for all vectors

2019-08-05 Thread Liya Fan (JIRA)
Liya Fan created ARROW-6143: --- Summary: [Java] Unify the copyFrom and copyFromSafe methods for all vectors Key: ARROW-6143 URL: https://issues.apache.org/jira/browse/ARROW-6143 Project: Apache Arrow

[jira] [Created] (ARROW-6142) [R] Install instructions on linux could be clearer

2019-08-05 Thread Karl Dunkle Werner (JIRA)
Karl Dunkle Werner created ARROW-6142: - Summary: [R] Install instructions on linux could be clearer Key: ARROW-6142 URL: https://issues.apache.org/jira/browse/ARROW-6142 Project: Apache Arrow

[GitHub] [arrow-site] nealrichardson commented on a change in pull request #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site

2019-08-05 Thread GitBox
nealrichardson commented on a change in pull request #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site URL: https://github.com/apache/arrow-site/pull/7#discussion_r310816056 ## File path: assets/.sprockets-manifest-af5b3e33562477ba4f207e3ea1e798c0.

[GitHub] [arrow-site] kou commented on a change in pull request #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site

2019-08-05 Thread GitBox
kou commented on a change in pull request #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site URL: https://github.com/apache/arrow-site/pull/7#discussion_r310807654 ## File path: assets/.sprockets-manifest-af5b3e33562477ba4f207e3ea1e798c0.json #

Re: Proposal to move website source to arrow-site, add automatic builds

2019-08-05 Thread Joris Van den Bossche
This sounds as a good proposal to me (at least at the moment where we have separate docs and main site). I agree that documentation should indeed stay with the code, as you want to update those together in PRs. But the website is something you can typically update separately and also might want to

[jira] [Created] (ARROW-6141) [C++] Enable memory-mapping a file region that is offset from the beginning of the file

2019-08-05 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-6141: --- Summary: [C++] Enable memory-mapping a file region that is offset from the beginning of the file Key: ARROW-6141 URL: https://issues.apache.org/jira/browse/ARROW-6141 P

[C++] Organizing JIRA issues and work related to the "Datasets" C++ subproject

2019-08-05 Thread Wes McKinney
hi all, I just put together a document to help with creating and organizing JIRA issues related to the Datasets project that we've been discussing over the last 6 months https://docs.google.com/document/d/1QOuz_6rIUskM0Dcxk5NwP8KhKn_qK6o_rFV3fbHQ_AM/edit?usp=sharing I've left out work relating t

Re: Proposal to move website source to arrow-site, add automatic builds

2019-08-05 Thread Wes McKinney
Let's wait a little while to collect any additional opinions about this. There's pretty good evidence from other Apache projects that this isn't too bad of an idea Apache Calcite: https://github.com/apache/calcite-site Apache Kafka: https://github.com/apache/kafka-site Apache Spark: https://githu

[GitHub] [arrow-site] wesm closed pull request #8: ARROW-4473: [Website] Support test site deployment

2019-08-05 Thread GitBox
wesm closed pull request #8: ARROW-4473: [Website] Support test site deployment URL: https://github.com/apache/arrow-site/pull/8 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [arrow-site] fsaintjacques commented on a change in pull request #8: ARROW-4473: [Website] Support test site deployment

2019-08-05 Thread GitBox
fsaintjacques commented on a change in pull request #8: ARROW-4473: [Website] Support test site deployment URL: https://github.com/apache/arrow-site/pull/8#discussion_r310730531 ## File path: build-and-deploy.sh ## @@ -0,0 +1,51 @@ +#!/bin/bash +set -ev + +if [ "${TRAVIS_B

[GitHub] [arrow-site] nealrichardson commented on a change in pull request #8: ARROW-4473: [Website] Support test site deployment

2019-08-05 Thread GitBox
nealrichardson commented on a change in pull request #8: ARROW-4473: [Website] Support test site deployment URL: https://github.com/apache/arrow-site/pull/8#discussion_r310729936 ## File path: build-and-deploy.sh ## @@ -0,0 +1,51 @@ +#!/bin/bash +set -ev + +if [ "${TRAVIS_

[jira] [Created] (ARROW-6140) [C++][Parquet] Support direct dictionary decoding of types other than BYTE_ARRAY

2019-08-05 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-6140: --- Summary: [C++][Parquet] Support direct dictionary decoding of types other than BYTE_ARRAY Key: ARROW-6140 URL: https://issues.apache.org/jira/browse/ARROW-6140 Project:

[GitHub] [arrow-site] fsaintjacques commented on a change in pull request #8: ARROW-4473: [Website] Support test site deployment

2019-08-05 Thread GitBox
fsaintjacques commented on a change in pull request #8: ARROW-4473: [Website] Support test site deployment URL: https://github.com/apache/arrow-site/pull/8#discussion_r310724697 ## File path: build-and-deploy.sh ## @@ -0,0 +1,51 @@ +#!/bin/bash +set -ev + +if [ "${TRAVIS_B

[GitHub] [arrow-site] fsaintjacques commented on a change in pull request #8: ARROW-4473: [Website] Support test site deployment

2019-08-05 Thread GitBox
fsaintjacques commented on a change in pull request #8: ARROW-4473: [Website] Support test site deployment URL: https://github.com/apache/arrow-site/pull/8#discussion_r310727786 ## File path: build-and-deploy.sh ## @@ -0,0 +1,51 @@ +#!/bin/bash +set -ev + +if [ "${TRAVIS_B

[GitHub] [arrow-site] nealrichardson opened a new pull request #8: ARROW-4473: [Website] Support test site deployment

2019-08-05 Thread GitBox
nealrichardson opened a new pull request #8: ARROW-4473: [Website] Support test site deployment URL: https://github.com/apache/arrow-site/pull/8 See https://lists.apache.org/thread.html/73e8a7d2ee667e83371e8bb99c13338144c8af5444f55918994713be@%3Cdev.arrow.apache.org%3E ---

[GitHub] [arrow-site] nealrichardson commented on issue #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site

2019-08-05 Thread GitBox
nealrichardson commented on issue #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site URL: https://github.com/apache/arrow-site/pull/7#issuecomment-518334974 > Currently there are no links to and from the main arrow.apache.org/docs/ site, but I'd like to ta

[GitHub] [arrow-site] fsaintjacques commented on issue #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site

2019-08-05 Thread GitBox
fsaintjacques commented on issue #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site URL: https://github.com/apache/arrow-site/pull/7#issuecomment-518332661 I don't see the R documentation in the drop-down menu of documentations. ---

[GitHub] [arrow-site] nealrichardson commented on issue #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site

2019-08-05 Thread GitBox
nealrichardson commented on issue #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site URL: https://github.com/apache/arrow-site/pull/7#issuecomment-518327887 Full site preview at https://enpiar.com/arrow-site/ and R docs at https://enpiar.com/arrow-site/doc

[GitHub] [arrow-site] nealrichardson opened a new pull request #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site

2019-08-05 Thread GitBox
nealrichardson opened a new pull request #7: ARROW-6139: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site URL: https://github.com/apache/arrow-site/pull/7 This renders the site that was configured in https://issues.apache.org/jira/browse/ARROW-5452, using the 0.14.1 R C

[jira] [Created] (ARROW-6139) [Documentation][R] Build R docs (pkgdown) site and add to arrow-site

2019-08-05 Thread Neal Richardson (JIRA)
Neal Richardson created ARROW-6139: -- Summary: [Documentation][R] Build R docs (pkgdown) site and add to arrow-site Key: ARROW-6139 URL: https://issues.apache.org/jira/browse/ARROW-6139 Project: Apach

[jira] [Created] (ARROW-6138) [C++] Add a basic (single RecordBatch) implementation of Dataset

2019-08-05 Thread Benjamin Kietzman (JIRA)
Benjamin Kietzman created ARROW-6138: Summary: [C++] Add a basic (single RecordBatch) implementation of Dataset Key: ARROW-6138 URL: https://issues.apache.org/jira/browse/ARROW-6138 Project: Apach

[jira] [Created] (ARROW-6137) [C++][Gandiva] Change output format of castVARCHAR(timestamp) in Gandiva

2019-08-05 Thread Prudhvi Porandla (JIRA)
Prudhvi Porandla created ARROW-6137: --- Summary: [C++][Gandiva] Change output format of castVARCHAR(timestamp) in Gandiva Key: ARROW-6137 URL: https://issues.apache.org/jira/browse/ARROW-6137 Project:

Re: [Discuss] IPC Specification, flatbuffers and unaligned memory accesses

2019-08-05 Thread Wes McKinney
I'm going to review Micah's Format PR and propose a vote. I would like to take on the C++ implementation of this in the near future. On Mon, Jul 29, 2019 at 11:34 AM Antoine Pitrou wrote: > > > Le 29/07/2019 à 18:32, Wes McKinney a écrit : > > > > We have a version number in the metadata already

Re: [C++][Python] Direct Arrow DictionaryArray reads from Parquet files

2019-08-05 Thread Wes McKinney
hi Hatem -- I was planning to look at the round-trip question here early this week, since I have all the code fresh in my mind let me have a look and I'll report back. Accurately preserving the original dictionary in a round trip tricky because the low-level column writer doesn't expose any detail

[jira] [Created] (ARROW-6136) [FlightRPC][Java] Don't double-close response stream

2019-08-05 Thread lidavidm (JIRA)
lidavidm created ARROW-6136: --- Summary: [FlightRPC][Java] Don't double-close response stream Key: ARROW-6136 URL: https://issues.apache.org/jira/browse/ARROW-6136 Project: Apache Arrow Issue Type: B

Re: [C++][Python] Direct Arrow DictionaryArray reads from Parquet files

2019-08-05 Thread Hatem Helal
Thanks for sharing this very illustrative benchmark. Really nice to see the huge benefit for languages that have a type for modelling categorical data. I'm interested in whether we can make the parquet/arrow integration automatically handle the round-trip for Arrow DictionaryArrays. We've had

[jira] [Created] (ARROW-6135) [C++] KeyValueMetadata::Equals should not be order-sensitive

2019-08-05 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-6135: - Summary: [C++] KeyValueMetadata::Equals should not be order-sensitive Key: ARROW-6135 URL: https://issues.apache.org/jira/browse/ARROW-6135 Project: Apache Arrow

[jira] [Created] (ARROW-6134) [C++][Gandiva] Add concat function in Gandiva

2019-08-05 Thread Prudhvi Porandla (JIRA)
Prudhvi Porandla created ARROW-6134: --- Summary: [C++][Gandiva] Add concat function in Gandiva Key: ARROW-6134 URL: https://issues.apache.org/jira/browse/ARROW-6134 Project: Apache Arrow Issu

[jira] [Created] (ARROW-6133) Schema Missing Exception in ArrowStreamReader

2019-08-05 Thread Boris V.Kuznetsov (JIRA)
Boris V.Kuznetsov created ARROW-6133: Summary: Schema Missing Exception in ArrowStreamReader Key: ARROW-6133 URL: https://issues.apache.org/jira/browse/ARROW-6133 Project: Apache Arrow Is

[jira] [Created] (ARROW-6132) [Python] ListArray.from_arrays does not check validity of input arrays

2019-08-05 Thread Joris Van den Bossche (JIRA)
Joris Van den Bossche created ARROW-6132: Summary: [Python] ListArray.from_arrays does not check validity of input arrays Key: ARROW-6132 URL: https://issues.apache.org/jira/browse/ARROW-6132