>
> I wonder how arrow deals with gaps among different implementations? Say,
> C++ lib implements some features go lib doesn't support. Is there a
> consistent API document, or documents for each language implementation?
It is important to distinguish between two types of functionality:
1. Suppo
Hi Wes,
On 10/30/19 10:24 PM, Wes McKinney wrote:
hi Yibo
On Wed, Oct 30, 2019 at 2:16 AM Yibo Cai wrote:
Hi,
I'm new to Arrow. Would like to seek for help about some questions. Any comment
is welcomed.
- About source code tree, my understand is that "cpp" is the core arrow libraries,
"c
Prudhvi Porandla created ARROW-7099:
---
Summary: [C++] Disambiguate function calls in csv parser test
Key: ARROW-7099
URL: https://issues.apache.org/jira/browse/ARROW-7099
Project: Apache Arrow
The Apache Arrow project would like to hereby disclose that our 0.15.1
release patches two uninitialized bugs (CVE-2019-12408 and CVE-2019-12410)
in the the C++ implementation (which in turn can affect, Python, Ruby and
R). In both cases there is a potential vulnerability where data in memory
can
Liya Fan created ARROW-7098:
---
Summary: [Java] Improve the performance of comparing two memory
blocks
Key: ARROW-7098
URL: https://issues.apache.org/jira/browse/ARROW-7098
Project: Apache Arrow
Iss
Wes McKinney created ARROW-7097:
---
Summary: [Rust][CI] Builds failing due to rust nightly
Key: ARROW-7097
URL: https://issues.apache.org/jira/browse/ARROW-7097
Project: Apache Arrow
Issue Type:
Wes McKinney created ARROW-7096:
---
Summary: [C++] Add options structs for
concatenation-with-promotion and schema unification
Key: ARROW-7096
URL: https://issues.apache.org/jira/browse/ARROW-7096
Project
Thanks Antoine.
Do we need to hold a vote to adopt the C API? I will see if I can
review the C++ implementation prior to leaving for ~1 week of vacation
next Tuesday
On Thu, Nov 7, 2019 at 1:24 PM Antoine Pitrou wrote:
>
>
> Hello,
>
> The C data interface spec was updated following a suggestion
hi folks,
I recently merged https://github.com/apache/arrow/pull/4826 containing
the bulk of the Parquet C++ encrypted file implementation:
https://github.com/apache/arrow/commit/41753ace481a82dea651c54639ec4adbae169187
This patch has been in progress for over a year with numerous rounds
of revi
There are a few open PRs that I think could either use a first or second
set of eyes:
https://github.com/apache/arrow/pull/5630
https://github.com/apache/arrow/pull/5645
https://github.com/apache/arrow/pull/5751
Would some committers be willing to take a look?
Thanks,
Micah
I think the main sticking point was dictionaries in the file format. It
seems like the use-case for delta dictionaries might be limited so I didn't
feel strongly about it.
Antoine, did you have more thoughts on this?
Thanks,
Micah
On Wed, Nov 6, 2019 at 9:24 AM Wes McKinney wrote:
> Just bum
Neal Richardson created ARROW-7095:
--
Summary: [R] Better handling of unsupported filter expression in
dplyr methods
Key: ARROW-7095
URL: https://issues.apache.org/jira/browse/ARROW-7095
Project: Apac
Neal Richardson created ARROW-7094:
--
Summary: [R] Change FileSystem access in Datasets to shared_ptr
Key: ARROW-7094
URL: https://issues.apache.org/jira/browse/ARROW-7094
Project: Apache Arrow
Neal Richardson created ARROW-7093:
--
Summary: [R] Support creating ScalarExpressions for more data types
Key: ARROW-7093
URL: https://issues.apache.org/jira/browse/ARROW-7093
Project: Apache Arrow
Neal Richardson created ARROW-7092:
--
Summary: [R] Add vignette for dplyr and datasets
Key: ARROW-7092
URL: https://issues.apache.org/jira/browse/ARROW-7092
Project: Apache Arrow
Issue Type:
Hi,
> - centos-7:
> URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-07-0-azure-centos-7
I've opened an issue for this:
https://issues.apache.org/jira/browse/PARQUET-1688
It's caused by https://github.com/apache/arrow/pull/5699 .
It seems that g++ 4.8.5 doesn't
Hello,
The C data interface spec was updated following a suggestion
by Wes and Uwe:
https://github.com/apache/arrow/blob/3173f88dfa32ce3296a121b032f351e089888601/docs/source/format/CDataInterface.rst
The metadata encoding was changed. It does not use JSON anymore
but a very simple binary encod
Antoine Pitrou created ARROW-7091:
-
Summary: [C++] Move all factories to type_fwd.h
Key: ARROW-7091
URL: https://issues.apache.org/jira/browse/ARROW-7091
Project: Apache Arrow
Issue Type: Imp
Antoine Pitrou created ARROW-7090:
-
Summary: [C++] AssertFieldEqual (and friends) doesn't show
metadata on failure
Key: ARROW-7090
URL: https://issues.apache.org/jira/browse/ARROW-7090
Project: Apache
I've been extremely backlogged, I will update the proposal when I get
a chance and reply here when done.
Best,
David
On 11/7/19, Wes McKinney wrote:
> Bumping this discussion since a couple of weeks have passed. It seems
> there are still some questions here, could we summarize what are the
> al
Bumping this discussion since a couple of weeks have passed. It seems
there are still some questions here, could we summarize what are the
alternatives along with any public API implications so we can try to
render a decision?
On Sat, Oct 26, 2019 at 7:19 PM David Li wrote:
>
> Hi Wes,
>
> Respon
I just opened https://issues.apache.org/jira/browse/ARROW-7089 about
increasing transparency around what options are causing thirdparty
dependencies to be required
On Thu, Nov 7, 2019 at 10:05 AM Wes McKinney wrote:
>
> hi Richard,
>
> On Thu, Nov 7, 2019 at 9:59 AM Richard Bachmann
> wrote:
> >
Wes McKinney created ARROW-7089:
---
Summary: [C++] In CMake output, list each enabled thirdparty
toolchain dependency and the reason for its being enabled
Key: ARROW-7089
URL: https://issues.apache.org/jira/browse/ARR
hi Richard,
On Thu, Nov 7, 2019 at 9:59 AM Richard Bachmann
wrote:
>
> Hello,
> I'm contacting you on behalf of the LCG Releases team at CERN. We
> provide a common software stack for LHCb, ATLAS and others to be used at
> CERN and the worldwide computing grid.
>
> Right now we're looking into op
Hello,
I'm contacting you on behalf of the LCG Releases team at CERN. We
provide a common software stack for LHCb, ATLAS and others to be used at
CERN and the worldwide computing grid.
Right now we're looking into optimizing the way we're building Apache
Arrow (C++ & Python) and its dependenc
I opened https://issues.apache.org/jira/browse/ARROW-7088 about the
legitimate wheel build failures. Haven't looked at the others yet
On Thu, Nov 7, 2019 at 7:01 AM Crossbow wrote:
>
>
> Arrow Build Report for Job nightly-2019-11-07-0
>
> All tasks:
> https://github.com/ursa-labs/crossbow/branch
Wes McKinney created ARROW-7088:
---
Summary: [C++][Python] gcc 4.8 / wheel builds failing after
PARQUET-1678
Key: ARROW-7088
URL: https://issues.apache.org/jira/browse/ARROW-7088
Project: Apache Arrow
François Blanchard created ARROW-7087:
-
Summary: [Pyarrow] Table Metadata disappear when we write a
partitioned dataset
Key: ARROW-7087
URL: https://issues.apache.org/jira/browse/ARROW-7087
Projec
Ben Kietzman created ARROW-7086:
---
Summary: [C++] Provide a wrapper for invoking factories to produce
a Result
Key: ARROW-7086
URL: https://issues.apache.org/jira/browse/ARROW-7086
Project: Apache Arrow
Artem Alekseev created ARROW-7085:
-
Summary: [C++][CSV] Add support for Extention type in csv reader
Key: ARROW-7085
URL: https://issues.apache.org/jira/browse/ARROW-7085
Project: Apache Arrow
Arrow Build Report for Job nightly-2019-11-07-0
All tasks:
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-07-0
Failed Tasks:
- centos-7:
URL:
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-07-0-azure-centos-7
- conda-linux-gcc-py37:
URL:
Micah Kornfield created ARROW-7084:
--
Summary: [C++] ArrayRangeEquals should check for full type
equality?
Key: ARROW-7084
URL: https://issues.apache.org/jira/browse/ARROW-7084
Project: Apache Arrow
Hi Micah,
Thanks for bringing this up.
> 1. An efficient solution already exists? It seems like TransferPair
implementations could possibly be improved upon or have they already been
optimized?
Fundamnentally, memory copy is unavoidable, IMO, because the source and
targe memory regions are like
33 matches
Mail list logo