Table of tensors with Arrow

In Petastorm we operate with tables of tensors. We are trying to map this data structure into Arrow's primitives. One way is to use pa.array of BinaryValue type while using FixedSizeBufferWriter to serialize a pa.Tensor type into it and deserialize it on read. This feels somewhat ackward and I gues

[jira] [Created] (ARROW-3591) [R] Support to collect decimal type

Javier Luraschi created ARROW-3591: -- Summary: [R] Support to collect decimal type Key: ARROW-3591 URL: https://issues.apache.org/jira/browse/ARROW-3591 Project: Apache Arrow Issue Type: Impr

Re: [RESULT] [VOTE] Release Apache Arrow 0.11.1 (RC0)

Hi, > * Update the linux packages I take this task. Thanks, -- kou In "[RESULT] [VOTE] Release Apache Arrow 0.11.1 (RC0)" on Mon, 22 Oct 2018 18:15:23 -0400, Wes McKinney wrote: > hi folks, > > With 4 binding +1 votes and 1 non-binding +1, I am closing the vote > early in the interest

Re: Limited availability the next 2 weeks

unsubscribe On Mon, Oct 22, 2018 at 1:26 PM Wes McKinney wrote: > Hi folks -- I am traveling internationally the next 2 weeks to conferences > and will be on vacation for a part of the time, so I won't be as responsive > on patch maintenance. I'll be sprinting a bit at the PyCon DE / PyData > Ka

Re: [jira] [Created] (ARROW-3590) Expose Python API for start and end offset of row group in parquet file

unsubscribe On Mon, Oct 22, 2018 at 4:51 PM Heejong Lee (JIRA) wrote: > Heejong Lee created ARROW-3590: > -- > > Summary: Expose Python API for start and end offset of row > group in parquet file > Key: ARROW-3590 > U

[jira] [Created] (ARROW-3590) Expose Python API for start and end offset of row group in parquet file

Heejong Lee created ARROW-3590: -- Summary: Expose Python API for start and end offset of row group in parquet file Key: ARROW-3590 URL: https://issues.apache.org/jira/browse/ARROW-3590 Project: Apache Arr

[jira] [Created] (ARROW-3589) [Gandiva] Make it possible to compile gandiva without JNI

Philipp Moritz created ARROW-3589: - Summary: [Gandiva] Make it possible to compile gandiva without JNI Key: ARROW-3589 URL: https://issues.apache.org/jira/browse/ARROW-3589 Project: Apache Arrow

[jira] [Created] (ARROW-3588) [Java] checkstyle - fix license

Bryan Cutler created ARROW-3588: --- Summary: [Java] checkstyle - fix license Key: ARROW-3588 URL: https://issues.apache.org/jira/browse/ARROW-3588 Project: Apache Arrow Issue Type: Sub-task

[RESULT] [VOTE] Release Apache Arrow 0.11.1 (RC0)

hi folks, With 4 binding +1 votes and 1 non-binding +1, I am closing the vote early in the interest of pushing out this bugfix release. I don't think fanfare is necessary with this release -- we can update the packages, update the website, and announce that new binaries are available on social me

Limited availability the next 2 weeks

Hi folks -- I am traveling internationally the next 2 weeks to conferences and will be on vacation for a part of the time, so I won't be as responsive on patch maintenance. I'll be sprinting a bit at the PyCon DE / PyData Karlsruhe sprints -- I might try to do some work on Flight rather than doing

[jira] [Created] (ARROW-3587) Efficient serialization for Arrow Objects (array, table, tensor, etc)

Siyuan Zhuang created ARROW-3587: Summary: Efficient serialization for Arrow Objects (array, table, tensor, etc) Key: ARROW-3587 URL: https://issues.apache.org/jira/browse/ARROW-3587 Project: Apache A

Re: Issue with GitHub PR

Ah, ok thanks. Get Outlook for iOS From: Antoine Pitrou Sent: Monday, October 22, 2018 11:00 AM To: dev@arrow.apache.org Subject: Re: Issue with GitHub PR Le 22/10/2018 à 16:53, paddy horan a écrit : > Hey all, > > I created a PR for ARRO

Re: Issue with GitHub PR

Le 22/10/2018 à 16:53, paddy horan a écrit : > Hey all, > > I created a PR for ARROW-3541, after addressing review comments i rebased and > force pushed to my branch. GitHub seems to be having issues though, the PR is > not updating and i don’t believe CI was re-triggered. Looking at the PR no

Re: Issue with GitHub PR

hi, On Mon, Oct 22, 2018 at 4:54 PM paddy horan wrote: > Hey all, > > I created a PR for ARROW-3541, after addressing review comments i rebased > and force pushed to my branch. GitHub seems to be having issues though, the > PR is not updating and i don’t believe CI was re-triggered. Looking at t

Issue with GitHub PR

Hey all, I created a PR for ARROW-3541, after addressing review comments i rebased and force pushed to my branch. GitHub seems to be having issues though, the PR is not updating and i don’t believe CI was re-triggered. Looking at the PR now comments I made this morning are not showing up and co

[jira] [Created] (ARROW-3586) Segmentation fault when converting empty table to pandas with categoricals

Andreas created ARROW-3586: -- Summary: Segmentation fault when converting empty table to pandas with categoricals Key: ARROW-3586 URL: https://issues.apache.org/jira/browse/ARROW-3586 Project: Apache Arrow

Re: [VOTE] Release Apache Arrow 0.11.1 (RC0)

Hi, I tried: * ./dev/release/verify-release-candidate.sh binaries 0.11.1 0 -> worked * ./dev/release/verify-release-candidate.sh source 0.11.1 0 -> failed in test_plasma.py (but nothing new here) This is on Ubuntu 18.04. $ nodejs --version v8.10.0 $ ruby --version ruby 2.5.1p57 (2018-03-29 rev

Re: Update to crates.io

Great, thanks Andy Get Outlook for iOS From: Andy Grove Sent: Sunday, October 21, 2018 11:45 PM To: dev@arrow.apache.org Subject: Re: Update to crates.io I'd be happy to take a look at this tomorrow. I will also write up docs on the proces

[jira] [Created] (ARROW-3585) Update the documentation about Schema & Metadata usage

Daniel Haviv created ARROW-3585: --- Summary: Update the documentation about Schema & Metadata usage Key: ARROW-3585 URL: https://issues.apache.org/jira/browse/ARROW-3585 Project: Apache Arrow Iss

Re: [VOTE] Release Apache Arrow 0.11.1 (RC0)

+1 (binding) I ran the followings on Debian GNU/Linux sid: * ARROW_HAVE_GPU=no dev/release/verify-release-candidate.sh source 0.11.0 1 with: * gcc version 8.2.0 (Debian 8.2.0-1) * OpenJDK 1.8.0_181 * Ruby 2.6.0dev * NodeJS 10.8.0 Thanks, -- kou In "[VOTE] Release Apache Arrow 0.