[jira] [Created] (ARROW-7387) [C#] Support ListType Serialization

2019-12-12 Thread Takashi Hashida (Jira)
Takashi Hashida created ARROW-7387: -- Summary: [C#] Support ListType Serialization Key: ARROW-7387 URL: https://issues.apache.org/jira/browse/ARROW-7387 Project: Apache Arrow Issue Type: Impr

Re: [Gandiva] question about IR optimization

2019-12-12 Thread Ravindra Pindikura
On Wed, Dec 11, 2019 at 4:09 PM Yibo Cai wrote: > Hi, > > I'm trying to figure out how Gandiva works by tracing unit test > TestSimpleArichmetic[1]. > I met with a problem about Gandiva IR generator and optimizer, would like > to seek for > help from community. > > I'm focusing on case "b+1", whi

[jira] [Created] (ARROW-7386) [C#] Array offset does not work properly

2019-12-12 Thread Takashi Hashida (Jira)
Takashi Hashida created ARROW-7386: -- Summary: [C#] Array offset does not work properly Key: ARROW-7386 URL: https://issues.apache.org/jira/browse/ARROW-7386 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-7385) ParquetDataset deadlock with different metadata_nthreads values

2019-12-12 Thread Chongkai Zhu (Jira)
Chongkai Zhu created ARROW-7385: --- Summary: ParquetDataset deadlock with different metadata_nthreads values Key: ARROW-7385 URL: https://issues.apache.org/jira/browse/ARROW-7385 Project: Apache Arrow

[jira] [Created] (ARROW-7384) [Website] Fix search indexing warning reported by Google

2019-12-12 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-7384: --- Summary: [Website] Fix search indexing warning reported by Google Key: ARROW-7384 URL: https://issues.apache.org/jira/browse/ARROW-7384 Project: Apache Arrow I

Re: Planned Support for ORC Dataset?

2019-12-12 Thread Wes McKinney
FWIW, the incremental effort of adding new data formats to the C++ Datasets API should be relatively low. I think we even should document in broad terms how users can define their own data sources or file formats On Wed, Dec 11, 2019 at 4:19 PM Neal Richardson wrote: > > Hi William, > ORC is part

Re: MIME type

2019-12-12 Thread Wes McKinney
Shall we create a JIRA issue to memorialize this task? On Thu, Dec 12, 2019 at 1:16 AM Micah Kornfield wrote: > > Yeah, I was thinking to wait for the actual formats to become "official", > but I agree the names won't change. > > On Thu, Dec 5, 2019 at 9:55 PM Sutou Kouhei wrote: > > > I think t

Re: [Discuss][FlightRPC] Extensions to Flight: "DoBidirectional"

2019-12-12 Thread Wes McKinney
I agree we should handle the issue of potentially-multiple-streams separately from the BiDirectional RPC design / implementation On Thu, Dec 12, 2019 at 2:20 PM David Li wrote: > > Just following up here again, any other thoughts? > > I think we do have justifications for potentially separate str

[jira] [Created] (ARROW-7383) Cannot Read In Java/Scala Streaming Arrow Files Generated In C++

2019-12-12 Thread David Wilcox (Jira)
David Wilcox created ARROW-7383: --- Summary: Cannot Read In Java/Scala Streaming Arrow Files Generated In C++ Key: ARROW-7383 URL: https://issues.apache.org/jira/browse/ARROW-7383 Project: Apache Arrow

Re: [Discuss][FlightRPC] Extensions to Flight: "DoBidirectional"

2019-12-12 Thread David Li
Just following up here again, any other thoughts? I think we do have justifications for potentially separate streams in a call, but that's more of an orthogonal question - it doesn't need to be addressed here. I do agree that it very much complicates things. Thanks, David On 11/29/19, Wes McKinn

[jira] [Created] (ARROW-7382) [C++][Dataset] Refactor FsDsDiscovery constructors

2019-12-12 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-7382: --- Summary: [C++][Dataset] Refactor FsDsDiscovery constructors Key: ARROW-7382 URL: https://issues.apache.org/jira/browse/ARROW-7382 Project: Apache Arrow Issue T

Re: PyArrow build problems

2019-12-12 Thread Justin Polchlopek
Thanks for the response. I wasn't able to figure out what happened, but I was able to get a docker environment set up to do the build. There must be something really peculiar with my environment. (Which is probably not something I should be surprised of. I suppose I was just hoping this was a t

[jira] [Created] (ARROW-7381) [C++][Packaging] Iterator change broke manylinux1 wheels

2019-12-12 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7381: -- Summary: [C++][Packaging] Iterator change broke manylinux1 wheels Key: ARROW-7381 URL: https://issues.apache.org/jira/browse/ARROW-7381 Project: Apache Arrow

[jira] [Created] (ARROW-7380) [C++][Dataset] Implement DatasetDiscovery

2019-12-12 Thread Francois Saint-Jacques (Jira)
Francois Saint-Jacques created ARROW-7380: - Summary: [C++][Dataset] Implement DatasetDiscovery Key: ARROW-7380 URL: https://issues.apache.org/jira/browse/ARROW-7380 Project: Apache Arrow

[jira] [Created] (ARROW-7379) [C++] Introduce Field::CompatiblesWith and Schema::CompatiblesWith

2019-12-12 Thread Francois Saint-Jacques (Jira)
Francois Saint-Jacques created ARROW-7379: - Summary: [C++] Introduce Field::CompatiblesWith and Schema::CompatiblesWith Key: ARROW-7379 URL: https://issues.apache.org/jira/browse/ARROW-7379 Pr

[NIGHTLY] Arrow Build Report for Job nightly-2019-12-12-0

2019-12-12 Thread Crossbow
Arrow Build Report for Job nightly-2019-12-12-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-12-0 Failed Tasks: - centos-7: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-12-0-azure-centos-7 - conda-osx-clang-py27: URL:

Re: PyArrow build problems

2019-12-12 Thread Micah Kornfield
I'm not sure exactly what is going on but somehow, FindArrow.cmake [1] doesn't seem to be getting imported when the command is getting run in setup.py, I'm not why this would be different then running the same command by hand. [1] https://github.com/apache/arrow/blob/b282838d3ffea8285a06addab20201