[jira] [Created] (ARROW-1014) 0.4.0 release

2017-05-11 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1014: --- Summary: 0.4.0 release Key: ARROW-1014 URL: https://issues.apache.org/jira/browse/ARROW-1014 Project: Apache Arrow Issue Type: New Feature Reporter

[jira] [Created] (ARROW-1013) [C++] Add asynchronous StreamWriter

2017-05-11 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1013: --- Summary: [C++] Add asynchronous StreamWriter Key: ARROW-1013 URL: https://issues.apache.org/jira/browse/ARROW-1013 Project: Apache Arrow Issue Type: New Featur

[jira] [Created] (ARROW-1012) [C++] Create implementation of StreamReader that reads from Apache Parquet files

2017-05-11 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1012: --- Summary: [C++] Create implementation of StreamReader that reads from Apache Parquet files Key: ARROW-1012 URL: https://issues.apache.org/jira/browse/ARROW-1012 Project:

RE: list scope question

2017-05-11 Thread Katelman, Michael
Thanks, Wes. I really appreciate you doing that. I'll be sure let you know if I run into other issues. -Original Message- From: Wes McKinney [mailto:wesmck...@gmail.com] Sent: Thursday, May 11, 2017 11:54 To: dev@arrow.apache.org Subject: Re: list scope question Seems like valid use cas

[jira] [Created] (ARROW-1011) [Format] Clarify in Layout.md what are the expectations for buffer padding vs. in-memory data

2017-05-11 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1011: --- Summary: [Format] Clarify in Layout.md what are the expectations for buffer padding vs. in-memory data Key: ARROW-1011 URL: https://issues.apache.org/jira/browse/ARROW-1011

[jira] [Created] (ARROW-1010) [Website] Only show English posts in /blog/

2017-05-11 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1010: --- Summary: [Website] Only show English posts in /blog/ Key: ARROW-1010 URL: https://issues.apache.org/jira/browse/ARROW-1010 Project: Apache Arrow Issue Type: Ne

[jira] [Created] (ARROW-1009) [C++] Create asynchronous version of StreamReader

2017-05-11 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1009: --- Summary: [C++] Create asynchronous version of StreamReader Key: ARROW-1009 URL: https://issues.apache.org/jira/browse/ARROW-1009 Project: Apache Arrow Issue Ty

[jira] [Created] (ARROW-1008) [C++] Define abstract interface for stream iteration

2017-05-11 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1008: --- Summary: [C++] Define abstract interface for stream iteration Key: ARROW-1008 URL: https://issues.apache.org/jira/browse/ARROW-1008 Project: Apache Arrow Issue

Re: list scope question

2017-05-11 Thread Wes McKinney
Seems like valid use cases. I created ARROW-1006 and ARROW-1007 to build support for appends. If you are have other problems with the reader can you open a JIRA or post them here? Thanks On Thu, May 11, 2017 at 11:28 AM, Katelman, Michael wrote: > I do see a streaming reader and writer, which mig

[jira] [Created] (ARROW-1007) [C++] Add API for writing additional record batches to a stream on disk

2017-05-11 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1007: --- Summary: [C++] Add API for writing additional record batches to a stream on disk Key: ARROW-1007 URL: https://issues.apache.org/jira/browse/ARROW-1007 Project: Apache A

[jira] [Created] (ARROW-1006) [C++] API for writing additional record batches to an existing file on disk

2017-05-11 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1006: --- Summary: [C++] API for writing additional record batches to an existing file on disk Key: ARROW-1006 URL: https://issues.apache.org/jira/browse/ARROW-1006 Project: Apac

RE: list scope question

2017-05-11 Thread Katelman, Michael
I do see a streaming reader and writer, which might what I need. Although, I'm having some minor problems with the reader. -Original Message- From: Katelman, Michael [mailto:michael.katel...@cubistsystematic.com] Sent: Thursday, May 11, 2017 9:37 To: dev@arrow.apache.org Subject: RE: lis

RE: list scope question

2017-05-11 Thread Katelman, Michael
Thanks, Wes. I was able to get the setup you outlined working as long as I explicitly communicate the location of the footer to processes wanting to read the table (I'm not sure if there's a better way of doing this). One other thing, though, that I would ultimately like to do is share a table