Is sparse matrix in Apache Arrow scope?

2017-04-17 Thread Kouhei Sutou
Hi, I have a question. Is there any plan to support sparse matrix in Apache Arrow? I just want to know whether sparse matrix is out of scope or not. Thanks, -- kou

[jira] [Created] (ARROW-845) [Python] Sync FindArrow.cmake changes from parquet-cpp

2017-04-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-845: -- Summary: [Python] Sync FindArrow.cmake changes from parquet-cpp Key: ARROW-845 URL: https://issues.apache.org/jira/browse/ARROW-845 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-844) [Format] Revise format/README.md to reflect progress reaching a more complete specification

2017-04-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-844: -- Summary: [Format] Revise format/README.md to reflect progress reaching a more complete specification Key: ARROW-844 URL: https://issues.apache.org/jira/browse/ARROW-844 P

[jira] [Created] (ARROW-843) [Python] Parquet merging unequal but equivalent schemas

2017-04-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-843: -- Summary: [Python] Parquet merging unequal but equivalent schemas Key: ARROW-843 URL: https://issues.apache.org/jira/browse/ARROW-843 Project: Apache Arrow Issue

Re: Say no to zero length batches...

2017-04-17 Thread Jason Altekruse
I agree with Jacques on the expansion of the allowed batch sizes being a significant change to the format. Optional features do have a risk of fragmenting the community, but need to be balanced against the benefits provided to a particular user of arrow. I think that the requirement that individu