Re: [DRAFT] Apache Arrow Board Report January 2020

2020-01-09 Thread Jacques Nadeau
Posted with correction. Thanks to Wes, Antoine and Todd! On Wed, Jan 8, 2020 at 10:15 AM Wes McKinney wrote: > Not sure what happened there. The two words after "grow" can be removed > > ## Description: > > The mission of Apache Arrow is the creation and maintenance of software > related > to co

Re: [DRAFT] Apache Arrow Board Report January 2020

2020-01-08 Thread Wes McKinney
Not sure what happened there. The two words after "grow" can be removed ## Description: The mission of Apache Arrow is the creation and maintenance of software related to columnar in-memory processing and data interchange ## Issues: There are no issues requiring board attention at this time. #

Re: [DRAFT] Apache Arrow Board Report January 2020

2020-01-08 Thread Todd Hendricks
Hi Wes, Looks like there is a cutoff sentence at the end of the Community Health section. On Wed, Jan 8, 2020 at 10:01 AM Wes McKinney wrote: > Here is an updated draft. If there is no more feedback, this can be > submitted to the board > > ## Description: > > The mission of Apache Arrow is the

Re: [DRAFT] Apache Arrow Board Report January 2020

2020-01-08 Thread Wes McKinney
Here is an updated draft. If there is no more feedback, this can be submitted to the board ## Description: The mission of Apache Arrow is the creation and maintenance of software related to columnar in-memory processing and data interchange ## Issues: There are no issues requiring board attenti

Re: [DRAFT] Apache Arrow Board Report January 2020

2020-01-06 Thread Antoine Pitrou
Perhaps also mention that we're dependent on enough capacity on GitHub Actions currently. I'm not sure how long their generosity will last :-) Le 06/01/2020 à 18:14, Wes McKinney a écrit : > There is still the question of how to manage CI tasks (e.g. > GPU-enabled, ARM-enabled) that are unable

Re: [DRAFT] Apache Arrow Board Report January 2020

2020-01-06 Thread Wes McKinney
There is still the question of how to manage CI tasks (e.g. GPU-enabled, ARM-enabled) that are unable to be run in GitHub Actions. We should probably mention that we've migrated off Travis CI, though. On Mon, Jan 6, 2020 at 11:07 AM Antoine Pitrou wrote: > > > Do we consider the CI issue solved?

Re: [DRAFT] Apache Arrow Board Report January 2020

2020-01-06 Thread Antoine Pitrou
Do we consider the CI issue solved? Le 06/01/2020 à 18:02, Wes McKinney a écrit : > Hi folks -- our quarterly ASF board report is due in 2 days. What > items would we like to add in the below sections? > > ## Description: > > The mission of Apache Arrow is the creation and maintenance of soft

[DRAFT] Apache Arrow Board Report January 2020

2020-01-06 Thread Wes McKinney
Hi folks -- our quarterly ASF board report is due in 2 days. What items would we like to add in the below sections? ## Description: The mission of Apache Arrow is the creation and maintenance of software related to columnar in-memory processing and data interchange ## Issues: There are no issue

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-10 Thread Jacques Nadeau
Hey there, I meant to remove the issues section at top and replace with the one in the community health section but forgot to remove the top part. I just submitted with the removed top part. Let me know if people want me to further edit. Thanks On Thu, Oct 10, 2019 at 1:54 PM Antoine Pitrou wrot

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-10 Thread Antoine Pitrou
It's good with me. Regards Antoine. Le 10/10/2019 à 22:51, Jacques Nadeau a écrit : > Antoine, is my synopsis fair? > > On Thu, Oct 10, 2019 at 12:53 PM Wes McKinney wrote: > >> +1 >> >> On Thu, Oct 10, 2019, 2:12 PM Jacques Nadeau wrote: >> >>> Proposed report update below. LMK your thou

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-10 Thread Jacques Nadeau
Antoine, is my synopsis fair? On Thu, Oct 10, 2019 at 12:53 PM Wes McKinney wrote: > +1 > > On Thu, Oct 10, 2019, 2:12 PM Jacques Nadeau wrote: > > > Proposed report update below. LMK your thoughts. > > > > ## Description: > > The mission of Apache Arrow is the creation and maintenance of softw

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-10 Thread Wes McKinney
+1 On Thu, Oct 10, 2019, 2:12 PM Jacques Nadeau wrote: > Proposed report update below. LMK your thoughts. > > ## Description: > The mission of Apache Arrow is the creation and maintenance of software > related to columnar in-memory processing and data interchange > > ## Issues: > > * We are stru

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-10 Thread Jacques Nadeau
Proposed report update below. LMK your thoughts. ## Description: The mission of Apache Arrow is the creation and maintenance of software related to columnar in-memory processing and data interchange ## Issues: * We are struggling with Continuous Integration scalability as the project has defin

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-10 Thread Jacques Nadeau
Arg... accidental send before ready. What do think about the statement below for community health? Does it fairly capture the concerns/perspective? On Thu, Oct 10, 2019 at 10:24 AM Jacques Nadeau wrote: > Many contributors are struggling with the slowness of pre-commit CI. Arrow > has a large n

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-10 Thread Jacques Nadeau
Many contributors are struggling with the slowness of pre-commit CI. Arrow has a large number of different platforms and components and a complex build matrix. As new commits come in, they frequently take a long time to complete. The community is trying several ways to solve this. Some of those hav

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-10 Thread Wes McKinney
Here is a rejection of CircleCI more than 18 months ago https://issues.apache.org/jira/browse/INFRA-15964 On Thu, Oct 10, 2019 at 4:33 AM Antoine Pitrou wrote: > > > For the record, here is the ticket for Azure Pipelines integration: > https://issues.apache.org/jira/browse/INFRA-17030 > > I open

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-10 Thread Antoine Pitrou
For the record, here is the ticket for Azure Pipelines integration: https://issues.apache.org/jira/browse/INFRA-17030 I opened an issue back in May about the Travis-CI capacity situation: https://issues.apache.org/jira/browse/INFRA-18533 Apparently CI capacity has been a "hot topic as of late":

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-09 Thread Wes McKinney
On Thu, Oct 10, 2019 at 12:22 AM Jacques Nadeau wrote: > > I'm not dismissing the there are issues but I also don't feel like there > has been constant discussion for months on the list that INFRA is not being > responsive to Arrow community requests. It seems like you might be saying a > couple d

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-09 Thread Jacques Nadeau
I'm not dismissing the there are issues but I also don't feel like there has been constant discussion for months on the list that INFRA is not being responsive to Arrow community requests. It seems like you might be saying a couple different things one of two things (or both?)? 1) The Arrow infras

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-09 Thread Wes McKinney
hi Jacques, I think we need to share the concerns that many PMC members have over the constraints that INFRA is placing on us. Can we rephrase the concern in a way that is more helpful? Firstly, I respect and appreciate the ASF's desire to limit write access to committers only from an IP provenan

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-09 Thread Jacques Nadeau
I think we need to more direct in listing issues for the board. What have we done? What do we want them to do? In general, any large org is going to be slow to add new deep integrations into GitHub. I don't think we should expect Apache to be any different (it took several years before we could m

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-08 Thread Wes McKinney
New draft ## Description: The mission of Apache Arrow is the creation and maintenance of software related to columnar in-memory processing and data interchange ## Issues: * We are struggling with Continuous Integration scalability as the project has definitely outgrown what Travis CI and Appve

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-08 Thread Wes McKinney
Yes, I agree with raising the issue to the board. On Tue, Oct 8, 2019 at 8:31 AM Antoine Pitrou wrote: > > > I agree. Especially given that the constraints imposed by Infra don't > help solving the problem. > > Regards > > Antoine. > > > Le 08/10/2019 à 15:02, Uwe L. Korn a écrit : > > I'm not s

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-08 Thread Antoine Pitrou
I agree. Especially given that the constraints imposed by Infra don't help solving the problem. Regards Antoine. Le 08/10/2019 à 15:02, Uwe L. Korn a écrit : > I'm not sure what qualifies for "board attention" but it seems that CI is a > critical problem in Apache projects, not just Arrow.

Re: [DRAFT] Apache Arrow Board Report - October 2019

2019-10-08 Thread Uwe L. Korn
I'm not sure what qualifies for "board attention" but it seems that CI is a critical problem in Apache projects, not just Arrow. Should we raise that? Uwe On Tue, Oct 8, 2019, at 12:00 AM, Wes McKinney wrote: > Here is a start for our Q3 board report > > ## Description: > The mission of Apache

[DRAFT] Apache Arrow Board Report - October 2019

2019-10-07 Thread Wes McKinney
Here is a start for our Q3 board report ## Description: The mission of Apache Arrow is the creation and maintenance of software related to columnar in-memory processing and data interchange ## Issues: There are no issues requiring board attention at this time ## Membership Data: * Apache Arrow w

Re: [DRAFT] Apache Arrow board report January 2019

2019-01-09 Thread Wes McKinney
Yes, definitely. On Wed, Jan 9, 2019 at 5:07 AM Antoine Pitrou wrote: > > > Should it mention the forthcoming 0.12.0 release? > > Regards > > Antoine. > > > Le 09/01/2019 à 06:54, Wes McKinney a écrit : > > ## Description: > > > > - Apache Arrow is a cross-language development platform for in-mem

Re: [DRAFT] Apache Arrow board report January 2019

2019-01-09 Thread Antoine Pitrou
Should it mention the forthcoming 0.12.0 release? Regards Antoine. Le 09/01/2019 à 06:54, Wes McKinney a écrit : > ## Description: > > - Apache Arrow is a cross-language development platform for in-memory data. It > specifies a standardized language-independent columnar memory format for

[DRAFT] Apache Arrow board report January 2019

2019-01-08 Thread Wes McKinney
## Description: - Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware. It also provides computational l

Re: [DRAFT] Apache Arrow board report October 2018

2018-10-16 Thread Wes McKinney
Uwe just replied to the Parquet thread so we can pursue further there On Mon, Oct 15, 2018 at 7:01 PM Julien Le Dem wrote: > > What's the plan for the parquet-cpp repo now that ARROW-3075 has been > merged? > > > On Thu, Oct 11, 2018 at 9:12 AM Wes McKinney wrote: > > > OK, I have updated. If oth

Re: [DRAFT] Apache Arrow board report October 2018

2018-10-15 Thread Julien Le Dem
What's the plan for the parquet-cpp repo now that ARROW-3075 has been merged? On Thu, Oct 11, 2018 at 9:12 AM Wes McKinney wrote: > OK, I have updated. If others could comment on the .NET thread, we can > start a vote soon there > > ## Description: > > Apache Arrow is a cross-language developme

Re: [DRAFT] Apache Arrow board report October 2018

2018-10-11 Thread Wes McKinney
OK, I have updated. If others could comment on the .NET thread, we can start a vote soon there ## Description: Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organize

Re: [DRAFT] Apache Arrow board report October 2018

2018-10-11 Thread Uwe L. Korn
You could also mention that we are about to receive a C# donation. Otherwise this looks good. Uwe On Thu, Oct 11, 2018, at 6:05 PM, Wes McKinney wrote: > ## Description: > > Apache Arrow is a cross-language development platform for in-memory data. It > specifies a standardized language-independ

[DRAFT] Apache Arrow board report October 2018

2018-10-11 Thread Wes McKinney
## Description: Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware. It also provides computational libraries

Re: [DRAFT] Apache Arrow board report April 2018

2018-04-11 Thread Jacques Nadeau
Thanks Wes and Uwe. I added a couple more activity items around the build work and the intention to faster Rust releases. Initial posted report below. Let me know if you think we should wordsmith further. ## Description: Apache Arrow is a cross-language development platform for in-memory data. It

Re: [DRAFT] Apache Arrow board report April 2018

2018-04-11 Thread Uwe L. Korn
We should add the start of a Rust implementation to Activity, otherwise this looks good. Uwe On Wed, Apr 11, 2018, at 7:14 PM, Wes McKinney wrote: > ## Description: > > Apache Arrow is a cross-language development platform for in-memory data. It > specifies a standardized language-independent c

[DRAFT] Apache Arrow board report April 2018

2018-04-11 Thread Wes McKinney
## Description: Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware. It also provides computational libraries

Re: [DRAFT] Apache Arrow board report

2018-01-09 Thread Jacques Nadeau
Just saw this. Thanks Wes. Will send along if no further comments tomorrow. On Jan 2, 2018 2:18 PM, "Siddharth Teotia" wrote: > +1. Thanks, Wes. > > On Tue, Jan 2, 2018 at 12:10 PM, Holden Karau > wrote: > > > Would it make sense to mention the other Apache projects using/planning > to > > use

Re: [DRAFT] Apache Arrow board report

2018-01-02 Thread Siddharth Teotia
+1. Thanks, Wes. On Tue, Jan 2, 2018 at 12:10 PM, Holden Karau wrote: > Would it make sense to mention the other Apache projects using/planning to > use Arrow? > > On Tue, Jan 2, 2018 at 11:31 AM Li Jin wrote: > > > +1. Thanks Wes! > > > > On Tue, Jan 2, 2018 at 11:19 AM, Uwe L. Korn wrote: >

Re: [DRAFT] Apache Arrow board report

2018-01-02 Thread Holden Karau
Would it make sense to mention the other Apache projects using/planning to use Arrow? On Tue, Jan 2, 2018 at 11:31 AM Li Jin wrote: > +1. Thanks Wes! > > On Tue, Jan 2, 2018 at 11:19 AM, Uwe L. Korn wrote: > > > +1 > > > > On Tue, Jan 2, 2018, at 4:21 PM, Wes McKinney wrote: > > > Here is a dra

Re: [DRAFT] Apache Arrow board report

2018-01-02 Thread Li Jin
+1. Thanks Wes! On Tue, Jan 2, 2018 at 11:19 AM, Uwe L. Korn wrote: > +1 > > On Tue, Jan 2, 2018, at 4:21 PM, Wes McKinney wrote: > > Here is a draft for this quarter's ASF board report. The Activity / > > Health sections are a bit light on detail, if others would like to add > > some things fee

Re: [DRAFT] Apache Arrow board report

2018-01-02 Thread Uwe L. Korn
+1 On Tue, Jan 2, 2018, at 4:21 PM, Wes McKinney wrote: > Here is a draft for this quarter's ASF board report. The Activity / > Health sections are a bit light on detail, if others would like to add > some things feel free to send them along. > > thanks > Wes > > ## Description: > > Apache Arro

[DRAFT] Apache Arrow board report

2018-01-02 Thread Wes McKinney
Here is a draft for this quarter's ASF board report. The Activity / Health sections are a bit light on detail, if others would like to add some things feel free to send them along. thanks Wes ## Description: Apache Arrow is a cross-language development platform for in-memory data. It specifies a

Re: [DRAFT] Apache Arrow board report

2017-07-14 Thread Wes McKinney
So sorry about that omission -- the turbodbc integration is huge (getting cross-Python library C++ API working)! Here's the updated report ## Description: Arrow is a columnar in-memory analytics layer designed to accelerate big data. It houses a set of canonical in-memory representations of flat

Re: [DRAFT] Apache Arrow board report

2017-07-14 Thread Uwe L. Korn
The report looks fine. Not sure if we already mentioned turbodbc in the last report. If not, we should include it. Uwe On Fri, Jul 14, 2017, at 04:37 PM, Jacques Nadeau wrote: > Wes, thanks for pulling this together! We've crazy busy getting reading > to > launch. I'll post this in a few hours af

Re: [DRAFT] Apache Arrow board report

2017-07-14 Thread Jacques Nadeau
Wes, thanks for pulling this together! We've crazy busy getting reading to launch. I'll post this in a few hours after anybody provides any suggested additions/modifications. On Fri, Jul 14, 2017 at 7:31 AM, Wes McKinney wrote: > If anyone has any comments on this quarter's board report or anyth

[DRAFT] Apache Arrow board report

2017-07-14 Thread Wes McKinney
If anyone has any comments on this quarter's board report or anything to add, please let us know. Thanks! Wes ## Description: Arrow is a columnar in-memory analytics layer designed to accelerate big data. It houses a set of canonical in-memory representations of flat and hierarchical data along