Re: Timeline for 0.15.0 release

2019-09-26 Thread Krisztián Szűcs
>> From:Micah Kornfield >> Send Time:2019年9月26日(星期四) 14:23 >> To:Neal Richardson >> Cc:"Krisztián Szűcs" ; Wes McKinney < >> wesmck...@gmail.com>; dev >> Subject:Re: Timeline for 0.15.0 rel

Re: Timeline for 0.15.0 release

2019-09-26 Thread Micah Kornfield
>>> > > > > > > > >> > >> > > >>>> > > > > > > > >> > > Sure, I'll be available next week. We can also > > grant access > > >>>> > > > to > >

Re: Timeline for 0.15.0 release

2019-09-26 Thread Ji Liu
) 14:23 To:Neal Richardson Cc:"Krisztián Szűcs" ; Wes McKinney ; dev Subject:Re: Timeline for 0.15.0 release Just an I've started the RC generation process off, the last commit from master is [1] I am currently waiting the crossbow builds (build-690 on ursa-labs/crossbow). I

Re: Timeline for 0.15.0 release

2019-09-25 Thread Micah Kornfield
time consuming. > >>>> > > > > > > > >> > > > >>>> > > > > > > > >> > >> > >>>> > > > > > > > >> > >> > Thanks, >

Re: Timeline for 0.15.0 release

2019-09-25 Thread Neal Richardson
>> > Micah >>>> > > > > > > > >> > >> > >>>> > > > > > > > >> > >> > [1] >>>> > > > > > > > >> > >> >>>> > > > > >>&

Re: Timeline for 0.15.0 release

2019-09-25 Thread Krisztián Szűcs
>>> > > > > >>> > > > >>> https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide >>> > > > > > > > >> > >> > >>> > > > > > > > >> > >> > On Wed

Re: Timeline for 0.15.0 release

2019-09-25 Thread Krisztián Szűcs
; >> number of steps. Note that you need to add your >> code >> > > > > signing key to >> > > > > > > > >> > >> >> the KEYS file in SVN (that's not very hard to >> do). I &

Re: Timeline for 0.15.0 release

2019-09-25 Thread Wes McKinney
>> >> On Tue, Sep 17, 2019 at 10:55 PM Micah Kornfield < > > > > > > > >> > >> emkornfi...@gmail.com> wrote: > > > > > > > >> > >> >> > > > > > > > > >> > >> >> > SGTM, as well. >

Re: Timeline for 0.15.0 release

2019-09-25 Thread Micah Kornfield
le RMs involved with > producing the > > > > > source and > > > > > > > > >> > >> >> binary artifacts for the vote > > > > > > > > >> > >> >> > > > > > > > > >> > >> >> On Tue

Re: Timeline for 0.15.0 release

2019-09-25 Thread Neal Richardson
gt; >> I have > > > > > > >> > >> >> > a couple of concerns: > > > > > > >> > >> >> > 1. In the past I've had trouble downloading and > > > validating > > > >

Re: Timeline for 0.15.0 release

2019-09-24 Thread Andy Grove
nd > > validating > > > > > >> > >> releases. I'm a > > > > > >> > >> >> > bit worried, that I might have similar problems doing > > the necessary > > > > > >> > >> uploads. > > > > > >&g

Re: Timeline for 0.15.0 release

2019-09-24 Thread Micah Kornfield
t; >> > >> uploads. > > > > >> > >> >> > 2. My internet connection will likely be not great, I > don't know if > > > > >> > >> this > > > > >> > >> >> > would make it even less likely to be succ

Re: Timeline for 0.15.0 release

2019-09-24 Thread Wes McKinney
>> > >> this > > > >> > >> >> > would make it even less likely to be successful. > > > >> > >> >> > > > > >> > >> >> > Does it become problematic if somehow I would have to > > > >> > >> >>

Re: Timeline for 0.15.0 release

2019-09-24 Thread Wes McKinney
I would have to abandon > > >> > >> >> > the > > >> > >> process > > >> > >> >> > mid-release? Is there anyone who could serve as a backup? > > >> > >> >> > Are the >

Re: Timeline for 0.15.0 release

2019-09-24 Thread Wes McKinney
t; >> >> > > >> > >> >> > On Tue, Sep 17, 2019 at 4:25 PM Neal Richardson < > >> > >> neal.p.richard...@gmail.com> > >> > >> >> > wrote: > >> > >> >> > > >> > >> >&g

Re: Timeline for 0.15.0 release

2019-09-24 Thread Wes McKinney
> wrote: >> > >> >> > >> > >> >> > > Sounds good to me. >> > >> >> > > >> > >> >> > > Do we have a release manager yet? Any volunteers? >> > >> >> > > >> > &

Re: Timeline for 0.15.0 release

2019-09-22 Thread Micah Kornfield
; > > On Tue, Sep 17, 2019 at 4:06 PM Wes McKinney < > wesmck...@gmail.com> > > >> wrote: > > >> >> > > > > >> >> > > > hi all, > > >> >> > > > > > >> >> >

Re: Timeline for 0.15.0 release

2019-09-22 Thread Andy Grove
> >> >> > > > > >> >> > > > hi all, > > >> >> > > > > > >> >> > > > It looks like we're drawing close to be able to make the > 0.15.0 > > >> >> > > > release. I would suggest "penc

Re: Timeline for 0.15.0 release

2019-09-21 Thread Wes McKinney
ble to make the 0.15.0 > >> >> > > > release. I would suggest "pencils down" at the end of this week > >> and > >> >> > > > see if a release candidate can be produced next Monday September > >> 23. > >> >> >

Re: Timeline for 0.15.0 release

2019-09-20 Thread Micah Kornfield
ncils down" at the end of this week >> and >> >> > > > see if a release candidate can be produced next Monday September >> 23. >> >> > > > Any thoughts or objections? >> >> > > > >> >> > > > Thanks, >> >> > > >

Re: Timeline for 0.15.0 release

2019-09-20 Thread Krisztián Szűcs
;> > > wrote: > >> > > > > > >> > > > > hi Eric -- yes, that's correct. I'm planning to amend the > Format docs > >> > > > > today regarding the EOS issue and also update the C++ library > >> > > > &g

Re: Timeline for 0.15.0 release

2019-09-19 Thread Wes McKinney
; > > > > hi Eric -- yes, that's correct. I'm planning to amend the Format docs >> > > > > today regarding the EOS issue and also update the C++ library >> > > > > >> > > > > On Wed, Sep 11, 2019 at 11:21 AM Eric Erhardt >&g

Re: Timeline for 0.15.0 release

2019-09-18 Thread Micah Kornfield
t 11:21 AM Eric Erhardt > > > > > wrote: > > > > > > > > > > > > I assume the plan is to merge the ARROW-6313-flatbuffer-alignment > > > > branch into master before the 0.15 release, correct? > > > > > > > > >

Re: Timeline for 0.15.0 release

2019-09-18 Thread Wes McKinney
> > > > > BTW - I believe the C# alignment changes are ready to be merged into > > > the alignment branch - https://github.com/apache/arrow/pull/5280/ > > > > > > > > > > Eric > > > > > > > > > > --

Re: Timeline for 0.15.0 release

2019-09-17 Thread Micah Kornfield
e merged into > > the alignment branch - https://github.com/apache/arrow/pull/5280/ > > > > > > > > Eric > > > > > > > > -Original Message- > > > > From: Micah Kornfield > > > > Sent: Tuesday, September 10, 2019 10

Re: Timeline for 0.15.0 release

2019-09-17 Thread Neal Richardson
release, correct? > > > > > > BTW - I believe the C# alignment changes are ready to be merged into > the alignment branch - https://github.com/apache/arrow/pull/5280/ > > > > > > Eric > > > > > > -Original Message- > > >

Re: Timeline for 0.15.0 release

2019-09-17 Thread Wes McKinney
; > > -Original Message- > > From: Micah Kornfield > > Sent: Tuesday, September 10, 2019 10:24 PM > > To: Wes McKinney > > Cc: dev ; niki.lj > > Subject: Re: Timeline for 0.15.0 release > > > > I should have a little more bandwidth

Re: Timeline for 0.15.0 release

2019-09-11 Thread Wes McKinney
0, 2019 10:24 PM > To: Wes McKinney > Cc: dev ; niki.lj > Subject: Re: Timeline for 0.15.0 release > > I should have a little more bandwidth to help with some of the packaging > starting tomorrow and going into the weekend. > > On Tuesday, September 10, 2019, Wes McKinney

RE: Timeline for 0.15.0 release

2019-09-11 Thread Eric Erhardt
: Micah Kornfield Sent: Tuesday, September 10, 2019 10:24 PM To: Wes McKinney Cc: dev ; niki.lj Subject: Re: Timeline for 0.15.0 release I should have a little more bandwidth to help with some of the packaging starting tomorrow and going into the weekend. On Tuesday, September 10, 2019, Wes

Re: Timeline for 0.15.0 release

2019-09-10 Thread Micah Kornfield
t; JSON files[3] >>> > > Java side code already checked in, other implementations seems not. >>> > > >>> > > iii. ARROW-6202: OutOfMemory in JdbcAdapter[4] >>> > > Caused by trying to load all records in one contiguous batch, fixed >>> by providing iterator API for iterati

Re: Timeline for 0.15.0 release

2019-09-10 Thread Wes McKinney
> > > Caused by trying to load all records in one contiguous batch, fixed >> by providing iterator API for iteratively reading in ARROW-6219[5]. >> > > >> > > Thanks, >> > > Ji Liu >> > > >> > > [1] https://github.com/apache/ar

Re: Timeline for 0.15.0 release

2019-09-05 Thread Micah Kornfield
[2] https://arrow.apache.org/docs/ipc.html > > > [3] https://issues.apache.org/jira/browse/ARROW-1875 > > > [4] https://issues.apache.org/jira/browse/ARROW-6202[5] > https://issues.apache.org/jira/browse/ARROW-6219 > > > > > > > > > > > >

Re: Timeline for 0.15.0 release

2019-09-05 Thread Wes McKinney
[2] https://arrow.apache.org/docs/ipc.html > > [3] https://issues.apache.org/jira/browse/ARROW-1875 > > [4] https://issues.apache.org/jira/browse/ARROW-6202[5] > > https://issues.apache.org/jira/browse/ARROW-6219 > > > > > > > > -- > > From:Wes McKinney > > Send T

Re: Timeline for 0.15.0 release

2019-08-27 Thread Wes McKinney
ROW-1875 > [4] https://issues.apache.org/jira/browse/ARROW-6202[5] > https://issues.apache.org/jira/browse/ARROW-6219 > > > > ------ > From:Wes McKinney > Send Time:2019年8月19日(星期一) 23:03 > To:dev > Subj

Re: Timeline for 0.15.0 release

2019-08-19 Thread Ji Liu
Time:2019年8月19日(星期一) 23:03 To:dev Subject:Re: Timeline for 0.15.0 release I'm going to work some on organizing the 0.15.0 backlog some this week, if anyone wants to help with grooming (particularly for languages other than C++/Python where I'm focusing) that would be helpful. There have b

Re: Timeline for 0.15.0 release

2019-08-19 Thread Wes McKinney
I'm going to work some on organizing the 0.15.0 backlog some this week, if anyone wants to help with grooming (particularly for languages other than C++/Python where I'm focusing) that would be helpful. There have been almost 500 JIRA issues opened since the 0.14.0 release, so we should make sure t

Re: Timeline for 0.15.0 release

2019-08-15 Thread Wes McKinney
The Windows wheel issue in 0.14.1 seems to be https://issues.apache.org/jira/browse/ARROW-6015 I think the root cause could be the Windows changes in https://github.com/apache/arrow/commit/223ae744cc2a12c60cecb5db593263a03c13f85a I would be appreciative if a volunteer would look into what was w

Re: Timeline for 0.15.0 release

2019-08-15 Thread Antoine Pitrou
On Thu, 15 Aug 2019 11:17:07 -0700 Micah Kornfield wrote: > > > > In C++ they are > > independent, we could have 32-bit array lengths and variable-length > > types with 64-bit offsets if we wanted (we just wouldn't be able to > > have a List child with more than INT32_MAX elements). > > I think

Re: Timeline for 0.15.0 release

2019-08-15 Thread Micah Kornfield
> > In C++ they are > independent, we could have 32-bit array lengths and variable-length > types with 64-bit offsets if we wanted (we just wouldn't be able to > have a List child with more than INT32_MAX elements). I think the point is we could do this in C++ but we don't. I'm not sure we would

Re: Timeline for 0.15.0 release

2019-08-15 Thread Wes McKinney
On Thu, Aug 15, 2019 at 12:00 AM Micah Kornfield wrote: > > Hi Wes, > > > > Do these need to be dependent on the 64-bit array length discussion? > > We could hack something that can read the lower 32-bit range, so I guess > not, but this leaves a bad taste in my mouth. I think there is likely > s

Re: Timeline for 0.15.0 release

2019-08-14 Thread Micah Kornfield
Hi Wes, > > Do these need to be dependent on the 64-bit array length discussion? We could hack something that can read the lower 32-bit range, so I guess not, but this leaves a bad taste in my mouth. I think there is likely still enough time to have the discussion and get these implemented, one w

Re: Timeline for 0.15.0 release

2019-08-14 Thread Antoine Pitrou
Agreed with Wes. Regards Antoine. Le 14/08/2019 à 20:30, Wes McKinney a écrit : > For the record, I don't think we should hold a major release hostage > if we aren't able to complete various feature milestones in time. > Since it's been about 5-6 weeks since 0.14.0 we're coming close to the >

Re: Timeline for 0.15.0 release

2019-08-14 Thread Wes McKinney
For the record, I don't think we should hold a major release hostage if we aren't able to complete various feature milestones in time. Since it's been about 5-6 weeks since 0.14.0 we're coming close to the desired 8-10 week timeline for major releases, so if we need to have 0.16.0 prior to 1.0.0, I

Re: Timeline for 0.15.0 release

2019-08-14 Thread Wes McKinney
On Wed, Aug 14, 2019 at 11:43 AM Micah Kornfield wrote: > > > > > is there anything else that has come up that > > definitely needs to happen before we can release again? > > We need to decide on a way forward for LargeList, LargeBinary, etc, types... > Do these need to be dependent on the 64-bi

Re: Timeline for 0.15.0 release

2019-08-14 Thread Micah Kornfield
> > is there anything else that has come up that > definitely needs to happen before we can release again? We need to decide on a way forward for LargeList, LargeBinary, etc, types... On Tue, Aug 13, 2019 at 8:27 PM Wes McKinney wrote: > hi folks, > > Since there have been a number of fairly s

Re: Timeline for 0.15.0 release

2019-08-14 Thread Wes McKinney
Is there a JIRA for the issue that caused us to pull the 0.14.1 Windows Python wheel installers? If we want to have working wheels for 0.15.0 we'll need a volunteer to help address whatever was wrong with 0.14.1. On Tue, Aug 13, 2019 at 10:26 PM Wes McKinney wrote: > > hi folks, > > Since there h

Timeline for 0.15.0 release

2019-08-13 Thread Wes McKinney
hi folks, Since there have been a number of fairly serious issues (e.g. ARROW-6060) since 0.14.1 that have been fixed I think we should start planning of the next major release. Note that we still have some format-related work (the Flatbuffers alignment issue) that ought to be resolved (not a smal