Re: [MERGE]object_store branch into master [Second round]

2013-06-15 Thread Chip Childers
On Sat, Jun 15, 2013 at 03:07:39AM +, Edison Su wrote: > Hi all, > The second round, call for merge object_store branch into master, is > coming! > The issues fixed: >1. All the major issues addressed by John are fixed: > 1.1 A cache storage replacement

Re: [MERGE]object_store branch into master [Second round]

2013-06-14 Thread Prasanna Santhanam
On Sat, Jun 15, 2013 at 03:07:39AM +, Edison Su wrote: > Hi all, > The second round, call for merge object_store branch into master, is > coming! > The issues fixed: >1. All the major issues addressed by John are fixed: > 1.1 A cache storage replacement

Re: [MERGE]object_store branch into master

2013-06-03 Thread Min Chen
Sure. Edison will start one soon with this context information. Thanks -min On 6/3/13 10:33 AM, "John Burwell" wrote: >Chip/Min, > >For thread 1, I would like to see an expanded discussion regarding the >need for the staging area. In particular, what features on which >hypervisors created the

Re: [MERGE]object_store branch into master

2013-06-03 Thread John Burwell
Chip/Min, For thread 1, I would like to see an expanded discussion regarding the need for the staging area. In particular, what features on which hypervisors created the need for it. With the wider expertise of the list, we may be able to find solutions to these issues that either reduce or e

Re: [MERGE]object_store branch into master

2013-06-03 Thread Chip Childers
On Mon, Jun 03, 2013 at 05:09:24PM +, Min Chen wrote: > Chip/John, > > This thread has become very hard to follow due to several technical > debates mixed together. Chip earlier made a good suggestion that we should > start separate threads for several important architectural issues rais

Re: [MERGE]object_store branch into master

2013-06-03 Thread Min Chen
- >>>> From: John Burwell [mailto:jburw...@basho.com] >>>> Sent: Thursday, May 30, 2013 7:43 AM >>>> To: dev@cloudstack.apache.org >>>> Subject: Re: [MERGE]object_store branch into master >>>> >>>> It feels like we have ju

Re: [MERGE]object_store branch into master

2013-06-03 Thread John Burwell
ll [mailto:jburw...@basho.com] >>> Sent: Thursday, May 30, 2013 7:43 AM >>> To: dev@cloudstack.apache.org >>> Subject: Re: [MERGE]object_store branch into master >>> >>> It feels like we have jumped to a solution without completely understanding >

Re: [MERGE]object_store branch into master

2013-05-31 Thread Chip Childers
Comments inline: On Thu, May 30, 2013 at 09:42:29PM +, Edison Su wrote: > > > > -Original Message- > > From: John Burwell [mailto:jburw...@basho.com] > > Sent: Thursday, May 30, 2013 7:43 AM > > To: dev@cloudstack.apache.org > > Subject: Re: [M

Re: [MERGE]object_store branch into master

2013-05-30 Thread Chip Childers
On Thu, May 30, 2013 at 09:42:29PM +, Edison Su wrote: > And that's one of reason I don't care that much about the issue with nfs > cache storage, couldn't we put our energy on cloud style storage solution, > instead of on the un-scalable storage? I'll try to think through your whole email a

RE: [MERGE]object_store branch into master

2013-05-30 Thread Edison Su
> -Original Message- > From: John Burwell [mailto:jburw...@basho.com] > Sent: Thursday, May 30, 2013 7:43 AM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > Edison, > > Please see my comment in-line. > > Tha

Re: [MERGE]object_store branch into master

2013-05-30 Thread John Burwell
t;>>> -----Original Message----- >>>> From: Chip Childers [mailto:chip.child...@sungard.com] >>>> Sent: Wednesday, May 29, 2013 1:41 PM >>>> To: dev@cloudstack.apache.org >>>> Subject: Re: [MERGE]object_store branch into master >>>> >

Re: [MERGE]object_store branch into master

2013-05-30 Thread Chip Childers
child...@sungard.com] > >> Sent: Wednesday, May 29, 2013 1:41 PM > >> To: dev@cloudstack.apache.org > >> Subject: Re: [MERGE]object_store branch into master > >> > >> On Tue, May 28, 2013 at 11:42:49PM +, Edison Su wrote: > >>> > >>>

Re: [MERGE]object_store branch into master

2013-05-30 Thread John Burwell
che.org >> Subject: Re: [MERGE]object_store branch into master >> >> On Tue, May 28, 2013 at 11:42:49PM +, Edison Su wrote: >>> >>> >>>> -Original Message- >>>> From: John Burwell [mailto:jburw...@basho.com] >>&g

RE: [MERGE]object_store branch into master

2013-05-29 Thread Edison Su
> -Original Message- > From: Chip Childers [mailto:chip.child...@sungard.com] > Sent: Wednesday, May 29, 2013 1:41 PM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > On Tue, May 28, 2013 at 11:42:49PM +

Re: [MERGE]object_store branch into master

2013-05-29 Thread Chip Childers
On Tue, May 28, 2013 at 11:42:49PM +, Edison Su wrote: > > > > -Original Message- > > From: John Burwell [mailto:jburw...@basho.com] > > Sent: Tuesday, May 28, 2013 8:43 AM > > To: dev@cloudstack.apache.org > > Subject: Re: [MERGE]object_s

RE: [MERGE]object_store branch into master

2013-05-28 Thread Edison Su
> -Original Message- > From: John Burwell [mailto:jburw...@basho.com] > Sent: Tuesday, May 28, 2013 8:43 AM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > All, > > I have gone a through a large chunk of this pat

Re: [MERGE]object_store branch into master

2013-05-28 Thread Chip Childers
On Tue, May 28, 2013 at 11:42:56AM -0400, John Burwell wrote: > All, > > I have gone a through a large chunk of this patch, and published my review > thus far (https://reviews.apache.org/r/11277/). TL;DR is that this patch > has a number of significant issues which can be summarized as follows

Re: [MERGE]object_store branch into master

2013-05-28 Thread John Burwell
d, May 22, 2013 at 08:15:41PM +, Animesh Chaturvedi wrote: >>>>>> >>>>>> >>>>>>> -Original Message- >>>>>>> From: Chip Childers [mailto:chip.child...@sungard.com] >>>>>>> Sent: Wednesday, May

Re: [MERGE]object_store branch into master

2013-05-28 Thread Nitin Mehta
;>>> From: Chip Childers [mailto:chip.child...@sungard.com] >>>> Sent: Wednesday, May 22, 2013 1:26 PM >>>> To: dev@cloudstack.apache.org >>>> Subject: Re: [MERGE]object_store branch into master >>>> >>>> On Wed, May 22, 2013 at 08:15:41

Re: [MERGE]object_store branch into master

2013-05-28 Thread Abhinandan Prateek
ers [mailto:chip.child...@sungard.com] >>>> Sent: Wednesday, May 22, 2013 1:26 PM >>>> To: dev@cloudstack.apache.org >>>> Subject: Re: [MERGE]object_store branch into master >>>> >>>> On Wed, May 22, 2013 at 08:15:41PM +, Animesh Chaturvedi

Re: [MERGE]object_store branch into master

2013-05-28 Thread Wido den Hollander
branch into master On Wed, May 22, 2013 at 08:15:41PM +, Animesh Chaturvedi wrote: -Original Message- From: Chip Childers [mailto:chip.child...@sungard.com] Sent: Wednesday, May 22, 2013 12:08 PM To: dev@cloudstack.apache.org Subject: Re: [MERGE]object_store branch into master On Wed

Re: [MERGE]object_store branch into master

2013-05-26 Thread Chip Childers
On Fri, May 24, 2013 at 10:10:25PM +, Animesh Chaturvedi wrote: > [Animesh>] Plan means targeted for 4.2. Community review and technical > quality are of course important and being attended to. The effort to find and > fix issues with this change speaks for the attention to technical qualit

RE: [MERGE]object_store branch into master

2013-05-24 Thread Animesh Chaturvedi
> -Original Message- > From: Chip Childers [mailto:chip.child...@sungard.com] > Sent: Friday, May 24, 2013 2:54 PM > To: > Subject: Re: [MERGE]object_store branch into master > > On May 24, 2013, at 5:50 PM, Animesh Chaturvedi > wrote: > > &g

Re: [MERGE]object_store branch into master

2013-05-24 Thread Chip Childers
On May 24, 2013, at 5:50 PM, Animesh Chaturvedi wrote: > > >> -Original Message- >> From: Chip Childers [mailto:chip.child...@sungard.com] >> Sent: Friday, May 24, 2013 2:42 PM >> To: >> Subject: Re: [MERGE]object_store branch into master >&g

RE: [MERGE]object_store branch into master

2013-05-24 Thread Animesh Chaturvedi
> -Original Message- > From: Chip Childers [mailto:chip.child...@sungard.com] > Sent: Friday, May 24, 2013 2:42 PM > To: > Subject: Re: [MERGE]object_store branch into master > > On May 24, 2013, at 5:25 PM, Animesh Chaturvedi > wrote: > > &g

Re: [MERGE]object_store branch into master

2013-05-24 Thread Chip Childers
On May 24, 2013, at 5:25 PM, Animesh Chaturvedi wrote: > > >> -Original Message- >> From: Chip Childers [mailto:chip.child...@sungard.com] >> Sent: Friday, May 24, 2013 1:18 PM >> To: dev@cloudstack.apache.org >> Subject: Re: [MERGE]object_store bra

RE: [MERGE]object_store branch into master

2013-05-24 Thread Animesh Chaturvedi
> -Original Message- > From: Chip Childers [mailto:chip.child...@sungard.com] > Sent: Friday, May 24, 2013 1:18 PM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > On Thu, May 23, 2013 at 05:50:49PM +, Animesh Chaturved

Re: [MERGE]object_store branch into master

2013-05-24 Thread Chip Childers
On Thu, May 23, 2013 at 05:50:49PM +, Animesh Chaturvedi wrote: > [Animesh>] IMHO the goal behind bringing architectural changes early in > release is to ensure stability and proper review and that makes sense. In > this case the goals are being addressed with testing on feature branch and

RE: [MERGE]object_store branch into master

2013-05-23 Thread Edison Su
at will be great!:) > -Original Message- > From: John Burwell [mailto:jburw...@basho.com] > Sent: Thursday, May 23, 2013 1:56 PM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > Min, > > Yes, I feel that class needs to

Re: [MERGE]object_store branch into master

2013-05-23 Thread John Burwell
gt; these >>>>>> into a set of smaller patches submitted throughout the course of the >>>>>> release cycle. >>>>>> >>>>>> So far, I can say I am very concerned about failure scenarios and >>>>>> potential

Re: [MERGE]object_store branch into master

2013-05-23 Thread Min Chen
ar, I can say I am very concerned about failure scenarios and >>>>> potential race conditions around the NFS cache. However, I am only a >>>>> quarter of the way through the code so my concerns may be resolved by >>>>> the end of the process. >>&

Re: [MERGE]object_store branch into master

2013-05-23 Thread John Burwell
; the end of the process. >>>> >>>> I am also concerned about the correctness S3 implementation. Why did >>>> you choose to directly access the S3 HTTP API rather using the client >>>> library? >>>> >>>> Thanks, >>>> -Joh

RE: [MERGE]object_store branch into master

2013-05-23 Thread Animesh Chaturvedi
> -Original Message- > From: Chip Childers [mailto:chip.child...@sungard.com] > Sent: Thursday, May 23, 2013 9:35 AM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > On Wed, May 22, 2013 at 09:25:10PM +

Re: [MERGE]object_store branch into master

2013-05-23 Thread Chip Childers
On Wed, May 22, 2013 at 09:25:10PM +, Edison Su wrote: > > > > -Original Message- > > From: Chip Childers [mailto:chip.child...@sungard.com] > > Sent: Wednesday, May 22, 2013 1:26 PM > > To: dev@cloudstack.apache.org > > Subject: Re: [MERGE]object_

Re: [MERGE]object_store branch into master

2013-05-23 Thread Min Chen
gt; I am also concerned about the correctness S3 implementation. Why did >>> you choose to directly access the S3 HTTP API rather using the client >>> library? >>> >>> Thanks, >>> -John >>> >>> On May 22, 2013, at 5:25 PM, Edison Su wrote: >>> >>&

Re: [MERGE]object_store branch into master

2013-05-23 Thread John Burwell
>>>> On Wed, May 22, 2013 at 08:15:41PM +, Animesh Chaturvedi wrote: >>>>> >>>>> >>>>>> -Original Message- >>>>>> From: Chip Childers [mailto:chip.child...@sungard.com] >>>>>> Sent: Wedne

Re: [MERGE]object_store branch into master

2013-05-22 Thread Min Chen
;>> From: Chip Childers [mailto:chip.child...@sungard.com] >>> Sent: Wednesday, May 22, 2013 1:26 PM >>> To: dev@cloudstack.apache.org >>> Subject: Re: [MERGE]object_store branch into master >>> >>> On Wed, May 22, 2013 at 08:15:41PM +, Animesh

Re: [MERGE]object_store branch into master

2013-05-22 Thread John Burwell
2013 1:26 PM >> To: dev@cloudstack.apache.org >> Subject: Re: [MERGE]object_store branch into master >> >> On Wed, May 22, 2013 at 08:15:41PM +, Animesh Chaturvedi wrote: >>> >>> >>>> -Original Message- >>>> From: Chip Childers [

RE: [MERGE]object_store branch into master

2013-05-22 Thread Edison Su
> -Original Message- > From: Chip Childers [mailto:chip.child...@sungard.com] > Sent: Wednesday, May 22, 2013 1:26 PM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > On Wed, May 22, 2013 at 08:15:41PM +, Ani

RE: [MERGE]object_store branch into master

2013-05-22 Thread Animesh Chaturvedi
> -Original Message- > From: Chip Childers [mailto:chip.child...@sungard.com] > Sent: Wednesday, May 22, 2013 1:26 PM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > On Wed, May 22, 2013 at 08:15:41PM +, Ani

Re: [MERGE]object_store branch into master

2013-05-22 Thread Chip Childers
On Wed, May 22, 2013 at 08:15:41PM +, Animesh Chaturvedi wrote: > > > > -Original Message- > > From: Chip Childers [mailto:chip.child...@sungard.com] > > Sent: Wednesday, May 22, 2013 12:08 PM > > To: dev@cloudstack.apache.org > > Subject: Re: [M

RE: [MERGE]object_store branch into master

2013-05-22 Thread Animesh Chaturvedi
> -Original Message- > From: Chip Childers [mailto:chip.child...@sungard.com] > Sent: Wednesday, May 22, 2013 12:08 PM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > On Wed, May 22, 2013 at 07:00:51PM +, Ani

Re: [MERGE]object_store branch into master

2013-05-22 Thread John Burwell
22, 2013 at 07:00:51PM +, Animesh Chaturvedi wrote: >> >> >>> -Original Message- >>> From: John Burwell [mailto:jburw...@basho.com] >>> Sent: Tuesday, May 21, 2013 8:51 AM >>> To: dev@cloudstack.apache.org >>> Subject: Re: [MERGE]ob

Re: [MERGE]object_store branch into master

2013-05-22 Thread John Burwell
sage- >>> From: John Burwell [mailto:jburw...@basho.com] >>> Sent: Tuesday, May 21, 2013 8:51 AM >>> To: dev@cloudstack.apache.org >>> Subject: Re: [MERGE]object_store branch into master >>> >>> Edison, >>> >>> Thanks, I w

Re: [MERGE]object_store branch into master

2013-05-22 Thread Chip Childers
On Wed, May 22, 2013 at 07:00:51PM +, Animesh Chaturvedi wrote: > > > > -Original Message- > > From: John Burwell [mailto:jburw...@basho.com] > > Sent: Tuesday, May 21, 2013 8:51 AM > > To: dev@cloudstack.apache.org > > Subject: Re: [M

Re: [MERGE]object_store branch into master

2013-05-22 Thread John Burwell
well [mailto:jburw...@basho.com] >> Sent: Tuesday, May 21, 2013 8:51 AM >> To: dev@cloudstack.apache.org >> Subject: Re: [MERGE]object_store branch into master >> >> Edison, >> >> Thanks, I will start going through it today. Based on other $dayjob >> respons

RE: [MERGE]object_store branch into master

2013-05-22 Thread Animesh Chaturvedi
> -Original Message- > From: John Burwell [mailto:jburw...@basho.com] > Sent: Tuesday, May 21, 2013 8:51 AM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > Edison, > > Thanks, I will start going through it tod

Re: [MERGE]object_store branch into master

2013-05-21 Thread John Burwell
m] >> Sent: Monday, May 20, 2013 2:30 PM >> To: dev@cloudstack.apache.org >> Subject: RE: [MERGE]object_store branch into master >> >> >> >>> -Original Message- >>> From: John Burwell [mailto:jburw...@basho.com] >>> Sent: Monday

RE: [MERGE]object_store branch into master

2013-05-20 Thread Edison Su
> -Original Message- > From: Edison Su [mailto:edison...@citrix.com] > Sent: Monday, May 20, 2013 2:30 PM > To: dev@cloudstack.apache.org > Subject: RE: [MERGE]object_store branch into master > > > > > -Original Message- > > From: Joh

RE: [MERGE]object_store branch into master

2013-05-20 Thread Edison Su
> -Original Message- > From: John Burwell [mailto:jburw...@basho.com] > Sent: Monday, May 20, 2013 12:56 PM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > All, > > Since this change is so large, it makes reviewi

Re: [MERGE]object_store branch into master

2013-05-20 Thread John Burwell
All, Since this change is so large, it makes reviewing and commenting in detail extremely difficult. Would it be possible to push this patch through Review Board to ease comprehension and promote a conversation about this patch? Reading through the FS, I have the following questions regarding

RE: [MERGE]object_store branch into master

2013-05-20 Thread Animesh Chaturvedi
> -Original Message- > From: David Nalley [mailto:da...@gnsa.us] > Sent: Monday, May 20, 2013 11:36 AM > To: dev@cloudstack.apache.org > Subject: Re: [MERGE]object_store branch into master > > On Mon, May 20, 2013 at 2:22 PM, Sudha Ponnaganti > wrote: > >

Re: [MERGE]object_store branch into master

2013-05-20 Thread David Nalley
On Mon, May 20, 2013 at 2:22 PM, Sudha Ponnaganti wrote: > Also open defects need to be addressed as testing has been done on feature > branch and the numbers seem to be high on this branch - atleast blocker and > critical should be addressed. > > Key Summary AssigneeReporter

Re: [MERGE]object_store branch into master

2013-05-20 Thread Chip Childers
ect_Store_Refactor - Templates - Not able to create > a template from snapshot.Unassigned Sangeetha Hariharan > CriticalOpen +100 - known problems shouldn't be brought into master > > -Original Message- > From: Chip Childers [mailto:chip.child...@su

RE: [MERGE]object_store branch into master

2013-05-20 Thread Sudha Ponnaganti
ates - Not able to create a template from snapshot.Unassigned Sangeetha Hariharan Critical Open -Original Message- From: Chip Childers [mailto:chip.child...@sungard.com] Sent: Monday, May 20, 2013 10:53 AM To: dev@cloudstack.apache.org Subject: Re: [MERGE]object_st

Re: [MERGE]object_store branch into master

2013-05-20 Thread Chip Childers
On Fri, May 17, 2013 at 08:19:57AM -0400, David Nalley wrote: > On Fri, May 17, 2013 at 4:11 AM, Edison Su wrote: > > Hi all, > > Min and I worked on object_store branch during the last one and half > > month. We made a lot of refactor on the storage code, mostly related to > > secondary st

Re: [MERGE]object_store branch into master

2013-05-17 Thread John Burwell
David and Edison, I plan to review the branch, but due to a personal emergency, I won't have a my feedback until COB, Monday. Thanks, -John On May 17, 2013, at 8:19 AM, David Nalley wrote: > On Fri, May 17, 2013 at 4:11 AM, Edison Su wrote: >> Hi all, >> Min and I worked on object_store

Re: [MERGE]object_store branch into master

2013-05-17 Thread David Nalley
On Fri, May 17, 2013 at 4:11 AM, Edison Su wrote: > Hi all, > Min and I worked on object_store branch during the last one and half > month. We made a lot of refactor on the storage code, mostly related to > secondary storage, but also on the general storage framework. The following > goals