Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-22 Thread Srivatsa Vaddagiri
On Thu, Mar 22, 2007 at 09:39:09AM -0500, Serge E. Hallyn wrote: > > What troubles will mounting both cpuset and ns in the same hierarchy > > cause? > > Wow, don't recall the full context here. Sorry to have come back so late on this :) > But at least with Paul's container patchset, a subsystem

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-22 Thread Serge E. Hallyn
Quoting Srivatsa Vaddagiri ([EMAIL PROTECTED]): > On Fri, Mar 09, 2007 at 10:50:17AM -0600, Serge E. Hallyn wrote: > > The nsproxy container subsystem could be said to be that unification. > > If we really wanted to I suppose we could now always mount the nsproxy > > subsystem, get rid of tsk->nspr

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-22 Thread Srivatsa Vaddagiri
On Fri, Mar 09, 2007 at 10:50:17AM -0600, Serge E. Hallyn wrote: > The nsproxy container subsystem could be said to be that unification. > If we really wanted to I suppose we could now always mount the nsproxy > subsystem, get rid of tsk->nsproxy, and always get thta through it's > nsproxy subsyste

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-13 Thread Herbert Poetzl
On Mon, Mar 12, 2007 at 07:25:48PM -0700, Paul Menage wrote: > On 3/12/07, Herbert Poetzl <[EMAIL PROTECTED]> wrote: > > > > why? you simply enter that specific space and > > use the existing mechanisms (netlink, proc, whatever) > > to retrieve the information with _existing_ tools, > > That's ass

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Paul Menage
On 3/12/07, Herbert Poetzl <[EMAIL PROTECTED]> wrote: why? you simply enter that specific space and use the existing mechanisms (netlink, proc, whatever) to retrieve the information with _existing_ tools, That's assuming that you're using network namespace virtualization, with each group of ta

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Srivatsa Vaddagiri
On Tue, Mar 13, 2007 at 12:31:13AM +0100, Herbert Poetzl wrote: > just means that the current Linux-VServer behaviour > is a subset of that, no problem there as long as > it really _is_ a subset :) we always like to provide > more features in the future, no problem with that :) Considering the exa

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Herbert Poetzl
On Mon, Mar 12, 2007 at 09:50:45PM +0530, Srivatsa Vaddagiri wrote: > On Mon, Mar 12, 2007 at 10:56:43AM -0500, Serge E. Hallyn wrote: > > What's wrong with that? > > I had been asking around on "what is the fundamental unit of res mgmt > for vservers" and the answer I got (from Herbert) was "all

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Herbert Poetzl
On Mon, Mar 12, 2007 at 03:00:25AM -0700, Paul Menage wrote: > On 3/11/07, Paul Jackson <[EMAIL PROTECTED]> wrote: > > > > My current understanding of Paul Menage's container patch is that it is > > a useful improvement for some of the metered classes - those that could > > make good use of a file

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Sam Vilain
Srivatsa Vaddagiri wrote: > On Mon, Mar 12, 2007 at 10:56:43AM -0500, Serge E. Hallyn wrote: > >> What's wrong with that? >> > > I had been asking around on "what is the fundamental unit of res mgmt > for vservers" and the answer I got (from Herbert) was "all tasks that are > in the same pi

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Paul Jackson
vatsa wrote: > This assumes that you can see the global vfs namespace right? > > What if you are inside a container/vserver which restricts your vfs > namespace? i.e /dev/cpusets seen from one container is not same as what > is seen from another container . Well, yes. But that restriction on the

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Serge E. Hallyn
Quoting Srivatsa Vaddagiri ([EMAIL PROTECTED]): > On Mon, Mar 12, 2007 at 10:56:43AM -0500, Serge E. Hallyn wrote: > > What's wrong with that? > > I had been asking around on "what is the fundamental unit of res mgmt > for vservers" and the answer I got (from Herbert) was "all tasks that are > in

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Srivatsa Vaddagiri
On Mon, Mar 12, 2007 at 10:56:43AM -0500, Serge E. Hallyn wrote: > What's wrong with that? I had been asking around on "what is the fundamental unit of res mgmt for vservers" and the answer I got (from Herbert) was "all tasks that are in the same pid namespace". From what you are saying above, it

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Serge E. Hallyn
Quoting Srivatsa Vaddagiri ([EMAIL PROTECTED]): > On Fri, Mar 09, 2007 at 02:09:35PM -0800, Paul Menage wrote: > > > 3. This next leads me to think that 'tasks' file in each directory doesnt > > > make > > >sense for containers. In fact it can lend itself to error situations > > > (by > > >

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Srivatsa Vaddagiri
On Mon, Mar 12, 2007 at 07:31:48PM +0530, Srivatsa Vaddagiri wrote: > not so. This in-fact lets vservers and containers to work with each > other. So: s/containers/cpusets -- Regards, vatsa - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMA

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Srivatsa Vaddagiri
On Fri, Mar 09, 2007 at 02:09:35PM -0800, Paul Menage wrote: > > 3. This next leads me to think that 'tasks' file in each directory doesnt > > make > >sense for containers. In fact it can lend itself to error situations (by > >administrator/script mistake) when some tasks of a container ar

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Srivatsa Vaddagiri
On Wed, Mar 07, 2007 at 03:59:19PM -0600, Serge E. Hallyn wrote: > > containers patches uses just a single pointer in the task_struct, and > > all tasks in the same set of containers (across all hierarchies) will > > share a single container_group object, which holds the actual pointers > > to cont

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Srivatsa Vaddagiri
On Fri, Mar 09, 2007 at 02:06:03PM -0800, Paul Jackson wrote: > > if you create a 'resource container' to limit the > > usage of a set of resources for the processes > > belonging to this container, it would be kind of > > defeating the purpose, if you'd allow the processes > > to manipulate t

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Paul Menage
On 3/11/07, Paul Jackson <[EMAIL PROTECTED]> wrote: My current understanding of Paul Menage's container patch is that it is a useful improvement for some of the metered classes - those that could make good use of a file system like hierarchy for their interface. It probably doesn't benefit all m

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-12 Thread Sam Vilain
Allow me to annotate your nice summary. A lot of this is elaborating on what you are saying; and I think where we disagree, the differences are not important. Paul Jackson wrote: > We have actors, known as threads, tasks or processes, which use things, > which are instances of such classes of thin

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-11 Thread Paul Jackson
Sam, responding to Herbert: > > from my personal PoV the following would be fine: > > > > spaces (for the various 'spaces') > >... > > container (for resource accounting/limits) > >... > > I like these a lot ... Hmmm ... ok ... Let me see if I understand this. We have actors, known as

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-10 Thread Paul Jackson
Sam wrote: > But when you apply this to something like cpusets, it gets a little abstract. Just a tad abstract . Thanks. -- I won't rest till it's the best ... Programmer, Linux Scalability Paul Jackson <[EMAIL PROTECTED]> 1.925.600.0401 - T

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-10 Thread Sam Vilain
Herbert Poetzl wrote: > On Wed, Mar 07, 2007 at 11:44:58PM -0700, Eric W. Biederman wrote: > >> I really don't much care as long as we don't start redefining >> container as something else. I think the IBM guys took it from >> solaris originally which seems to define a zone as a set of >> isola

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-10 Thread Sam Vilain
Paul Jackson wrote: >> But "namespace" has well-established historical semantics too - a way >> of changing the mappings of local * to global objects. This >> accurately describes things liek resource controllers, cpusets, resource >> monitoring, etc. >> > > No! > > Cpusets don't rename or cha

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Srivatsa Vaddagiri
On Sat, Mar 10, 2007 at 07:32:20AM +0530, Srivatsa Vaddagiri wrote: > Ok, let me see if I can convey what I had in mind better: > > uts_ns pid_ns ipc_ns > \|/ > --- > | nsproxy| > >

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Herbert Poetzl
On Sat, Mar 10, 2007 at 12:11:05AM +0530, Srivatsa Vaddagiri wrote: > On Fri, Mar 09, 2007 at 02:16:08AM +0100, Herbert Poetzl wrote: > > On Thu, Mar 08, 2007 at 05:00:54PM +0530, Srivatsa Vaddagiri wrote: > > > On Thu, Mar 08, 2007 at 01:50:01PM +1300, Sam Vilain wrote: > > > > 7. resource namespa

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Srivatsa Vaddagiri
I think maybe I didnt communicate what I mean by a container here (although I thought I did). I am referring to a container in a vserver context (set of tasks which share the same namespace). On Fri, Mar 09, 2007 at 02:09:35PM -0800, Paul Menage wrote: > >2. Regarding space savings, if 100 tasks a

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Paul Menage
On 3/9/07, Srivatsa Vaddagiri <[EMAIL PROTECTED]> wrote: 1. What is the fundamental unit over which resource-management is applied? Individual tasks or individual containers? /me thinks latter. Yes In which case, it makes sense to stick resource control information in the co

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Paul Jackson
> the emphasis here is on 'from inside' which basically > boils down to the following: > > if you create a 'resource container' to limit the > usage of a set of resources for the processes > belonging to this container, it would be kind of > defeating the purpose, if you'd allow the processes

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Herbert Poetzl
On Fri, Mar 09, 2007 at 11:49:08PM +0530, Srivatsa Vaddagiri wrote: > On Fri, Mar 09, 2007 at 01:53:57AM +0100, Herbert Poetzl wrote: >>> The real trick is that I believe these groupings are designed to >>> be something you can setup on login and then not be able to switch >>> out of. Which means w

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Paul Jackson
Herbert wrote (and vatsa quoted): > precisely, once you are inside a resource container, you > must not have the ability to modify its limits, and to > some degree, you should not know about the actual available > resources, but only about the artificial limits Not necessarily. Depending on the r

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Srivatsa Vaddagiri
On Fri, Mar 09, 2007 at 02:16:08AM +0100, Herbert Poetzl wrote: > On Thu, Mar 08, 2007 at 05:00:54PM +0530, Srivatsa Vaddagiri wrote: > > On Thu, Mar 08, 2007 at 01:50:01PM +1300, Sam Vilain wrote: > > > 7. resource namespaces > > > > It should be. Imagine giving 20% bandwidth to a user X. X wants

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Srivatsa Vaddagiri
On Fri, Mar 09, 2007 at 01:53:57AM +0100, Herbert Poetzl wrote: > > The real trick is that I believe these groupings are designed to > > be something you can setup on login and then not be able to switch > > out of. Which means we can't use sessions and process groups as the > > grouping entities a

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Serge E. Hallyn
Quoting Paul Menage ([EMAIL PROTECTED]): > On 3/7/07, Sam Vilain <[EMAIL PROTECTED]> wrote: > > > >Ok, they share this characteristic with namespaces: that they group > >processes. Namespaces have a side effect of grouping processes, but a namespace is not defined by 'grouping proceses.' A contai

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Srivatsa Vaddagiri
On Fri, Mar 09, 2007 at 10:04:30PM +0530, Srivatsa Vaddagiri wrote: > 2. Regarding space savings, if 100 tasks are in a container (I dont know >what is a typical number) -and- lets say that all tasks are to share >the same resource allocation (which seems to be natural), then having >a

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-09 Thread Srivatsa Vaddagiri
On Wed, Mar 07, 2007 at 01:20:18PM -0800, Paul Menage wrote: > On 3/7/07, Serge E. Hallyn <[EMAIL PROTECTED]> wrote: > > > >All that being said, if it were going to save space without overly > >complicating things I'm actually not opposed to using nsproxy, but it > > If space-saving is the main is

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-08 Thread Paul Jackson
Matt wrote: > It's like that Star Trek episode ... except we can't agree on the name Usually, when there is this much heat and smoke over a name, there is really an underlying disagreement or misunderstanding over the meaning of something. The name becomes the proxy for meaning ;). --

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-08 Thread Paul Jackson
> The real trick is that I believe these groupings are designed to be something > you can setup on login and then not be able to switch out of. Which means > we can't use sessions and process groups as the grouping entities as those > have different semantics. Not always on login. For big admin

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-08 Thread Paul Jackson
> But "namespace" has well-established historical semantics too - a way > of changing the mappings of local * to global objects. This > accurately describes things liek resource controllers, cpusets, resource > monitoring, etc. No! Cpusets don't rename or change the mapping of objects. I suspect

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-08 Thread Herbert Poetzl
On Thu, Mar 08, 2007 at 05:00:54PM +0530, Srivatsa Vaddagiri wrote: > On Thu, Mar 08, 2007 at 01:50:01PM +1300, Sam Vilain wrote: > > 7. resource namespaces > > It should be. Imagine giving 20% bandwidth to a user X. X wants to > divide this bandwidth further between multi-media (10%), kernel > co

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-08 Thread Herbert Poetzl
On Wed, Mar 07, 2007 at 11:44:58PM -0700, Eric W. Biederman wrote: > Matt Helsley <[EMAIL PROTECTED]> writes: > > > On Thu, 2007-03-08 at 16:32 +-1300, Sam Vilain wrote: > > > > +ADw-snip+AD4 > > > > +AD4 Kirill, 06032418:36+-03: > > +AD4 +AD4 I propose to use +ACI-namespace+ACI naming. > > +AD4 +

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-08 Thread Herbert Poetzl
On Wed, Mar 07, 2007 at 05:35:58PM -0800, Paul Menage wrote: > On 3/7/07, Eric W. Biederman <[EMAIL PROTECTED]> wrote: >> Pretty much. For most of the other cases I think we are safe >> referring to them as resource controls or resource limits. I know >> that roughly covers what cpusets and beancou

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-08 Thread Herbert Poetzl
On Wed, Mar 07, 2007 at 06:32:10PM -0700, Eric W. Biederman wrote: > "Paul Menage" <[EMAIL PROTECTED]> writes: > >> On 3/7/07, Sam Vilain <[EMAIL PROTECTED]> wrote: >>> But "namespace" has well-established historical semantics too - a way >>> of changing the mappings of local * to global objects.

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-08 Thread Srivatsa Vaddagiri
On Wed, Mar 07, 2007 at 04:16:00PM -0700, Eric W. Biederman wrote: > I think implementation wise this tends to make sense. > However it should have nothing to do with semantics. > > If we have a lot of independent resource controllers. Placing the > pointer to their data structures directly in ns

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-08 Thread Srivatsa Vaddagiri
On Thu, Mar 08, 2007 at 01:50:01PM +1300, Sam Vilain wrote: > 7. resource namespaces It should be. Imagine giving 20% bandwidth to a user X. X wants to divide this bandwidth further between multi-media (10%), kernel compilation (5%) and rest (5%). So, > Is the subservient namespace's resource usa

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-08 Thread Paul Menage
On 3/7/07, Sam Vilain <[EMAIL PROTECTED]> wrote: Ok, they share this characteristic with namespaces: that they group processes. So, they conceptually hang off task_struct. But we put them on ns_proxy because we've got this vague notion that things might be better that way. Remember that I'm

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Eric W. Biederman
Matt Helsley <[EMAIL PROTECTED]> writes: > On Thu, 2007-03-08 at 16:32 +-1300, Sam Vilain wrote: > > +ADw-snip+AD4 > > +AD4 Kirill, 06032418:36+-03: > +AD4 +AD4 I propose to use +ACI-namespace+ACI naming. > +AD4 +AD4 1. This is already used in fs. > +AD4 +AD4 2. This is what IMHO suites at least O

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Eric W. Biederman
Sam Vilain <[EMAIL PROTECTED]> writes: > And do we bother changing IPC namespaces or let that one slide? ipc namespaces works (if you worry about tiny details like we put the resource limits for the sysv ipc objects inside the namespace). Probably the most instructive example of this is that you

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Matt Helsley
On Thu, 2007-03-08 at 16:32 +1300, Sam Vilain wrote: > Kirill, 06032418:36+03: > > I propose to use "namespace" naming. > > 1. This is already used in fs. > > 2. This is what IMHO suites at least OpenVZ/Eric > > 3. it has good acronym "ns". > > Right. So, now I'll also throw into the mix: > >

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Sam Vilain
Paul Menage wrote: > I made sure to check [...]wikipedia.org[...] when this argument started ... > :-) > Wikipedia?! That's not a referen[...] oh bugger it. I've vented enough today and we're on the same page now I think. >> This is the classic terminology problem between substance and fun

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Paul Menage
On 3/7/07, Sam Vilain <[EMAIL PROTECTED]> wrote: Sorry, I didn't realise I was talking with somebody qualified enough to speak on behalf of the Generally Established Principles of Computer Science. I made sure to check http://en.wikipedia.org/wiki/Namespace http://en.wikipedia.org/wiki/Namesp

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Sam Vilain
Paul Menage wrote: > Sorry, I think this statement is wrong, by the generally established > meaning of the term namespace in computer science. > Sorry, I didn't realise I was talking with somebody qualified enough to speak on behalf of the Generally Established Principles of Computer Science.

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Eric W. Biederman
"Paul Menage" <[EMAIL PROTECTED]> writes: > On 3/7/07, Eric W. Biederman <[EMAIL PROTECTED]> wrote: >> The real trick is that I believe these groupings are designed to be something >> you can setup on login and then not be able to switch out of. > > That's going to to be the case for most resource

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Paul Menage
On 3/7/07, Eric W. Biederman <[EMAIL PROTECTED]> wrote: Pretty much. For most of the other cases I think we are safe referring to them as resource controls or resource limits.I know that roughly covers what cpusets and beancounters and ckrm currently do. Plus resource monitoring (which may

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Eric W. Biederman
"Paul Menage" <[EMAIL PROTECTED]> writes: > On 3/7/07, Sam Vilain <[EMAIL PROTECTED]> wrote: >> But "namespace" has well-established historical semantics too - a way >> of changing the mappings of local * to global objects. This >> accurately describes things liek resource controllers, cpusets, re

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Paul Menage
On 3/7/07, Sam Vilain <[EMAIL PROTECTED]> wrote: But "namespace" has well-established historical semantics too - a way of changing the mappings of local * to global objects. This accurately describes things liek resource controllers, cpusets, resource monitoring, etc. Sorry, I think this statem

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Sam Vilain
Paul Menage wrote: > But "namespace" has well-established historical semantics too - a way > of changing the mappings of local names to global objects. This > doesn't describe things liek resource controllers, cpusets, resource > monitoring, etc. > > Trying to extend the well-known term namespace t

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Sam Vilain
Srivatsa Vaddagiri wrote: > container structure in your patches provides for these things: > > a. A way to group tasks > b. A way to maintain several hierarchies of such groups > > If you consider just a. then I agree that container abstraction is > redundant, esp for vserver resource control (ns

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Paul Menage
On 3/7/07, Sam Vilain <[EMAIL PROTECTED]> wrote: Paul Menage wrote: >> In the namespace world when we say container we mean roughly at the level >> of nsproxy and container_group. >> > So you're saying that a task can only be in a single system-wide container. > Nope, we didn't make the mistake

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Sam Vilain
Paul Menage wrote: >> In the namespace world when we say container we mean roughly at the level >> of nsproxy and container_group. >> > So you're saying that a task can only be in a single system-wide container. > Nope, we didn't make the mistake of nailing down what a "container" was too

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Paul Menage
On 3/7/07, Eric W. Biederman <[EMAIL PROTECTED]> wrote: > Effectively, container_group is to container as nsproxy is to namespace. The statement above nicely summarizes the confusion in terminology. In the namespace world when we say container we mean roughly at the level of nsproxy and contain

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Eric W. Biederman
"Paul Menage" <[EMAIL PROTECTED]> writes: > No, Sam was saying that nsproxy should be the object that all resource > controllers hook off. I think implementation wise this tends to make sense. However it should have nothing to do with semantics. If we have a lot of independent resource controlle

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Eric W. Biederman
Dave Hansen <[EMAIL PROTECTED]> writes: > On Wed, 2007-03-07 at 15:59 -0600, Serge E. Hallyn wrote: >> Space saving was the only reason for nsproxy to exist. >> >> Now of course it also provides the teensiest reduction in # instructions >> since every clone results in just one reference count inc

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Eric W. Biederman
"Paul Menage" <[EMAIL PROTECTED]> writes: > On 3/7/07, Serge E. Hallyn <[EMAIL PROTECTED]> wrote: >> >> All that being said, if it were going to save space without overly >> complicating things I'm actually not opposed to using nsproxy, but it > > If space-saving is the main issue, then the latest

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Dave Hansen
On Wed, 2007-03-07 at 15:59 -0600, Serge E. Hallyn wrote: > Space saving was the only reason for nsproxy to exist. > > Now of course it also provides the teensiest reduction in # instructions > since every clone results in just one reference count inc for the > nsproxy rather than one for each nam

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Serge E. Hallyn
Quoting Paul Menage ([EMAIL PROTECTED]): > On 3/7/07, Serge E. Hallyn <[EMAIL PROTECTED]> wrote: > > > >All that being said, if it were going to save space without overly > >complicating things I'm actually not opposed to using nsproxy, but it > > If space-saving is the main issue, then the latest

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Paul Menage
On 3/7/07, Serge E. Hallyn <[EMAIL PROTECTED]> wrote: All that being said, if it were going to save space without overly complicating things I'm actually not opposed to using nsproxy, but it If space-saving is the main issue, then the latest version of my containers patches uses just a single

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Serge E. Hallyn
Quoting Srivatsa Vaddagiri ([EMAIL PROTECTED]): > On Wed, Mar 07, 2007 at 11:43:46AM -0600, Serge E. Hallyn wrote: > > I still think the complaint was about terminology, not implementation. > > I don't think that is what http://lkml.org/lkml/2007/2/12/426 conveyed! I don't have that in my inbox a

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Srivatsa Vaddagiri
On Wed, Mar 07, 2007 at 11:43:46AM -0600, Serge E. Hallyn wrote: > I still think the complaint was about terminology, not implementation. I don't think that is what http://lkml.org/lkml/2007/2/12/426 conveyed! > They just didn't want you calling them containers. Yes that too. > > Anyway, summar

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Srivatsa Vaddagiri
On Wed, Mar 07, 2007 at 09:29:12AM -0800, Paul Menage wrote: > That seems bad. With the current way you're doing it, if I mount > hierarchies A and B on /mnt/A and /mnt/B, then initially all tasks are > in /mnt/A/tasks and /mnt/B/tasks. If I then create /mnt/A/foo and move > a process into it, that

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Paul Menage
On 3/7/07, Serge E. Hallyn <[EMAIL PROTECTED]> wrote: Quoting Srivatsa Vaddagiri ([EMAIL PROTECTED]): > On Tue, Mar 06, 2007 at 06:32:07PM -0800, Paul Menage wrote: > > I'm not really sure that I see the value of having this be part of > > nsproxy rather than the previous independent container (a

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Serge E. Hallyn
Quoting Srivatsa Vaddagiri ([EMAIL PROTECTED]): > On Tue, Mar 06, 2007 at 06:32:07PM -0800, Paul Menage wrote: > > I'm not really sure that I see the value of having this be part of > > nsproxy rather than the previous independent container (and > > container_group) structure. > > *shrug* > > I

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Paul Menage
On 3/7/07, Srivatsa Vaddagiri <[EMAIL PROTECTED]> wrote: > - when you do sys_unshare() or a clone that creates new namespaces, > then the task (or its child) will get a new nsproxy that has the rcfs > subsystem state associated with the old nsproxy, and one or more > namespace pointers cloned to

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Srivatsa Vaddagiri
On Wed, Mar 07, 2007 at 11:00:31PM +0530, Srivatsa Vaddagiri wrote: > So we got several choices here. > > 1. Introduce the container abstraction as is in your patches > 2. Extend nsproxy somehow to represent hierarchies > 3. Let individual resource controllers that -actually- support >hierarch

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-07 Thread Srivatsa Vaddagiri
On Tue, Mar 06, 2007 at 06:32:07PM -0800, Paul Menage wrote: > I'm not really sure that I see the value of having this be part of > nsproxy rather than the previous independent container (and > container_group) structure. *shrug* I wrote the patch mainly to see whether the stuff container folks

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-06 Thread Paul Menage
Hi Vatsa, Sorry for the delayed reply - the last week has been very busy ... On 3/1/07, Srivatsa Vaddagiri <[EMAIL PROTECTED]> wrote: Paul, Based on some of the feedback to container patches, I have respun them to avoid the "container" structure abstraction and instead use nsproxy struc

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-06 Thread Srivatsa Vaddagiri
On Tue, Mar 06, 2007 at 02:28:39PM +0100, Herbert Poetzl wrote: > groups like Memory, Disk Space, Sockets might make > sense though, although we never had a single request > for any overlapping in the resource management (while > we have quite a few users of overlapping Network spaces) If we have

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-06 Thread Herbert Poetzl
On Tue, Mar 06, 2007 at 04:09:40PM +0530, Srivatsa Vaddagiri wrote: > On Mon, Mar 05, 2007 at 07:39:37PM +0100, Herbert Poetzl wrote: > > > Thats why nsproxy has pointers to resource control objects, rather > > > than embedding resource control information in nsproxy itself. > > > > which makes it

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-06 Thread Srivatsa Vaddagiri
On Mon, Mar 05, 2007 at 07:39:37PM +0100, Herbert Poetzl wrote: > > Thats why nsproxy has pointers to resource control objects, rather > > than embedding resource control information in nsproxy itself. > > which makes it a (name)space, no? I tend to agree, yes! > > This will let different nsprox

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-05 Thread Herbert Poetzl
On Mon, Mar 05, 2007 at 11:04:01PM +0530, Srivatsa Vaddagiri wrote: > On Sat, Mar 03, 2007 at 06:32:44PM +0100, Herbert Poetzl wrote: > > > Yes, perhaps this overloads nsproxy more than what it was intended for. > > > But, then if we have to to support resource management of each > > > container/vs

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-05 Thread Srivatsa Vaddagiri
On Sat, Mar 03, 2007 at 01:22:44PM -0800, Paul Jackson wrote: > I still can't claim to have my head around this, but what you write > here, Herbert, writes here touches on what I suspect is a key > difference between namespaces and resources that would make it > impractical to accomplish both with

Re: [ckrm-tech] [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-05 Thread Srivatsa Vaddagiri
On Sat, Mar 03, 2007 at 06:32:44PM +0100, Herbert Poetzl wrote: > > Yes, perhaps this overloads nsproxy more than what it was intended for. > > But, then if we have to to support resource management of each > > container/vserver (or whatever group is represented by nsproxy), > > then nsproxy seems

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-05 Thread Srivatsa Vaddagiri
On Sat, Mar 03, 2007 at 02:21:00AM -0800, Paul Jackson wrote: > Perhaps you could summarize what becomes of this hook, in this > brave new world of rcfs ... attach_task() still uses a synchronize_rcu before doing a put_nsproxy in the rcfs patches. This means cpuset_update_task_memory_state() can r

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-03 Thread Paul Jackson
Herbert wrote: > I agree here, there is not much difference for the > following aspects: Whether two somewhat similar needs should be met by one shared mechanism, or two distinct mechanisms, cannot really be decided by listing the similarities. One has to determine if there are any significant di

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-03 Thread Herbert Poetzl
On Fri, Mar 02, 2007 at 06:45:06PM +0300, Kirill Korotaev wrote: > Paul, > > >>I suspect we can make cpusets also work > >>on top of this very easily. > > > > > > I'm skeptical, and kinda worried. > > > > ... can you show me the code that does this? > don't worry. we are not planning to commit

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-03 Thread Herbert Poetzl
On Sat, Mar 03, 2007 at 03:06:55PM +0530, Srivatsa Vaddagiri wrote: > On Thu, Mar 01, 2007 at 11:39:00AM -0800, Paul Jackson wrote: > > vatsa wrote: > > > I suspect we can make cpusets also work > > > on top of this very easily. > > > > I'm skeptical, and kinda worried. > > > > ... can you show m

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-03 Thread Paul Jackson
> Regarding semantics, can you be more specific? Unfortunately not - sorry. I've been off in other areas, and not found the time to read through this current PATCH or think about it carefully enough to be really useful. Your reply seemed reasonable enough. > It should have the same perf overhea

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-03 Thread Srivatsa Vaddagiri
On Thu, Mar 01, 2007 at 11:39:00AM -0800, Paul Jackson wrote: > vatsa wrote: > > I suspect we can make cpusets also work > > on top of this very easily. > > I'm skeptical, and kinda worried. > > ... can you show me the code that does this? In essense, the rcfs patch is same as the original conta

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-02 Thread Kirill Korotaev
Andrew, >>>I'm wagering you'll break either the semantics, and/or the >>>performance, of cpusets doing this. >> >>I like Paul's containers patch. It looks good and pretty well. >>After some of the context issues are resolved it's fine. >>Maybe it is even the best way of doing things. > > > Have

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-02 Thread Andrew Morton
On Fri, 02 Mar 2007 18:45:06 +0300 Kirill Korotaev <[EMAIL PROTECTED]> wrote: > > I'm wagering you'll break either the semantics, and/or the > > performance, of cpusets doing this. > I like Paul's containers patch. It looks good and pretty well. > After some of the context issues are resolved it's

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-02 Thread Kirill Korotaev
Paul, >>I suspect we can make cpusets also work >>on top of this very easily. > > > I'm skeptical, and kinda worried. > > ... can you show me the code that does this? don't worry. we are not planning to commit any code breaking cpusets... I will be the first one against it. > Namespaces are no

Re: [PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-01 Thread Paul Jackson
vatsa wrote: > I suspect we can make cpusets also work > on top of this very easily. I'm skeptical, and kinda worried. ... can you show me the code that does this? Namespaces are not the same thing as actual resources (memory, cpu cycles, ...). Namespaces are fluid mappings; Resources are scarc

[PATCH 0/2] resource control file system - aka containers on top of nsproxy!

2007-03-01 Thread Srivatsa Vaddagiri
Paul, Based on some of the feedback to container patches, I have respun them to avoid the "container" structure abstraction and instead use nsproxy structure in the kernel. User interface (which I felt was neat in your patches) has been retained to be same. What follows is the core (big) p