Re: [Pacemaker] Resource capacity limit

2010-03-04 Thread Andrew Beekhof
On Fri, Oct 30, 2009 at 12:41 PM, Yan Gao wrote: > Hi Andrew and Lars, > The attachment is the first try to implement "Resource capacity limit" > which is issued by Lars from: > https://fate.novell.com/303384 > > Description: > We need a mechanism for the PE to take resource weight into account to

Re: [Pacemaker] Resource capacity limit

2010-03-04 Thread Yan Gao
Hi Andrew, I added utilization support for crm_attribute and crm_resource. Attached the patch. Please let me know if you have any comments or suggestions on that. BTW, LF#2351 has been fixed. Attached the patch there: http://developerbugs.linux-foundation.org/show_bug.cgi?id=2351 Thanks, Yan --

Re: [Pacemaker] Resource capacity limit

2009-12-13 Thread Yan Gao
Hi Andrew, Yan Gao wrote: > On 12/10/09 12:56, Yan Gao wrote: >> Hi Andrew, >> Attached the hg export patch against the devel branch for that. Hope >> that's easier to be merged:-) > And the patch including the test cases. The *.score files were adopted the wrong file name extension rather than "s

Re: [Pacemaker] Resource capacity limit

2009-12-10 Thread Yan Gao
Andrew Beekhof wrote: > On Thu, Dec 10, 2009 at 9:52 AM, Yan Gao wrote: >> On 12/10/09 12:56, Yan Gao wrote: >>> Hi Andrew, >>> Attached the hg export patch against the devel branch for that. Hope >>> that's easier to be merged:-) >> And the patch including the test cases. > > Done. Thanks for y

Re: [Pacemaker] Resource capacity limit

2009-12-10 Thread Andrew Beekhof
On Thu, Dec 10, 2009 at 9:52 AM, Yan Gao wrote: > On 12/10/09 12:56, Yan Gao wrote: >> Hi Andrew, >> Attached the hg export patch against the devel branch for that. Hope >> that's easier to be merged:-) > And the patch including the test cases. Done. Thanks for your efforts! ___

Re: [Pacemaker] Resource capacity limit

2009-12-10 Thread Yan Gao
On 12/10/09 12:56, Yan Gao wrote: > Hi Andrew, > Attached the hg export patch against the devel branch for that. Hope > that's easier to be merged:-) And the patch including the test cases. Thanks, Yan -- y...@novell.com Software Engineer China Server Team, OPS Engineering Novell, Inc. Making

Re: [Pacemaker] Resource capacity limit

2009-12-09 Thread Yan Gao
Hi Andrew, Attached the hg export patch against the devel branch for that. Hope that's easier to be merged:-) Thanks, Yan -- y...@novell.com Software Engineer China Server Team, OPS Engineering Novell, Inc. Making IT Work As Oneā„¢ # HG changeset patch # User Yan Gao # Date 1260419866 -28800 #

Re: [Pacemaker] Resource capacity limit

2009-11-20 Thread Yan Gao
Hi Andrew, On 11/20/09 04:10, Andrew Beekhof wrote: > Btw. You're still missing some test cases ;-) Oh, right:-) I created some. Hope I created them in the correct way. Sorry for so many attachments... Thanks, Yan -- y...@novell.com Software Engineer China Server Team, OPS Engineering Novell,

Re: [Pacemaker] Resource capacity limit

2009-11-19 Thread Andrew Beekhof
Btw. You're still missing some test cases ;-) On Fri, Nov 13, 2009 at 8:23 AM, Yan Gao wrote: > Hi Andrew, Lars, > > Andrew Beekhof wrote: >> I'd like to see the while-block from native_color() be a function that >> is called from native_assign_node(). > It seems to be too late to filter out the

Re: [Pacemaker] Resource capacity limit

2009-11-17 Thread Lars Marowsky-Bree
On 2009-11-13T15:23:20, Yan Gao wrote: > Minimal: > Consider the utilization of nodes and resources. While if a resource has > the same score for several available nodes, do _not_ balance the load. > That implies that the resources will be concentrated to minimal number of > nodes. > > Balance

Re: [Pacemaker] Resource capacity limit

2009-11-13 Thread Andrew Beekhof
On Thu, Nov 12, 2009 at 11:58 PM, Lars Marowsky-Bree wrote: > On 2009-11-12T14:53:24, Andrew Beekhof wrote: > >> At this point in time, I can't see us going back to the way heartbeat >> releases were done. >> If there was a single thing that I'd credit Pacemaker's current >> reliability to, it wo

Re: [Pacemaker] Resource capacity limit

2009-11-13 Thread Andrew Beekhof
On Fri, Nov 13, 2009 at 8:23 AM, Yan Gao wrote: > Hi Andrew, Lars, > > Andrew Beekhof wrote: >> I'd like to see the while-block from native_color() be a function that >> is called from native_assign_node(). > It seems to be too late to filter out the nodes without enough capacity from > native_ass

Re: [Pacemaker] Resource capacity limit

2009-11-12 Thread Yan Gao
Hi Andrew, Lars, Andrew Beekhof wrote: > I'd like to see the while-block from native_color() be a function that > is called from native_assign_node(). It seems to be too late to filter out the nodes without enough capacity from native_assign_node(). I wrote a have_enough_capacity() function which

Re: [Pacemaker] Resource capacity limit

2009-11-12 Thread Steven Dake
On Thu, 2009-11-12 at 14:53 +0100, Andrew Beekhof wrote: > On Wed, Nov 11, 2009 at 1:36 PM, Lars Marowsky-Bree wrote: > > On 2009-11-05T14:45:36, Andrew Beekhof wrote: > > > >> Lastly, I would really like to defer this for 1.2 > >> I know I've bent the rules a bit for 1.0 in the past, but its rea

Re: [Pacemaker] Resource capacity limit

2009-11-12 Thread Lars Marowsky-Bree
On 2009-11-12T14:53:24, Andrew Beekhof wrote: > At this point in time, I can't see us going back to the way heartbeat > releases were done. > If there was a single thing that I'd credit Pacemaker's current > reliability to, it would be our release strategy. Well, exactly, and that's what pacemak

Re: [Pacemaker] Resource capacity limit

2009-11-12 Thread Andrew Beekhof
On Wed, Nov 11, 2009 at 1:36 PM, Lars Marowsky-Bree wrote: > On 2009-11-05T14:45:36, Andrew Beekhof wrote: > >> Lastly, I would really like to defer this for 1.2 >> I know I've bent the rules a bit for 1.0 in the past, but its really >> late in the game now. > > Personally, I think the Linux kern

Re: [Pacemaker] Resource capacity limit

2009-11-12 Thread Andrew Beekhof
On Wed, Nov 11, 2009 at 1:42 PM, Lars Marowsky-Bree wrote: > On 2009-11-06T12:45:17, Andrew Beekhof wrote: > >> And instead of a limit-utilization option, we'd have >> placement-strategy=(default|utilization|minimal) >> >> Default ::= what we do now >> Utilization ::= what you've implemented > >

Re: [Pacemaker] Resource capacity limit

2009-11-11 Thread Lars Marowsky-Bree
On 2009-11-09T10:52:03, Michael Schwartzkopff wrote: > I just think it would be cool solution to make the cluster itself > doing the work if condfigured to do so. So the CRM (or the RAs) should > have the abaility to monitor the resource consumption of resources > dynamically. This automatism wou

Re: [Pacemaker] Resource capacity limit

2009-11-11 Thread Lars Marowsky-Bree
On 2009-11-06T12:45:17, Andrew Beekhof wrote: > And instead of a limit-utilization option, we'd have > placement-strategy=(default|utilization|minimal) > > Default ::= what we do now > Utilization ::= what you've implemented These two are obvious, since we can already do them with existing code

Re: [Pacemaker] Resource capacity limit

2009-11-11 Thread Lars Marowsky-Bree
On 2009-11-05T14:45:36, Andrew Beekhof wrote: > Lastly, I would really like to defer this for 1.2 > I know I've bent the rules a bit for 1.0 in the past, but its really > late in the game now. Personally, I think the Linux kernel model works really well. ie, no "major releases" any more, but bug

Re: [Pacemaker] Resource capacity limit

2009-11-09 Thread Michael Schwartzkopff
Am Freitag, 6. November 2009 08:49:06 schrieb Andrew Beekhof: > On Fri, Nov 6, 2009 at 8:31 AM, Michael Schwartzkopff wrote: > > Am Donnerstag, 5. November 2009 21:37:23 schrieb Andrew Beekhof: > >> On Thu, Nov 5, 2009 at 8:50 PM, Michael Schwartzkopff > >> > > > > wrote: > >> > Hi, > >> > > >>

Re: [Pacemaker] Resource capacity limit

2009-11-08 Thread Yan Gao
Hi, Andrew Beekhof wrote: > > I've been thinking about this more and while this will work, I think > we can make it better. > > I'd like to see the while-block from native_color() be a function that > is called from native_assign_node(). Okay. > And instead of a limit-utilization option, we'd ha

Re: [Pacemaker] Resource capacity limit

2009-11-06 Thread Dejan Muhamedagic
Hi, On Thu, Nov 05, 2009 at 07:28:16PM +0100, Andrew Beekhof wrote: > On Thu, Nov 5, 2009 at 5:25 PM, Dejan Muhamedagic wrote: > > Hi, > >> Which reminds me, I need to get devel sorted out... > > > > While you're at it, perhaps it would be good to rethink the > > release policy. For me in particu

Re: [Pacemaker] Resource capacity limit

2009-11-05 Thread Andrew Beekhof
On Fri, Nov 6, 2009 at 8:31 AM, Michael Schwartzkopff wrote: > Am Donnerstag, 5. November 2009 21:37:23 schrieb Andrew Beekhof: >> On Thu, Nov 5, 2009 at 8:50 PM, Michael Schwartzkopff > wrote: >> > Hi, >> > >> > on the list was a discussion about resource capacity limits. Yan Gao also >> > imple

Re: [Pacemaker] Resource capacity limit

2009-11-05 Thread Michael Schwartzkopff
Am Donnerstag, 5. November 2009 21:37:23 schrieb Andrew Beekhof: > On Thu, Nov 5, 2009 at 8:50 PM, Michael Schwartzkopff wrote: > > Hi, > > > > on the list was a discussion about resource capacity limits. Yan Gao also > > implemented it. > > > > As far as I understood the discussion the solution

Re: [Pacemaker] Resource capacity limit

2009-11-05 Thread Yan Gao
Hi Andrew, Andrew Beekhof wrote: > On Tue, Nov 3, 2009 at 12:15 PM, Yan Gao wrote: >> Hi again, >> >> Yan Gao wrote: >> >> XML sample: >> .. >> >> >> >> >> >> >> >> >> .. >> >> >> >> >> >> >>

Re: [Pacemaker] Resource capacity limit

2009-11-05 Thread Yan Gao
Hi Andrew, Thanks for your reply! Andrew Beekhof wrote: > On Wed, Nov 4, 2009 at 5:41 PM, Lars Marowsky-Bree wrote: >> On 2009-11-03T19:15:59, Yan Gao wrote: >> >>> XML sample: >>> .. >>> >>> >>> >>> >>> >>> >>> >>> >>> .. >>>

Re: [Pacemaker] Resource capacity limit

2009-11-05 Thread Andrew Beekhof
On Thu, Nov 5, 2009 at 8:50 PM, Michael Schwartzkopff wrote: > Hi, > > on the list was a discussion about resource capacity limits. Yan Gao also > implemented it. > > As far as I understood the discussion the solution is to attach nodes and > resources capacity limits. Resources are distributed on

[Pacemaker] Resource capacity limit

2009-11-05 Thread Michael Schwartzkopff
Hi, on the list was a discussion about resource capacity limits. Yan Gao also implemented it. As far as I understood the discussion the solution is to attach nodes and resources capacity limits. Resources are distributed on the nodes of a cluster according to its capacatiy needs. They would be

Re: [Pacemaker] Resource capacity limit

2009-11-04 Thread Lars Marowsky-Bree
On 2009-11-03T19:15:59, Yan Gao wrote: > XML sample: > .. > > > > > > > > > .. > > > > > > > > > > > > > > > .. >

Re: [Pacemaker] Resource capacity limit

2009-11-03 Thread Yan Gao
Hi again, Yan Gao wrote: > Hi Lars, > Thanks for the great suggestions! > > Lars Marowsky-Bree wrote: >> On 2009-10-30T19:41:35, Yan Gao wrote: >>> Configuration example: >>> >>> node yingying \ >>> attributes capacity="100" >>> primitive dummy0 ocf:heartbeat:Dummy \ >>> meta weight="90"

Re: [Pacemaker] Resource capacity limit

2009-11-01 Thread Yan Gao
Hi Lars, Thanks for the great suggestions! Lars Marowsky-Bree wrote: > On 2009-10-30T19:41:35, Yan Gao wrote: >> >> Configuration example: >> >> node yingying \ >> attributes capacity="100" >> primitive dummy0 ocf:heartbeat:Dummy \ >> meta weight="90" priority="2" >> primitive dummy1 oc

Re: [Pacemaker] Resource capacity limit

2009-10-30 Thread Raoul Bhatia [IPAX]
hi, On 10/30/2009 01:20 PM, Lars Marowsky-Bree wrote: > I think this is a two phase feature for the PE: The first phase is what > you propose - make sure we do not overload any given node, basically > implementing hard limits. > > The second phase would be for the PE to actually try to "optimize"

Re: [Pacemaker] Resource capacity limit

2009-10-30 Thread Lars Marowsky-Bree
On 2009-10-30T19:41:35, Yan Gao wrote: Hi Yan Gao, excellent! Before reviewing the code, lets review the interface/configuration though. > User case: > Xen guests have memory requirements; nodes cannot host more guests than > the node has physical memory installed. > > > Configuration exampl

[Pacemaker] Resource capacity limit

2009-10-30 Thread Yan Gao
Hi Andrew and Lars, The attachment is the first try to implement "Resource capacity limit" which is issued by Lars from: https://fate.novell.com/303384 Description: We need a mechanism for the PE to take resource weight into account to prevent nodes from being overloaded. Resources would require