Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-10 Thread Attila Fazekas
- Original Message - > From: "Attila Fazekas" > To: "OpenStack Development Mailing List (not for usage questions)" > > Sent: Tuesday, March 10, 2015 12:48:00 PM > Subject: Re: [openstack-dev] [nova] blueprint about multiple wor

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-10 Thread Attila Fazekas
- Original Message - > From: "Nikola Đipanov" > To: openstack-dev@lists.openstack.org > Sent: Tuesday, March 10, 2015 10:53:01 AM > Subject: Re: [openstack-dev] [nova] blueprint about multiple workers > supported in nova-scheduler > > On 03/06/2015

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-10 Thread Attila Fazekas
- Original Message - > From: "Jay Pipes" > To: openstack-dev@lists.openstack.org > Sent: Wednesday, March 4, 2015 9:22:43 PM > Subject: Re: [openstack-dev] [nova] blueprint about multiple workers > supported in nova-scheduler > > On 03/04/2015 01:51 A

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-10 Thread Nikola Đipanov
On 03/06/2015 03:19 PM, Attila Fazekas wrote: > Looks like we need some kind of _per compute node_ mutex in the critical > section, > multiple scheduler MAY be able to schedule to two compute node at same time, > but not for scheduling to the same compute node. > > If we don't want to introduce a

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-06 Thread Mehdi Abaakouk
Hi, just some oslo.messaging thoughts about having multiple nova-scheduler processes (can also apply to any other daemon acting as rpc server), nova-scheduler use service.Service.create() to create a rpc server, that one is identified by a 'topic' and a 'server' (the oslo.messaging.Target).

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-06 Thread Attila Fazekas
- Original Message - > From: "Attila Fazekas" > To: "OpenStack Development Mailing List (not for usage questions)" > > Sent: Friday, March 6, 2015 4:19:18 PM > Subject: Re: [openstack-dev] [nova] blueprint about multiple workers > supported in

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-06 Thread Attila Fazekas
v@lists.openstack.org > Sent: Friday, March 6, 2015 10:29:52 AM > Subject: Re: [openstack-dev] [nova] blueprint about multiple workers > supported in nova-scheduler > > On 03/06/2015 01:56 AM, Rui Chen wrote: > > Thank you very much for in-depth discussion about this topic, @Niko

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-06 Thread Nikola Đipanov
On 03/06/2015 01:56 AM, Rui Chen wrote: > Thank you very much for in-depth discussion about this topic, @Nikola > and @Sylvain. > > I agree that we should solve the technical debt firstly, and then make > the scheduler better. > That was not necessarily my point. I would be happy to see work on

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-05 Thread Rui Chen
Thank you very much for in-depth discussion about this topic, @Nikola and @Sylvain. I agree that we should solve the technical debt firstly, and then make the scheduler better. Best Regards. 2015-03-05 21:12 GMT+08:00 Sylvain Bauza : > > Le 05/03/2015 13:00, Nikola Đipanov a écrit : > > On 03/

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-05 Thread Sylvain Bauza
Le 05/03/2015 13:00, Nikola Đipanov a écrit : On 03/04/2015 09:23 AM, Sylvain Bauza wrote: Le 04/03/2015 04:51, Rui Chen a écrit : Hi all, I want to make it easy to launch a bunch of scheduler processes on a host, multiple scheduler workers will make use of multiple processors of host and enh

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-05 Thread Nikola Đipanov
On 03/04/2015 09:23 AM, Sylvain Bauza wrote: > > Le 04/03/2015 04:51, Rui Chen a écrit : >> Hi all, >> >> I want to make it easy to launch a bunch of scheduler processes on a >> host, multiple scheduler workers will make use of multiple processors >> of host and enhance the performance of nova-sch

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-05 Thread Rui Chen
spent the past several months adding >>>> features directly to SQLAlchemy that allow an ORM-based app to have >>>> routes >>>> to operations that perform just as fast as that of Core without a >>>> rewrite of >>>> code. >>>> >

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-05 Thread Sylvain Bauza
>> To: "OpenStack Development Mailing List (not for usage questions)" mailto:openstack-dev@lists.openstack.org>> >> Sent: Wednesday, March 4, 2015 4:51:07 AM >> Subject: [openstack-dev] [nova] blueprint about

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-04 Thread Rui Chen
The scheduler does lot of thing in the application, like filtering >>> > what can be done on the DB level more efficiently. Why it is not done >>> > on the DB side ? >>> > >>> > There are use cases when the scheduler would need to know even more >

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-04 Thread Alex Xu
ng` in all schedulers process >> memory up-to-date ? >> > (Maybe zookeeper) >> > >> > The opposite way would be to move most operation into the DB side, >> > since the DB already knows everything. >> > (stored procedures ?) >> > >> &g

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-04 Thread Rui Chen
> since the DB already knows everything. > > (stored procedures ?) > > > > Best Regards, > > Attila > > > > > > - Original Message - > >> From: "Rui Chen" > >> To: "OpenStack Development Mailing List (not for usage qu

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-04 Thread Mike Bayer
res ?) > > Best Regards, > Attila > > > - Original Message - >> From: "Rui Chen" >> To: "OpenStack Development Mailing List (not for usage questions)" >> >> Sent: Wednesday, March 4, 2015 4:51:07 AM >> Subject: [openstack-d

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-04 Thread Jay Pipes
March 4, 2015 4:51:07 AM Subject: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler Hi all, I want to make it easy to launch a bunch of scheduler processes on a host, multiple scheduler workers will make use of multiple processors of host and enhance the perfo

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-04 Thread Attila Fazekas
nesday, March 4, 2015 4:51:07 AM > Subject: [openstack-dev] [nova] blueprint about multiple workers supported > in nova-scheduler > > Hi all, > > I want to make it easy to launch a bunch of scheduler processes on a host, > multiple scheduler workers will make use of multipl

Re: [openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-04 Thread Sylvain Bauza
Le 04/03/2015 04:51, Rui Chen a écrit : Hi all, I want to make it easy to launch a bunch of scheduler processes on a host, multiple scheduler workers will make use of multiple processors of host and enhance the performance of nova-scheduler. I had registered a blueprint and commit a patch t

[openstack-dev] [nova] blueprint about multiple workers supported in nova-scheduler

2015-03-03 Thread Rui Chen
Hi all, I want to make it easy to launch a bunch of scheduler processes on a host, multiple scheduler workers will make use of multiple processors of host and enhance the performance of nova-scheduler. I had registered a blueprint and commit a patch to implement it. https://blueprints.launchpad.n