Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-08 Thread Wido den Hollander
Hi, To conclude, after doing a lot of work in debugging we were able to reduce the deployment of our VRs from ~2 hours to ~5 MINUTES. Two PRs are open for this against the 4.9 branch: - https://github.com/apache/cloudstack/pull/2077 - https://github.com/apache/cloudstack/pull/2089 The problem

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-07 Thread Daan Hoogland
> > > From: Remi Bergsma > > > > > Sent: 03 May 2017 16:58:18 > > > > > To: dev@cloudstack.apache.org > > > > > Subject: Re: Very slow Virtual Router provisioning with 4.9.2.0 > > > > > > >

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-04 Thread Wido den Hollander
> > > > > > > On 3 May 2017 2:25 pm, "Remi Bergsma" > > > wrote: > > > > > > > > > Always happy to share, but I won’t have time to work on porting this > > > > > to > > > > > CloudStack any time soon. > >

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-04 Thread Wido den Hollander
3 May 2017 2:25 pm, "Remi Bergsma" > > wrote: > > > > > > > Always happy to share, but I won’t have time to work on porting this to > > > > CloudStack any time soon. > > > > > > > > Regards, Remi > > > > > > > > > > > > On 03/05/2017, 13:44, "Rohit

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-04 Thread Wei ZHOU
; > Hi Remi, thanks for sharing. We would love to have those changes > (for > > > 4.9+), looking forward to your pull requests. > > > > > > > > > Regards. > > > > > > > > > From: Rem

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-04 Thread Wido den Hollander
ot; wrote: > > > > Hi Remi, thanks for sharing. We would love to have those changes (for > > 4.9+), looking forward to your pull requests. > > > > > > Regards. > > > > ________ > > From: Remi Be

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-03 Thread Rene Moser
Thanks Remi for the hint and Daan for pick it up! That is why I like open source software development and this project ;) On 05/03/2017 02:49 PM, Daan Hoogland wrote: > Happy to pick this up, Remi. I'm travelling now but will look at both on > Friday.

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-03 Thread Daan Hoogland
___ > From: Remi Bergsma > Sent: 03 May 2017 16:58:18 > To: dev@cloudstack.apache.org > Subject: Re: Very slow Virtual Router provisioning with 4.9.2.0 > > Hi, > > The patches I talked about: > > 1) Iptables speed improvement >

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-03 Thread Remi Bergsma
l requests. Regards. From: Remi Bergsma Sent: 03 May 2017 16:58:18 To: dev@cloudstack.apache.org Subject: Re: Very slow Virtual Router provisioning with 4.9.2.0 Hi, The patches I talked about: 1) Iptables speed i

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-03 Thread Rohit Yadav
Hi Remi, thanks for sharing. We would love to have those changes (for 4.9+), looking forward to your pull requests. Regards. From: Remi Bergsma Sent: 03 May 2017 16:58:18 To: dev@cloudstack.apache.org Subject: Re: Very slow Virtual Router provisioning with

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-03 Thread Remi Bergsma
Hi, The patches I talked about: 1) Iptables speed improvement https://github.com/apache/cloudstack/pull/1482 Was reverted due to a licensing issue. 2) Passwd speed improvement https://github.com/MissionCriticalCloudOldRepos/cosmic-core/pull/138 By now, these are rather old patches so they ne

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-03 Thread Jeff Hair
Hi Remi, Do you have a link to the PR that was reverted? And also possibly the code that makes the password updating more efficient? Jeff On Wed, May 3, 2017 at 10:36 AM, Remi Bergsma wrote: > Hi Wido, > > When we had similar issues last year, we found that for example comparing > the iptables

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-03 Thread Remi Bergsma
Hi Wido, When we had similar issues last year, we found that for example comparing the iptables rules one-by-one is 1000x slower than simply loading them all at once. Boris rewrote this part in our Cosmic fork, may be worth looking into this again. The PR to CloudStack was merged, but reverted

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-03 Thread Jayapal Uradi
Another reason of slow can be VR configuration(persistent VR configuration design). When one component config apply, whole VR configuration apply is executed. Due to this the VR boot up time will increase. Thanks, Jayapal > On May 3, 2017, at 1:55 PM, Marc-Aurèle Brothier wrote: > > Hi Wido

Re: Very slow Virtual Router provisioning with 4.9.2.0

2017-05-03 Thread Marc-Aurèle Brothier
Hi Wido, Well for us, it's not a version problem, it's simply a design problem. This VR is very problematic during any upgrade of cloudstack (which I perform every week almost on our platform), same goes for the secondary storage VMs which scans all templates. We've planned on our roadmap to get r