I will get that PR in one of my Bubbles today to see if I have problems. *Will STEVENS* Lead Developer
*CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Tue, May 17, 2016 at 8:51 AM, Daan Hoogland <daan.hoogl...@gmail.com> wrote: > Rohit, the connector installs from epel and the mysql repo does not > contain the python connector. I think we are not talking about the same > problem. > > On Tue, May 17, 2016 at 2:40 PM, Daan Hoogland <daan.hoogl...@gmail.com> > wrote: > >> I am now trying 1297, for the third time today. >> next to the rpm-build error, I had an error in building the UI and it >> just stopped with the rpm-build error again. >> I did go to master in the bubble scripts. I had to re-add the java7 conf >> and change the config to use the cloudstack section. Other than that it >> seems to work. The rpm-build error arose before going to the head of the >> bubble branch, so I don't think it is related to the bubble itself. >> >> On Tue, May 17, 2016 at 2:32 PM, Will Stevens <wstev...@cloudops.com> >> wrote: >> >>> Can you send me the error you are getting? Also, are you testing >>> against 4.7, 4.8 or master? >>> >>> *Will STEVENS* >>> Lead Developer >>> >>> *CloudOps* *| *Cloud Solutions Experts >>> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 >>> w cloudops.com *|* tw @CloudOps_ >>> >>> On Tue, May 17, 2016 at 8:26 AM, Daan Hoogland <daan.hoogl...@gmail.com> >>> wrote: >>> >>>> H Will, I don't want to break your mojo on this other bughunting but do >>>> you see any rpm packaging errors concerning mysql-connector? >>>> I added the repo for mysql to find out the connector was already >>>> installed. >>>> >>>> BTW this is only one of four to five intermittent errors I'm getting. >>>> Hardly any run succeeds. >>>> >>>> On Tue, May 17, 2016 at 1:55 PM, Will Stevens <wstev...@cloudops.com> >>>> wrote: >>>> >>>>> Yes. I did a clean setup in 6 CI environments. With these PRs in place >>>>> all 6 had the addHost issue. I reverted and did a clean setup again and >>>>> all >>>>> 6 came up perfectly. >>>>> >>>>> I am using bubble on commit 9134cf8be930d0b982829da216471feaf214621f >>>>> to test. I create the CS and KVM instances and then check out the code and >>>>> deploy (two script in bubble). >>>>> >>>>> Once ACS is up and running it does a DeployDC and it fails at this >>>>> point. >>>>> >>>>> I can test your PR and send you the logs. >>>>> On May 17, 2016 12:40 AM, "Rohit Yadav" <bhais...@apache.org> wrote: >>>>> >>>>>> Will, >>>>>> >>>>>> Alright, I've reopened a PR with the changes that were reverted to be >>>>>> reviewed/tested separately again. Can you share if you're able to get >>>>>> your >>>>>> CI env working again after the revert? >>>>>> Can you share in detail how may I reproduce the issues you get that >>>>>> you think are because of Nio related changes, so I can try to fix them. >>>>>> Thanks. >>>>>> >>>>>> Regards. >>>>>> >>>>>> On Tue, May 17, 2016 at 2:49 AM, Will Stevens <wstev...@cloudops.com> >>>>>> wrote: >>>>>> >>>>>>> I would be running these commands: >>>>>>> >>>>>>> git revert 540d9572fd491db3ce182d26636fc74ada4e171c (1543) >>>>>>> git revert f88cb880974fa56866492c437af291e40bd1a4f6 -m 1 (1538) >>>>>>> git revert 9f970f28b18534dffe33196ead60ea861f501fa9 -m 1 (1534) >>>>>>> git revert 7ce0e10fbcd949375e43535aae168421ecdaa562 -m 1 (1493) >>>>>>> >>>>>>> *Will STEVENS* >>>>>>> Lead Developer >>>>>>> >>>>>>> *CloudOps* *| *Cloud Solutions Experts >>>>>>> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 >>>>>>> w cloudops.com *|* tw @CloudOps_ >>>>>>> >>>>>>> On Mon, May 16, 2016 at 5:19 PM, Will Stevens <wstev...@cloudops.com >>>>>>> > wrote: >>>>>>> >>>>>>>> I think I am going to have to revert #1493 ( >>>>>>>> https://github.com/apache/cloudstack/pull/1493) because it seems >>>>>>>> to be responsible for the `addHost` issue I am having in all my CI >>>>>>>> environments while doing DeployDC. On completely new deployments, I >>>>>>>> got >>>>>>>> the `addHost` error on all 6 of my CI environments with #1493 >>>>>>>> included. I >>>>>>>> have noticed this as an intermittent issue for the last while, but >>>>>>>> could >>>>>>>> not isolate it. >>>>>>>> >>>>>>>> I have reverted #1493 (and it's descendants) locally and I have not >>>>>>>> had the error in my first 3 tests after reverting it. I only started >>>>>>>> seeing the problem after #1493. >>>>>>>> >>>>>>>> With the freeze basically here, I need my CI environments in action >>>>>>>> cause I have a few PRs that I really want to run before I merge and >>>>>>>> freeze... >>>>>>>> >>>>>>>> *Will STEVENS* >>>>>>>> Lead Developer >>>>>>>> >>>>>>>> *CloudOps* *| *Cloud Solutions Experts >>>>>>>> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 >>>>>>>> w cloudops.com *|* tw @CloudOps_ >>>>>>>> >>>>>>>> On Mon, May 16, 2016 at 1:53 PM, Will Stevens < >>>>>>>> wstev...@cloudops.com> wrote: >>>>>>>> >>>>>>>>> I mean revert them locally to test (for now)... >>>>>>>>> >>>>>>>>> *Will STEVENS* >>>>>>>>> Lead Developer >>>>>>>>> >>>>>>>>> *CloudOps* *| *Cloud Solutions Experts >>>>>>>>> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 >>>>>>>>> w cloudops.com *|* tw @CloudOps_ >>>>>>>>> >>>>>>>>> On Mon, May 16, 2016 at 1:53 PM, Will Stevens < >>>>>>>>> wstev...@cloudops.com> wrote: >>>>>>>>> >>>>>>>>>> I am getting it more than not right now. I am concerned we have >>>>>>>>>> a bigger issue here. It only started happening for me after #1493 >>>>>>>>>> went in, >>>>>>>>>> but I don't want to blame it on that without knowing for sure. >>>>>>>>>> >>>>>>>>>> Maybe I will revert those ones and see if it changes anything... >>>>>>>>>> :( >>>>>>>>>> >>>>>>>>>> *Will STEVENS* >>>>>>>>>> Lead Developer >>>>>>>>>> >>>>>>>>>> *CloudOps* *| *Cloud Solutions Experts >>>>>>>>>> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 >>>>>>>>>> w cloudops.com *|* tw @CloudOps_ >>>>>>>>>> >>>>>>>>>> On Mon, May 16, 2016 at 1:45 PM, Daan Hoogland < >>>>>>>>>> daan.hoogl...@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> yes, I'm having the same thing. I need to restart the kvm1 vm to >>>>>>>>>>> have it be >>>>>>>>>>> able to connect to the ms. It seems intermittent. >>>>>>>>>>> >>>>>>>>>>> On Mon, May 16, 2016 at 7:38 PM, Will Stevens < >>>>>>>>>>> wstev...@cloudops.com> wrote: >>>>>>>>>>> >>>>>>>>>>> > I am currently running into an issue in DeployDC that I >>>>>>>>>>> started getting on >>>>>>>>>>> > Thursday or Friday. I am not sure if it is a bubble issue or >>>>>>>>>>> an issue with >>>>>>>>>>> > ACS. >>>>>>>>>>> > >>>>>>>>>>> > I am trying to get it sorted out now... >>>>>>>>>>> > >>>>>>>>>>> > ==== Deploy DC Started ==== >>>>>>>>>>> > >>>>>>>>>>> > Exception Occurred :['Traceback (most recent call last):\n', >>>>>>>>>>> ' File >>>>>>>>>>> > >>>>>>>>>>> "/data/git/cs1/cloudstack/tools/marvin/marvin/deployDataCenter.py", >>>>>>>>>>> line >>>>>>>>>>> > 142, in addHosts\n ret = >>>>>>>>>>> self.__apiClient.addHost(hostcmd)\n', ' File >>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>>>> "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py", >>>>>>>>>>> > line 1530, in addHost\n response = >>>>>>>>>>> > self.connection.marvinRequest(command, response_type=response, >>>>>>>>>>> > method=method)\n', ' File >>>>>>>>>>> > >>>>>>>>>>> "/usr/lib/python2.7/site-packages/marvin/cloudstackConnection.py", >>>>>>>>>>> line >>>>>>>>>>> > 379, in marvinRequest\n raise e\n', >>>>>>>>>>> 'CloudstackAPIException: Execute >>>>>>>>>>> > cmd: addhost failed, due to: errorCode: 530, errorText:Unable >>>>>>>>>>> to add the >>>>>>>>>>> > host\n'] >>>>>>>>>>> > >>>>>>>>>>> > Exception Occurred :['Traceback (most recent call last):\n', >>>>>>>>>>> ' File >>>>>>>>>>> > >>>>>>>>>>> "/data/git/cs1/cloudstack/tools/marvin/marvin/deployDataCenter.py", >>>>>>>>>>> line >>>>>>>>>>> > 142, in addHosts\n ret = >>>>>>>>>>> self.__apiClient.addHost(hostcmd)\n', ' File >>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>>>> "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py", >>>>>>>>>>> > line 1530, in addHost\n response = >>>>>>>>>>> > self.connection.marvinRequest(command, response_type=response, >>>>>>>>>>> > method=method)\n', ' File >>>>>>>>>>> > >>>>>>>>>>> "/usr/lib/python2.7/site-packages/marvin/cloudstackConnection.py", >>>>>>>>>>> line >>>>>>>>>>> > 379, in marvinRequest\n raise e\n', >>>>>>>>>>> 'CloudstackAPIException: Execute >>>>>>>>>>> > cmd: addhost failed, due to: errorCode: 530, errorText:Guid is >>>>>>>>>>> not updated >>>>>>>>>>> > for cluster with specified cluster id; need to wait for hosts >>>>>>>>>>> in this >>>>>>>>>>> > cluster to come up\n'] >>>>>>>>>>> > >>>>>>>>>>> > ===deploy dc failed, so cleaning the created entries=== >>>>>>>>>>> > >>>>>>>>>>> > *Will STEVENS* >>>>>>>>>>> > Lead Developer >>>>>>>>>>> > >>>>>>>>>>> > *CloudOps* *| *Cloud Solutions Experts >>>>>>>>>>> > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 >>>>>>>>>>> > w cloudops.com *|* tw @CloudOps_ >>>>>>>>>>> > >>>>>>>>>>> > On Mon, May 16, 2016 at 12:51 PM, Daan Hoogland < >>>>>>>>>>> daan.hoogl...@gmail.com> >>>>>>>>>>> > wrote: >>>>>>>>>>> > >>>>>>>>>>> > > I understoud the request to try it out. I have #1547 running >>>>>>>>>>> once again >>>>>>>>>>> > now >>>>>>>>>>> > > and will try Remi's new version with the next one i'll run. >>>>>>>>>>> > > >>>>>>>>>>> > > On Mon, May 16, 2016 at 6:34 PM, Will Stevens < >>>>>>>>>>> williamstev...@gmail.com> >>>>>>>>>>> > > wrote: >>>>>>>>>>> > > >>>>>>>>>>> > > > Sorry. My phone decides to write whatever the hell it >>>>>>>>>>> wants to. I need >>>>>>>>>>> > to >>>>>>>>>>> > > > proof read everything on my phone. You can probably >>>>>>>>>>> understand my >>>>>>>>>>> > > previous >>>>>>>>>>> > > > email though. >>>>>>>>>>> > > > On May 16, 2016 12:32 PM, "Will Stevens" < >>>>>>>>>>> williamstev...@gmail.com> >>>>>>>>>>> > > wrote: >>>>>>>>>>> > > > >>>>>>>>>>> > > > > Remi and I have been discussing this. I suggested we >>>>>>>>>>> implement an >>>>>>>>>>> > > > override >>>>>>>>>>> > > > > system so she could reuse lost of the code, but be able >>>>>>>>>>> to override >>>>>>>>>>> > > files >>>>>>>>>>> > > > > specific to cosmic and cloudstack without impacting each >>>>>>>>>>> other. Remi >>>>>>>>>>> > > > > implemented this concept and asked me to verify it is >>>>>>>>>>> working as >>>>>>>>>>> > > > expected, >>>>>>>>>>> > > > > but I didn't want to push my luck with the freeze so >>>>>>>>>>> close and I had >>>>>>>>>>> > > > > working bubbles. >>>>>>>>>>> > > > > >>>>>>>>>>> > > > > I think the recent changes are going to help mitigate >>>>>>>>>>> issues going >>>>>>>>>>> > > > > forward, but I have not had a chance to validate yet. >>>>>>>>>>> > > > > On May 16, 2016 12:27 PM, "Daan Hoogland" < >>>>>>>>>>> daan.hoogl...@gmail.com> >>>>>>>>>>> > > > wrote: >>>>>>>>>>> > > > > >>>>>>>>>>> > > > >> trying that one but I think we need to add that repo to >>>>>>>>>>> the cs >>>>>>>>>>> > system >>>>>>>>>>> > > in >>>>>>>>>>> > > > >> or >>>>>>>>>>> > > > >> before the build script. Also this is not the last >>>>>>>>>>> (HEAD) of the >>>>>>>>>>> > > master >>>>>>>>>>> > > > >> branch of the bubble. I saw some cosmic specific >>>>>>>>>>> changes. We have >>>>>>>>>>> > some >>>>>>>>>>> > > > >> challenges on the road ahead. >>>>>>>>>>> > > > >> >>>>>>>>>>> > > > >> On Mon, May 16, 2016 at 3:06 PM, Will Stevens < >>>>>>>>>>> > wstev...@cloudops.com> >>>>>>>>>>> > > > >> wrote: >>>>>>>>>>> > > > >> >>>>>>>>>>> > > > >> > Daan, I am using bubble commit >>>>>>>>>>> > > > 9134cf8be930d0b982829da216471feaf214621f >>>>>>>>>>> > > > >> and >>>>>>>>>>> > > > >> > things seem to be working. Let me know if that is >>>>>>>>>>> not working for >>>>>>>>>>> > > > >> you... >>>>>>>>>>> > > > >> > >>>>>>>>>>> > > > >> > *Will STEVENS* >>>>>>>>>>> > > > >> > Lead Developer >>>>>>>>>>> > > > >> > >>>>>>>>>>> > > > >> > *CloudOps* *| *Cloud Solutions Experts >>>>>>>>>>> > > > >> > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 >>>>>>>>>>> > > > >> > w cloudops.com *|* tw @CloudOps_ >>>>>>>>>>> > > > >> > >>>>>>>>>>> > > > >> > On Mon, May 16, 2016 at 8:02 AM, Daan Hoogland < >>>>>>>>>>> > > > daan.hoogl...@gmail.com >>>>>>>>>>> > > > >> > >>>>>>>>>>> > > > >> > wrote: >>>>>>>>>>> > > > >> > >>>>>>>>>>> > > > >> > > Thanks Rohit, >>>>>>>>>>> > > > >> > > >>>>>>>>>>> > > > >> > > I did try the manual install on the build host but >>>>>>>>>>> that didn't >>>>>>>>>>> > > help. >>>>>>>>>>> > > > >> I'll >>>>>>>>>>> > > > >> > > have a look at the extra yum repo to add later. >>>>>>>>>>> > > > >> > > >>>>>>>>>>> > > > >> > > On Mon, May 16, 2016 at 12:26 PM, Rohit Yadav < >>>>>>>>>>> > > > >> rohit.ya...@shapeblue.com >>>>>>>>>>> > > > >> > > >>>>>>>>>>> > > > >> > > wrote: >>>>>>>>>>> > > > >> > > >>>>>>>>>>> > > > >> > > > I checked this again today, with the recent >>>>>>>>>>> changes wrt rpm >>>>>>>>>>> > > > >> > > deps/packaging >>>>>>>>>>> > > > >> > > > the mysql-connector-python is not availble in >>>>>>>>>>> default CentOS >>>>>>>>>>> > > > >> > repositories >>>>>>>>>>> > > > >> > > > therefore we'll need to modify documentation to >>>>>>>>>>> install it >>>>>>>>>>> > from >>>>>>>>>>> > > > >> MySQL >>>>>>>>>>> > > > >> > yum >>>>>>>>>>> > > > >> > > > repos: >>>>>>>>>>> > > > >> > > > http://dev.mysql.com/downloads/repo/yum >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > Regards, >>>>>>>>>>> > > > >> > > > Rohit Yadav >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > Regards, >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > Rohit Yadav >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > rohit.ya...@shapeblue.com >>>>>>>>>>> > > > >> > > > www.shapeblue.com >>>>>>>>>>> > > > >> > > > 53 Chandos Place, Covent Garden, London WC2N >>>>>>>>>>> 4HSUK >>>>>>>>>>> > > > >> > > > @shapeblue >>>>>>>>>>> > > > >> > > > On May 16 2016, at 8:37 am, Rohit Yadav < >>>>>>>>>>> > > > rohit.ya...@shapeblue.com> >>>>>>>>>>> > > > >> > > wrote: >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > Daan, >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > mysql-connector-python was recently added as a >>>>>>>>>>> pure-python >>>>>>>>>>> > > > >> dependency, >>>>>>>>>>> > > > >> > > can >>>>>>>>>>> > > > >> > > > you try to install that on your host system and >>>>>>>>>>> retry rpm >>>>>>>>>>> > > > building. >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > Regards. >>>>>>>>>>> > > > >> > > > ________________________________________ >>>>>>>>>>> > > > >> > > > From: Daan Hoogland <daan.hoogl...@gmail.com> >>>>>>>>>>> > > > >> > > > Sent: 15 May 2016 14:34:49 >>>>>>>>>>> > > > >> > > > To: dev >>>>>>>>>>> > > > >> > > > Subject: old error back? >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > anybody else seeing this in the bubble or during >>>>>>>>>>> rpm build? >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > ``` >>>>>>>>>>> > > > >> > > > error: Failed build dependencies: >>>>>>>>>>> > > > >> > > > mysql-connector-python is needed by >>>>>>>>>>> > > > >> > > > cloudstack-4.9.0-SNAPSHOT.el7.centos.x86_64 >>>>>>>>>>> > > > >> > > > RPM Build Failed >>>>>>>>>>> > > > >> > > > ``` >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > -- >>>>>>>>>>> > > > >> > > > Daan >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > Regards, >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > Rohit Yadav >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > > rohit.ya...@shapeblue.com >>>>>>>>>>> > > > >> > > > www.shapeblue.com >>>>>>>>>>> > > > >> > > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK >>>>>>>>>>> > > > >> > > > @shapeblue >>>>>>>>>>> > > > >> > > > >>>>>>>>>>> > > > >> > > >>>>>>>>>>> > > > >> > > >>>>>>>>>>> > > > >> > > >>>>>>>>>>> > > > >> > > -- >>>>>>>>>>> > > > >> > > Daan >>>>>>>>>>> > > > >> > > >>>>>>>>>>> > > > >> > >>>>>>>>>>> > > > >> >>>>>>>>>>> > > > >> >>>>>>>>>>> > > > >> >>>>>>>>>>> > > > >> -- >>>>>>>>>>> > > > >> Daan >>>>>>>>>>> > > > >> >>>>>>>>>>> > > > > >>>>>>>>>>> > > > >>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>>> > > -- >>>>>>>>>>> > > Daan >>>>>>>>>>> > > >>>>>>>>>>> > >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Daan >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>> >>>> >>>> -- >>>> Daan >>>> >>> >>> >> >> >> -- >> Daan >> > > > > -- > Daan >
