Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-17 Thread Akihiro Motoki
ague; John Griffith; > openstack-infra@lists.openstack.org > *Subject:* Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: > job failed to start" > > Hi Roey, > > Thanks for the tip. I have made the change according to your suggestion and > fired off tests for ov

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-12 Thread Dane Leblanc (leblancd)
Leblanc (leblancd); Sean Dague; John Griffith; openstack-infra@lists.openstack.org Subject: Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start" Hi Roey, Thanks for the tip. I have made the change according to your suggestion and fired off tests for over

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Sukhdev Kapur
> On 03/10/2014 03:00 PM, Dane Leblanc (leblancd) wrote: > > In my case, the base OS is 12.04 Precise. > > > > The problem is intermittent in that it takes maybe 15 to 20 cycles of > unstack/stack to get it into the failure mode, but once in the failure > mode, it appear

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Roey Chen
eset the VM for each run. Thanks, Dane From: Sukhdev Kapur [mailto:sukhdevka...@gmail.com] Sent: Monday, March 10, 2014 4:33 PM To: Sean Dague Cc: Dane Leblanc (leblancd); openstack-infra@lists.openstack.org Subject: Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job faile

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Dane Leblanc (leblancd)
...@gmail.com] Sent: Monday, March 10, 2014 4:33 PM To: Sean Dague Cc: Dane Leblanc (leblancd); openstack-infra@lists.openstack.org Subject: Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start" Hi Sean, In my case, for every run, I do unstack.sh, clean.s

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread John Griffith
lure >> mode, it appears that tgt daemon is 100% dead-in-the-water. >> >> -Original Message- >> From: Sean Dague [mailto:s...@dague.net] >> Sent: Monday, March 10, 2014 1:49 PM >> To: Dane Leblanc (leblancd); openstack-infra@lists.openstack.org >> S

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Sukhdev Kapur
gt; From: Sean Dague [mailto:s...@dague.net] > > Sent: Monday, March 10, 2014 1:49 PM > > To: Dane Leblanc (leblancd); openstack-infra@lists.openstack.org > > Subject: Re: [OpenStack-Infra] tgt restart fails in Cinder startup > "start: job failed to start" > > &

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Sukhdev Kapur
[mailto:s...@dague.net] > Sent: Monday, March 10, 2014 1:49 PM > To: Dane Leblanc (leblancd); openstack-infra@lists.openstack.org > Subject: Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: > job failed to start" > > What base OS? A change was made th

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Sean Dague
Dague [mailto:s...@dague.net] > Sent: Monday, March 10, 2014 1:49 PM > To: Dane Leblanc (leblancd); openstack-infra@lists.openstack.org > Subject: Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: > job failed to start" > > What base OS? A change was

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Dane Leblanc (leblancd)
[mailto:s...@dague.net] Sent: Monday, March 10, 2014 1:49 PM To: Dane Leblanc (leblancd); openstack-infra@lists.openstack.org Subject: Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start" What base OS? A change was made there recently to better handle debian b

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Sukhdev Kapur
Hi Sean, All the failures I have seen are on Ubuntu 13.10. They are not always 100%. Very intermittent. This failure occurs once after every 10-20 runsthat is why I have not been able to nail it down :-):-) Every time the error occurs - if reboot the VM it clears up and is good for another 10-

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Sean Dague
What base OS? A change was made there recently to better handle debian because we believed (possibly incorrectly) that precise actually had working init scripts. It would be interesting to understand if this was a 100% failure, or only intermittent, and what base OS it was on. -Sean On 0

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Sukhdev Kapur
Hey Rafael, If it helps any, I have noticed that this issue generally occurs after several runs of tempest tests. I run all smoke tests. I have been always suspicious that some new test got added which is not cleaning up afterwards. Can you point me to which tempest test corresponds to test_boot_

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Rafael Folco
This looks very familiar https://bugzilla.redhat.com/show_bug.cgi?id=848942 I'm not sure this is exactly the same bahavior, try turning debug messages on by adding -d to the tgtd start. I'm investigating a similar issue with tgt on test_boot_pattern test. It turns out that the file written to t

Re: [OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Sukhdev Kapur
I see the same issue. This issue has crept in during the latest flurry of check-ins. I started noticing this issue a day or two before the Icehouse Feature Freeze deadline. I tried restarting tgt as well, but, it does not help. However, rebooting the VM helps clear it up. Has anybody else seen i

[OpenStack-Infra] tgt restart fails in Cinder startup "start: job failed to start"

2014-03-10 Thread Dane Leblanc (leblancd)
I don't know if anyone can give me some troubleshooting advice with this issue. I'm seeing an occasional problem whereby after several DevStack unstack.sh/stack.sh cycles, the tgt daemon (tgtd) fails to start during Cinder startup. Here's a snippet from the stack.sh log: 2014-03-10 07:09:45.21