The interesting thing here is that this has always worked with my SAN until I recently updated my CloudStack codebase.
Now SR.create actually seems to create the SR (as it did in the past), but then it times out while doing a read. On Wed, Apr 16, 2014 at 12:27 PM, Anthony Xu <xuefei...@citrix.com> wrote: > Normally , SR.scan will not take too long, if SR.scan times out after 600 > seconds, I think there might be some problems with the SR, I think you > need to fix the SR issue first. > You can execute xe sr-scan in any XS hosts to see what's the problem. > > > Anthony > > -----Original Message----- > From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] > Sent: Wednesday, April 16, 2014 11:21 AM > To: Anthony Xu > Cc: Murali Reddy; dev@cloudstack.apache.org > Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out > > What I had done was change the xapiwait (or something like that) global > setting and then re-start my management server. > > > On Wed, Apr 16, 2014 at 12:19 PM, Mike Tutkowski < > mike.tutkow...@solidfire.com> wrote: > > > Ah, that's probably it. Thanks! > > > > > > On Wed, Apr 16, 2014 at 12:11 PM, Anthony Xu <xuefei...@citrix.com> > wrote: > > > >> I think you need to change value in DB configuration, changing the > >> java code will not change the value in DB if the DB is already > initialized. > >> > >> > >> > >> > >> > >> > >> > +----------+----------+--------------+----------+-------+----------------------------------------------+---------------+---------+-------+------------+ > >> > >> | Advanced | DEFAULT | AgentManager | xapiwait | 60 | Time (in > >> seconds) to wait for XAPI to return | NULL | NULL | NULL > >> | 0 | > >> > >> > >> > >> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] > >> *Sent:* Wednesday, April 16, 2014 11:09 AM > >> *To:* Anthony Xu > >> *Cc:* Murali Reddy; dev@cloudstack.apache.org > >> > >> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out > >> > >> > >> > >> Thanks, Anthony > >> > >> > >> > >> I will need to re-test. I changed that value from 60 to 600 last > >> night and still saw an issue. > >> > >> > >> > >> Maybe I'll just start over from scratch and see if all is well. > >> > >> > >> > >> Thanks for the follow-up! > >> > >> > >> > >> On Wed, Apr 16, 2014 at 12:05 PM, Anthony Xu <xuefei...@citrix.com> > >> wrote: > >> > >> Just checked in a fix for this. > >> > >> change xapitimeout to 600 second, > >> > >> looks like we need to change some XAPI calls to Async before shorten > >> the timeout > >> > >> > >> > >> > >> > >> Anthony > >> > >> > >> > >> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] > >> *Sent:* Wednesday, April 16, 2014 7:27 AM > >> *To:* Murali Reddy > >> *Cc:* Anthony Xu; dev@cloudstack.apache.org > >> > >> > >> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out > >> > >> > >> > >> This is a similar problem to what I sent an e-mail out about last night: > >> XmlRpcException (Read timed out). For me it's happening when > >> CitrixResourceBase issues SR.create. > >> > >> > >> > >> This issue is currently blocking my testing progress and I'm not > >> really sure who might be the right person to look into this. > >> > >> > >> > >> Any thoughts on this anyone? > >> > >> > >> > >> On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy > >> <murali.re...@citrix.com> > >> wrote: > >> > >> System VM's are launching fine now after Anthony's fix. But user VM's > >> are failing to get created with exception. > >> > >> > >> > >> 43275 2014-04-16 12:59:08,647 DEBUG > >> [c.c.h.x.r.XenServerConnectionPool] > >> (DirectAgent-137:ctx-4761cb0c) XmlRpcException for method: > >> VDI.snapshot due to org.apache.xmlrpc.XmlRpcException: Failed to > >> create input stream: Read timed out > >> > >> 43276 2014-04-16 12:59:08,647 WARN > >> [c.c.h.x.r.XenServerStorageProcessor] > >> (DirectAgent-137:ctx-4761cb0c) Catch Exception > >> org.apache.xmlrpc.XmlRpcException for template + due to > >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: > >> Read timed out > >> > >> > >> > >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: > >> Read timed out > >> > >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: > >> Read timed out > >> > >> at > >> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpc > >> SunHttpTransport.java:99) > >> > >> at > >> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStre > >> amTransport.java:152) > >> > >> at > >> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTr > >> ansport.java:143) > >> > >> at > >> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSun > >> HttpTransport.java:69) > >> > >> at > >> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorke > >> r.java:56) > >> > >> at > >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) > >> > >> at > >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) > >> > >> at > >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) > >> > >> at com.xensource.xenapi.Connection.dispatch(Connection.java:285) > >> > >> at > >> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerCo > >> nnection.dispatch(XenServerConnectionPool.java:456) > >> > >> at com.xensource.xenapi.VDI.snapshot(VDI.java:1155) > >> > >> at > >> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTempl > >> ateToPrimaryStorage(XenServerStorageProcessor.java:972) > >> > >> at > >> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute > >> (StorageSubsystemCommandHandlerBase.java:77) > >> > >> > >> > >> *From: *Mike Tutkowski <mike.tutkow...@solidfire.com> > >> *Date: *Wednesday, 16 April 2014 12:35 AM > >> *To: *"dev@cloudstack.apache.org" <dev@cloudstack.apache.org> > >> *Cc: *Murali Reddy <murali.re...@citrix.com> > >> > >> > >> *Subject: *Re: [4.4]copy_vhd_from_secondarystorage is timing out > >> > >> > >> > >> Hi Anthony, > >> > >> > >> > >> Can you go into a bit more depth about copy_vhd_from_secondarystorage > >> not being used with XenServer 6.2? > >> > >> > >> > >> Does that mean "public Answer > >> copyTemplateToPrimaryStorage(CopyCommand > >> cmd)" in XenServerStorageProcessor is not called when XenServer 6.2 > >> is in use? > >> > >> > >> > >> I'm testing out a feature of mine for 4.4, but have only been using > >> XenServer 6.1 so far. > >> > >> > >> > >> Thanks! > >> > >> Mike > >> > >> > >> > >> On Tue, Apr 15, 2014 at 12:44 PM, Anthony Xu <xuefei...@citrix.com> > >> wrote: > >> > >> Hi Murali, > >> > >> It is caused by the commit, I tested the commit on XS 6.2 FOX, which > >> doesn't use copy_vhd_from_secondarystorage, that's why I didn't see > >> this issue. > >> > >> Just disabled XAPI Event in 4.4 branch. > >> > >> > >> Thanks, > >> Anthony > >> > >> > >> > >> > >> > >> > >> > >> -----Original Message----- > >> From: Murali Reddy > >> Sent: Tuesday, April 15, 2014 10:54 AM > >> To: dev@cloudstack.apache.org; Anthony Xu > >> Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out > >> > >> > >> I am still running into this issue. Alex reverted complete change > >> replacing xapi.jar, which was also resulting XmlRpc exceptions but > >> system VM's were launching fine after revert. I may be wrong but > >> looking at the stack trace and recent commits, commit > >> 9f44909e63a19b2b8034baa13b92e24ea2eb0227 (use event instead of poll > >> for xapi async call in XS 6.2 and above to reduce the pressure on > >> XAPI) may be causing this issue. Anthony can you please take a look? > >> > >> > >> On 14/04/14 8:12 AM, "Mike Tutkowski" <mike.tutkow...@solidfire.com> > >> wrote: > >> > >> >I was seeing a similar issue when XAPI was changed when I tried to > >> >create an SR. > >> > > >> >I wonder if that XAPI issue hasn't been fully resolved. > >> > > >> > > >> >On Sun, Apr 13, 2014 at 4:16 PM, Srikanteswararao Talluri < > >> >srikanteswararao.tall...@citrix.com> wrote: > >> > > >> >> Did anybody see this on latest 4.4? > >> >> > >> >> > >> >> 2014-04-14 00:01:34,305 DEBUG [c.c.h.x.r.XenServerConnectionPool] > >> >> (DirectAgent-71:ctx-12d9be59) XmlRpcException for method: > >> >>event.from due to > >> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: > >> >>Read timed out > >> >> > >> >> 2014-04-14 00:01:34,305 WARN [c.c.h.x.r.CitrixResourceBase] > >> >> (DirectAgent-71:ctx-12d9be59) callHostPlugin failed for cmd: > >> >> copy_vhd_from_secondarystorage with args mountpoint: > >> >>10.147.28.7:/export/home/talluri/psec/template/tmpl/1/1/, > >> >> sruuid: b3dd21aa-8e82-a923-ed29-ee58220d158b, namelabel: > >> >> cloud-8498d88f-be6b-41b6-bece-a58bbc1fbc32, due to Failed to > >> >>create input > >> >> stream: Read timed out > >> >> > >> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: > >> >> Read timed out > >> >> > >> >> at > >> >> > >> >>org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlR > >> >>pcS > >> >>unH > >> >>ttpTransport.java:99) > >> >> > >> >> at > >> >> > >> >>org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcSt > >> >>rea > >> >>mTr > >> >>ansport.java:152) > >> >> > >> >> at > >> >> > >> >>org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttp > >> >>Tra > >> >>nsp > >> >>ort.java:143) > >> >> > >> >> at > >> >> > >> >>org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcS > >> >>unH > >> >>ttp > >> >>Transport.java:69) > >> >> > >> >> at > >> >> > >> >>org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWor > >> >>ker > >> >>.ja > >> >>va:56) > >> >> > >> >> at > >> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:16 > >> >> 7) > >> >> > >> >> at > >> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:13 > >> >> 7) > >> >> > >> >> at > >> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:12 > >> >> 6) > >> >> > >> >> at > >> >> com.xensource.xenapi.Connection.dispatch(Connection.java:285) > >> >> > >> >> at > >> >> > >> >>com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServer > >> >>Con > >> >>nec > >> >>tion.dispatch(XenServerConnectionPool.java:456) > >> >> > >> >> at com.xensource.xenapi.Event.properFrom(Event.java:310) > >> >> > >> >> at > >> >> > >> >>com.cloud.hypervisor.xen.resource.XenServer620Resource.waitForTask( > >> >>Xen > >> >>Ser > >> >>ver620Resource.java:125) > >> >> > >> >> at > >> >> > >> >>com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin > >> >>Asy > >> >>nc( > >> >>CitrixResourceBase.java:3558) > >> >> > >> >> at > >> >> > >> >>com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vh > >> >>d_f > >> >>rom > >> >>_secondarystorage(XenServerStorageProcessor.java:826) > >> >> > >> >> at > >> >> > >> >>com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTem > >> >>pla > >> >>teT > >> >>oPrimaryStorage(XenServerStorageProcessor.java:962) > >> >> > >> >> at > >> >> > >> >>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execu > >> >>te( > >> >>Sto > >> >>rageSubsystemCommandHandlerBase.java:77) > >> >> > >> >> at > >> >> > >> >>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handl > >> >>eSt > >> >>ora > >> >>geCommands(StorageSubsystemCommandHandlerBase.java:52) > >> >> > >> >> at > >> >> > >> >>com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest > >> >>(Ci > >> >>tri > >> >>xResourceBase.java:542) > >> >> > >> >> at > >> >> > >> >>com.cloud.hypervisor.xen.resource.XenServer56Resource.executeReques > >> >>t(X > >> >>enS > >> >>erver56Resource.java:60) > >> >> > >> >> at > >> >> > >> >>com.cloud.hypervisor.xen.resource.XenServer610Resource.executeReque > >> >>st( > >> >>Xen > >> >>Server610Resource.java:92) > >> >> > >> >> at > >> >> > >> >>com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(Direct > >> >>Age > >> >>ntA > >> >>ttache.java:216) > >> >> > >> >> at > >> >> > >> >>org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run( > >> >>Man > >> >>age > >> >>dContextRunnable.java:49) > >> >> > >> >> at > >> >> > >> >>org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1. > >> >>cal > >> >>l(D > >> >>efaultManagedContext.java:56) > >> >> > >> >> at > >> >> > >> >>org.apache.cloudstack.managed.context.impl.DefaultManagedContext.ca > >> >>llW > >> >>ith > >> >>Context(DefaultManagedContext.java:103) > >> >> > >> >> > >> >> 547,2-9 > >> >> > >> > > >> > > >> > > >> >-- > >> >*Mike Tutkowski* > >> >*Senior CloudStack Developer, SolidFire Inc.* > >> >e: mike.tutkow...@solidfire.com > >> >o: 303.746.7302 > >> >Advancing the way the world uses the > >> >cloud<http://solidfire.com/solution/overview/?video=play> > >> >*(tm)* > >> > > >> > >> > >> > >> > >> > >> -- > >> *Mike Tutkowski* > >> > >> *Senior CloudStack Developer, SolidFire Inc.* > >> > >> e: mike.tutkow...@solidfire.com > >> > >> o: 303.746.7302 > >> > >> Advancing the way the world uses the > >> cloud<http://solidfire.com/solution/overview/?video=play> > >> *(tm)* > >> > >> > >> > >> > >> > >> -- > >> *Mike Tutkowski* > >> > >> *Senior CloudStack Developer, SolidFire Inc.* > >> > >> e: mike.tutkow...@solidfire.com > >> > >> o: 303.746.7302 > >> > >> Advancing the way the world uses the > >> cloud<http://solidfire.com/solution/overview/?video=play> > >> *(tm)* > >> > >> > >> > >> > >> > >> -- > >> *Mike Tutkowski* > >> > >> *Senior CloudStack Developer, SolidFire Inc.* > >> > >> e: mike.tutkow...@solidfire.com > >> > >> o: 303.746.7302 > >> > >> Advancing the way the world uses the > >> cloud<http://solidfire.com/solution/overview/?video=play> > >> *(tm)* > >> > > > > > > > > -- > > *Mike Tutkowski* > > *Senior CloudStack Developer, SolidFire Inc.* > > e: mike.tutkow...@solidfire.com > > o: 303.746.7302 > > Advancing the way the world uses the > > cloud<http://solidfire.com/solution/overview/?video=play> > > *(tm)* > > > > > > -- > *Mike Tutkowski* > *Senior CloudStack Developer, SolidFire Inc.* > e: mike.tutkow...@solidfire.com > o: 303.746.7302 > Advancing the way the world uses the > cloud<http://solidfire.com/solution/overview/?video=play> > *(tm)* > -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud<http://solidfire.com/solution/overview/?video=play> *(tm)*
