Aha, In mgmt. logs found this,
2015-04-01 16:19:29,401 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(http-6443-exec-3:ctx-643fc04f ctx-b5bf9d3d) submit async job-2388, details:
AsyncJobVO {id:2388, userId: 2, accountId: 2, instanceType: Template,
instanceId: 209, cmd:
org.apache.cloudstack.api.command.admin.template.CreateTemplateCmdByAdmin,
cmdInfo:
{"sessionkey":"OYZZ3VDQrED49bazaliBHCalmVA\u003d","cmdEventType":"TEMPLATE.CREATE","ctxUserId":"2","volumeId":"b64c6eb5-ce9a-43c1-adaf-19d077b1e534","httpmethod":"GET","osTypeId":"cb4ef740-a239-11e4-8d64-a2772f6e5d2d","isPublic":"true","isfeatured":"false","id":"209","isdynamicallyscalable":"true","response":"json","ctxDetails":"{\"com.cloud.template.VirtualMachineTemplate\":\"5b34869f-3f10-434e-a3af-8091486fee62\",\"com.cloud.storage.Volume\":\"b64c6eb5-ce9a-43c1-adaf-19d077b1e534\",\"com.cloud.storage.GuestOS\":\"cb4ef740-a239-11e4-8d64-a2772f6e5d2d\"}","displayText":"Windows
Server 2012 R2 Std","passwordEnabled":"false","name":"Windows Server 2012 R2
Std","_":"1427897969098","uuid":"5b34869f-3f10-434e-a3af-8091486fee62","ctxAccountId":"2","ctxStartEventId":"2033"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 249373720971888, completeMsid: null, lastUpdated: null,
lastPolled: null, created: null}
2015-04-01 19:19:32,932 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-14:ctx-cccb879f) Async 10800 seconds timeout for task
com.xensource.xenapi.Task@a03eda0c
2015-04-01 19:19:32,959 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-14:ctx-cccb879f) Host 172.16.5.199
OpaqueRef:1b52a97b-a865-b82d-0c79-77a12f63f2e2: Removing SR
2015-04-01 19:19:32,969 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-14:ctx-cccb879f) Host 172.16.5.199
OpaqueRef:1b52a97b-a865-b82d-0c79-77a12f63f2e2: Catch XenAPIException: This
operation cannot be performed because this VDI is in use by some other operation
2015-04-01 19:19:32,979 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-14:ctx-cccb879f) Host 172.16.5.199
OpaqueRef:1b52a97b-a865-b82d-0c79-77a12f63f2e2: Catch XenAPIException: This
operation cannot be performed because this VDI is in use by some other operation
2015-04-01 19:19:32,979 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-14:ctx-cccb879f) Host 172.16.5.199
OpaqueRef:1b52a97b-a865-b82d-0c79-77a12f63f2e2: Unable to remove SR
2015-04-01 19:19:33,244 ERROR [c.c.h.x.r.XenServerStorageProcessor]
(DirectAgent-14:ctx-cccb879f) Creating template from volume
d07d3812-59f0-4d31-89e3-29107f9bb6cc failed due to
java.util.concurrent.TimeoutException: Async 10800 seconds timeout for task
com.xensource.xenapi.Task@a03eda0c
java.util.concurrent.TimeoutException: Async 10800 seconds timeout for task
com.xensource.xenapi.Task@a03eda0c
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.waitForTask(CitrixResourceBase.java:3282)
at
com.cloud.hypervisor.xen.resource.Xenserver625StorageProcessor.createTemplateFromVolume(Xenserver625StorageProcessor.java:556)
at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:90)
at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:547)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:61)
at
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:102)
at
com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
at
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:307)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2015-04-01 19:19:33,249 WARN [c.c.h.x.r.XenServerStorageProcessor]
(DirectAgent-14:ctx-cccb879f) unable to destroy
task(OpaqueRef:ad6e6573-59e8-0bba-6b26-0fc282030627) due to You tried to add a
key-value pair to a map, but that key is already there.
2015-04-01 19:19:33,249 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-14:ctx-cccb879f) Seq 1-6176686888938669178: Response Received:
2015-04-01 19:19:33,250 DEBUG [c.c.a.t.Request] (DirectAgent-14:ctx-cccb879f)
Seq 1-6176686888938669178: Processing: { Ans: , MgmtId: 249373720971888, via:
1, Ver: v1, Flags: 10,
[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Creating
template from volume d07d3812-59f0-4d31-89e3-29107f9bb6cc failed due to
java.util.concurrent.TimeoutException: Async 10800 seconds timeout for task
com.xensource.xenapi.Task@a03eda0c","wait":0}}] }
2015-04-01 19:19:33,250 DEBUG [c.c.a.t.Request]
(API-Job-Executor-5:ctx-b0a797c8 job-2388 ctx-17f2247b) Seq
1-6176686888938669178: Received: { Ans: , MgmtId: 249373720971888, via: 1,
Ver: v1, Flags: 10, { CopyCmdAnswer } }
2015-04-01 19:19:33,302 DEBUG [c.c.t.TemplateManagerImpl]
(API-Job-Executor-5:ctx-b0a797c8 job-2388 ctx-17f2247b) Failed to create
templateCreating template from volume d07d3812-59f0-4d31-89e3-29107f9bb6cc
failed due to java.util.concurrent.TimeoutException: Async 10800 seconds
timeout for task com.xensource.xenapi.Task@a03eda0c
2015-04-01 19:19:33,455 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-5:ctx-b0a797c8 job-2388) Unexpected exception while executing
org.apache.cloudstack.api.command.admin.template.CreateTemplateCmdByAdmin
com.cloud.utils.exception.CloudRuntimeException: Failed to create
templateCreating template from volume d07d3812-59f0-4d31-89e3-29107f9bb6cc
failed due to java.util.concurrent.TimeoutException: Async 10800 seconds
timeout for task com.xensource.xenapi.Task@a03eda0c
at
com.cloud.template.TemplateManagerImpl.createPrivateTemplate(TemplateManagerImpl.java:1402)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy173.createPrivateTemplate(Unknown Source)
at
org.apache.cloudstack.api.command.admin.template.CreateTemplateCmdByAdmin.execute(CreateTemplateCmdByAdmin.java:42)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:503)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:460)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2015-04-01 19:19:33,457 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-5:ctx-b0a797c8 job-2388) Complete async job-2388, jobStatus:
FAILED, resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed
to create templateCreating template from volume
d07d3812-59f0-4d31-89e3-29107f9bb6cc failed due to
java.util.concurrent.TimeoutException: Async 10800 seconds timeout for task
com.xensource.xenapi.Task@a03eda0c"}
2015-04-01 19:19:33,507 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-5:ctx-b0a797c8 job-2388) Done executing
org.apache.cloudstack.api.command.admin.template.CreateTemplateCmdByAdmin for
job-2388
2015-04-01 19:19:33,532 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(API-Job-Executor-5:ctx-b0a797c8 job-2388) Remove job-2388 from job monitoring
2015-04-01 19:19:36,317 DEBUG [c.c.s.StatsCollector]
(StatsCollector-1:ctx-31d353ec) AutoScaling Monitor is running...
But I did not understood exact cause for timeout of job? There is 12TB free
space on storage.
/Sonali
-----Original Message-----
From: Vadim Kimlaychuk [mailto:[email protected]]
Sent: Thursday, April 2, 2015 1:57 PM
To: [email protected]
Subject: RE: unable to find created template
Can you see template file is created on secondady storage? May be there is not
enough space somewhere, so transaction to DB was rollbacked ?
Vadim
-----Original Message-----
From: Sonali Jadhav [mailto:[email protected]]
Sent: Thursday, April 02, 2015 11:22 AM
To: [email protected]
Subject: RE: unable to find created template
Now this is more weird, I don't see template ID 209 in DB
mysql> select * from template_zone_ref;
+----+---------+-------------+---------------------+---------------------+---------+
| id | zone_id | template_id | created | last_updated |
removed |
+----+---------+-------------+---------------------+---------------------+---------+
| 1 | 1 | 1 | 2015-01-23 11:53:59 | 2015-01-23 11:53:59 | NULL
|
| 2 | 1 | 2 | 2015-01-23 11:53:59 | 2015-01-23 11:53:59 | NULL
|
| 3 | 1 | 3 | 2015-01-23 11:53:59 | 2015-01-23 11:53:59 | NULL
|
| 4 | 1 | 4 | 2015-01-23 11:53:59 | 2015-01-23 11:53:59 | NULL
|
| 5 | 1 | 5 | 2015-01-23 11:53:59 | 2015-01-23 12:01:02 | NULL
|
| 6 | 1 | 6 | 2015-01-23 11:53:59 | 2015-01-23 11:53:59 | NULL
|
| 7 | 1 | 7 | 2015-01-23 11:53:59 | 2015-01-23 11:53:59 | NULL
|
| 8 | 1 | 8 | 2015-01-23 11:53:59 | 2015-01-23 11:53:59 | NULL
|
| 9 | 1 | 9 | 2015-01-23 11:53:59 | 2015-01-23 11:53:59 | NULL
|
| 10 | 1 | 10 | 2015-01-23 11:54:00 | 2015-01-23 11:54:00 | NULL
|
| 11 | 1 | 202 | 2015-01-27 10:57:18 | 2015-01-27 12:46:00 | NULL
|
| 12 | 1 | 203 | 2015-01-27 11:04:37 | 2015-01-27 11:04:37 | NULL
|
| 13 | 1 | 204 | 2015-02-17 08:20:09 | 2015-02-17 11:36:25 | NULL
|
| 14 | 1 | 205 | 2015-02-17 08:49:45 | 2015-02-17 11:36:24 | NULL
|
| 15 | 1 | 206 | 2015-02-26 11:58:14 | 2015-02-26 11:58:14 | NULL
|
| 16 | 1 | 207 | 2015-03-12 09:26:58 | 2015-03-12 09:26:58 | NULL
|
| 17 | 1 | 208 | 2015-03-23 09:47:58 | 2015-03-23 09:47:58 | NULL
|
+----+---------+-------------+---------------------+---------------------+---------+
17 rows in set (0.00 sec)
/Sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:[email protected]]
Sent: Thursday, April 2, 2015 1:49 PM
To: <[email protected]>
Subject: Re: unable to find created template
Have you tried setting is as featured so it shows up in the default list.
Regards
Geoff Higginbottom
CTO / Cloud Architect
D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540>
| M: +447968161581<tel:+447968161581>
[email protected]<mailto:[email protected]> |
www.shapeblue.com<htp://www.shapeblue.com/> |
Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
4HS<x-apple-data-detectors://5>
On 2 Apr 2015, at 09:13, Sonali Jadhav
<[email protected]<mailto:[email protected]>> wrote:
Nope template was not featured, I set it as public. And I made it with admin
login.
/Sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:[email protected]]
Sent: Thursday, April 2, 2015 1:32 PM
To: <[email protected]<mailto:[email protected]>>
Subject: Re: unable to find created template
Is the template 'featured' or are you logged in as a user from a different
account than the account who owns the template so can't see it etc
Regards
Geoff Higginbottom
CTO / Cloud Architect
D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540>
| M: +447968161581<tel:+447968161581>
[email protected]<mailto:[email protected]><mailto:[email protected]>
| www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/> |
Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
4HS<x-apple-data-detectors://5>
On 2 Apr 2015, at 09:00, Sonali Jadhav
<[email protected]<mailto:[email protected]><mailto:[email protected]>>
wrote:
Hi,
I have very weird issue, I created template from volume of one instance. In
event I observed this "Successfully completed creating template. Template Id:
209 from volume Id: 54", But I can't find it under "Templates" ?
/Sonali
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended
solely for the use of the individual to whom it is addressed. Any views or
opinions expressed are solely those of the author and do not necessarily
represent those of Shape Blue Ltd or related companies. If you are not the
intended recipient of this email, you must neither take any action based upon
its contents, nor copy or show it to anyone. Please contact the sender if you
believe you have received this email in error. Shape Blue Ltd is a company
incorporated in England & Wales. ShapeBlue Services India LLP is a company
incorporated in India and is operated under license from Shape Blue Ltd. Shape
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company
registered by The Republic of South Africa and is traded under license from
Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended
solely for the use of the individual to whom it is addressed. Any views or
opinions expressed are solely those of the author and do not necessarily
represent those of Shape Blue Ltd or related companies. If you are not the
intended recipient of this email, you must neither take any action based upon
its contents, nor copy or show it to anyone. Please contact the sender if you
believe you have received this email in error. Shape Blue Ltd is a company
incorporated in England & Wales. ShapeBlue Services India LLP is a company
incorporated in India and is operated under license from Shape Blue Ltd. Shape
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company
registered by The Republic of South Africa and is traded under license from
Shape Blue Ltd. ShapeBlue is a registered trademark.
