Hi All,
I am using CS 4.3.1 and xenserver 6.2
I have configured daily recurring snapshot policy for all the root volumes.
but recent three days onwards it is taking full snapshots and not taking
any child snapshots.
I have configured snapshot.delta.max to 16.
please help me my secondary storage is becoming full.
The log file details shows:
2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
(DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
Resp: Routing to peer
2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage VM
2015-09-14 01:03:33,934 WARN [c.c.u.n.Link] (AgentManager-Selector:null)
SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-10:null) Seq 1-457572529: Executing: { Cmd , MgmtId:
108371418365724, via: 1, Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
"}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b"}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
}
2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
2015-09-14 01:03:35,421 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd: getVhdParent
with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6, due to
There was a failure communicating with the plugin.
2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
(DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for
cmd: getVhdParent with args snapshotUuid:
3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false, primaryStorageSRUuid:
a6a7f65a-a1d2-83e3-d3b0-f38792863fb6, due to There was a failure
communicating with the plugin.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
at
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
at
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
at
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
at
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)
2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
2015-09-14 01:03:35,423 INFO [c.c.a.m.ClusteredAgentManagerImpl]
(DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
(DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
Resp: Unable to route to peer: Seq 1-457572529: { Ans: , MgmtId:
108371418365724, via: 1, Ver: v1, Flags: 10,
[{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
}
2015-09-14 01:03:38,934 WARN [c.c.u.n.Link] (AgentManager-Selector:null)
SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178: {
Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
Regards,
rajasekhar.
