Ah.. it worked now, removing snapshots even if CS is throwing above error in log. But it's not removing destroyed vm's snapshots.
-- Leeno On Thu, Jul 4, 2013 at 11:01 PM, Leeno Jose.P.A <[email protected]> wrote: > Thanks Ahmad. > > I set interval to 300 for testing. But still snapshots are not deleted. In > management.log i see, > > 2013-07-04 13:18:09,202 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-65:null) Seq 47-153092120: Executing request > 2013-07-04 13:18:09,614 DEBUG [cloud.storage.StorageManagerImpl] > (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 > templates to clean up in storage pool: cstagzb-pds01 > 2013-07-04 13:18:09,616 DEBUG [cloud.storage.StorageManagerImpl] > (StorageManager-Scavenger-1:null) Secondary storage garbage collector found > 0 templates to cleanup on secondary storage host: nfs:// > 192.168.12.251/cstagzb-sds01 > 2013-07-04 13:18:09,617 WARN [cloud.storage.StorageManagerImpl] > (StorageManager-Scavenger-1:null) problem cleaning up snapshots in > secondary storage Host[-40-SecondaryStorage] > java.lang.NullPointerException > at > com.cloud.storage.StorageManagerImpl.cleanupSecondaryStorage(StorageManagerImpl.java:2531) > at > com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125) > at > com.cloud.storage.StorageManagerImpl.cleanupStorage(StorageManagerImpl.java:2403) > at > com.cloud.storage.StorageManagerImpl$StorageGarbageCollector.run(StorageManagerImpl.java:3757) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at > java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:679) > 2013-07-04 13:18:09,622 DEBUG [agent.transport.Request] > (StorageManager-Scavenger-1:null) Seq 50-1192034327: Sending { Cmd , > MgmtId: 130602634328, via: 50, Ver: v1, Flags: 100011, [{"CleanupSnapsh > otBackupCommand":{"secondaryStoragePoolURL":"nfs:// > 192.168.12.251/cstagzb-sds01","dcId":9,"accountId":2,"volumeId":1226,"validBackupUUIDs":[],"wait":0}}] > } > 2013-07-04 13:18:09,679 DEBUG [agent.transport.Request] > (AgentManager-Handler-12:null) Seq 50-1192034327: Processing: { Ans: , > MgmtId: 130602634328, via: 50, Ver: v1, Flags: 10, [{"Answer":{"resul > t":true,"wait":0}}] } > > > -- > Leeno > > > On Thu, Jul 4, 2013 at 10:15 PM, Ahmad Emneina <[email protected]> wrote: > >> they wont be removed from the backend until the actual cleanup happens. >> what is set for your storage.cleanup.interval, and storage.cleanup.enabled >> values in the global settings? >> >> >> On Thu, Jul 4, 2013 at 9:30 AM, Leeno Jose.P.A <[email protected]> >> wrote: >> >> > Hi All, >> > >> > I ma using Xenserver 6.0.2 with Clodstack 4.1 >> > >> > While deleting snapshots manually, it's getting removed from MS but not >> > from nfs secondary storage. >> > >> > I see following logs in SSVM, >> > >> > 2013-07-04 13:09:32,570 DEBUG [cloud.agent.Agent] >> (agentRequest-Handler-3:) >> > Processing command: com.cloud.agent.api.GetStorageStatsCommand >> > 2013-07-04 13:09:32,572 DEBUG >> > [storage.resource.NfsSecondaryStorageResource] (agentRequest-Handler-3:) >> > Executing: mount >> > 2013-07-04 13:09:32,575 DEBUG >> > [storage.resource.NfsSecondaryStorageResource] (agentRequest-Handler-3:) >> > Execution is successful. >> > 2013-07-04 13:09:37,003 DEBUG [cloud.agent.Agent] >> (agentRequest-Handler-4:) >> > Request:Seq 50-1124270094: { Cmd , MgmtId: 130602634328, via: 50, Ver: >> v1, >> > Flags: 100011, >> > >> > >> [{"DeleteSnapshotBackupCommand":{"all":false,"primaryStoragePoolNameLabel":"be695799-ec7e-390b-b600-09ad8f8db048","primaryPool":{"id":210,"uuid":"be695799-ec7e-390b-b600-09ad8f8db048","host":"192.168.10.251","path":"/cstagzb-pds01","port":2049,"type":"NetworkFilesystem"},"snapshotUuid":"127ea7ae-c7c0-4ee9-938d-80ea23f67e51","secondaryStorageUrl":" >> > nfs://192.168.12.251/cstagzb-sds01 >> > ","dcId":9,"accountId":2,"volumeId":1297,"wait":0}}] >> > } >> > 2013-07-04 13:09:37,003 DEBUG [cloud.agent.Agent] >> (agentRequest-Handler-4:) >> > Processing command: com.cloud.agent.api.DeleteSnapshotBackupCommand >> > 2013-07-04 13:09:37,004 DEBUG >> > [storage.resource.NfsSecondaryStorageResource] (agentRequest-Handler-4:) >> > Executing: mount >> > 2013-07-04 13:09:37,008 DEBUG >> > [storage.resource.NfsSecondaryStorageResource] (agentRequest-Handler-4:) >> > Execution is successful. >> > 2013-07-04 13:09:37,011 DEBUG >> > [storage.resource.NfsSecondaryStorageResource] (agentRequest-Handler-4:) >> > Executing: /bin/bash -c rm -f >> > >> > >> /mnt/SecStorage/71d74169-8641-39ec-aa9a-f2b6045ecdc8:snapshots:2:1297:*127ea7ae-c7c0-4ee9-938d-80ea23f67e51* >> > 2013-07-04 13:09:37,015 DEBUG >> > [storage.resource.NfsSecondaryStorageResource] (agentRequest-Handler-4:) >> > Execution is successful. >> > 2013-07-04 13:09:37,016 DEBUG [cloud.agent.Agent] >> (agentRequest-Handler-4:) >> > Seq 50-1124270094: { Ans: , MgmtId: 130602634328, via: 50, Ver: v1, >> Flags: >> > 10, [{"Answer":{"result":true,"details":"success","wait":0}}] } >> > 2013-07-04 13:09:52,935 DEBUG [cloud.agent.Agent] (UgentTask-5:) Sending >> > ping: Seq 50-7: { Cmd , MgmtId: -1, via: 50, Ver: v1, Flags: 11, >> > >> > >> [{"PingStorageCommand":{"changes":{},"hostType":"Storage","hostId":50,"wait":0}}] >> > } >> > 2013-07-04 13:09:52,978 DEBUG [cloud.agent.Agent] (Agent-Handler-2:) >> > Received response: Seq 50-7: { Ans: , MgmtId: 130602634328, via: 50, >> Ver: >> > v1, Flags: 100010, >> > >> > >> [{"PingAnswer":{"_command":{"hostType":"Storage","hostId":50,"wait":0},"result":true,"wait":0}}] >> > } >> > >> > >> > But it's not removing snapshot. The path shown with 'rm' command is >> > >> > >> /mnt/SecStorage/71d74169-8641-39ec-aa9a-f2b6045ecdc8:snapshots:2:1297:*127ea7ae-c7c0-4ee9-938d-80ea23f67e51*. >> > There it is seems directories are separated using ":". Is this correct? >> > Shouldn't be "/"? >> > >> > -- >> > Leeno >> > >> > -- >> > Leeno Jose .P.A >> > >> > > > > -- > Leeno Jose .P.A > -- Leeno Jose .P.A
