It seems that is the issue we are suffering. We expunged VMs prior to secondary storage cleanup.

Is there a way to delete those volumes manually or to force cleaning them up?


El 22/11/2016 a las 11:55, Koushik Das escribió:
There is an open PR which fixes a similar issue 
https://github.com/apache/cloudstack/pull/1726. Check it out.

-Koushik

On 22/11/16, 4:05 PM, "Natalia Costas Lago" <[email protected]> wrote:

     Hi Dag,
It is expunged..., but "removed" it is not set to a date.. ** In the database: MariaDB [cloud]> select * from volumes where name="ROOT-1241"\G;
     *************************** 1. row ***************************
                              id: 1283
                      account_id: 2
                       domain_id: 1
                         pool_id: 9
                    last_pool_id: NULL
                     instance_id: 1241
                       device_id: 0
                            name: ROOT-1241
                            uuid: 88f8e37d-8d84-48d5-9671-912e5749a288
                            size: 10737418240
                          folder: NULL
                            path: 88f8e37d-8d84-48d5-9671-912e5749a288
                          pod_id: NULL
                  data_center_id: 1
                      iscsi_name: NULL
                         host_ip: NULL
                     volume_type: ROOT
                       pool_type: NULL
                disk_offering_id: 23
                     template_id: 245
     first_snapshot_backup_uuid: NULL
                     recreatable: 0
                         created: 2016-11-09 13:16:48
                        attached: NULL
                         updated: 2016-11-09 15:44:53
                         removed: NULL
                           state: Expunged
                      chain_info: NULL
                    update_count: 8
                       disk_type: NULL
          vm_snapshot_chain_size: NULL
                          iso_id: NULL
                  display_volume: 1
                          format: QCOW2
                        min_iops: NULL
                        max_iops: NULL
                   hv_ss_reserve: NULL
               provisioning_type: sparse
     1 row in set (0.00 sec)
MariaDB [cloud]> select * from volume_view where name="ROOT-1241"\G;
     *************************** 1. row ***************************
                              id: 1283
                            uuid: 88f8e37d-8d84-48d5-9671-912e5749a288
                            name: ROOT-1241
                       device_id: 0
                     volume_type: ROOT
               provisioning_type: sparse
                            size: 10737418240
                        min_iops: NULL
                        max_iops: NULL
                         created: 2016-11-09 13:16:48
                           state: Expunged
                        attached: NULL
                         removed: NULL
                          pod_id: NULL
                  display_volume: 1
                          format: QCOW2
                            path: 88f8e37d-8d84-48d5-9671-912e5749a288
                      chain_info: NULL
                      account_id: 2
                    account_uuid: f1252dbd-7d0f-11e6-a07c-02000a700064
                    account_name: admin
                    account_type: 1
                       domain_id: 1
                     domain_uuid: c8665aea-7c12-11e6-a07c-02000a700064
                     domain_name: ROOT
                     domain_path: /
                      project_id: NULL
                    project_uuid: NULL
                    project_name: NULL
                  data_center_id: 1
                data_center_uuid: 07c2912e-fbd4-43fc-8279-083ed6342817
                data_center_name: zona1
                data_center_type: Advanced
                           vm_id: 1241
                         vm_uuid: d4215497-d009-4349-8fb4-c4a739d50d6d
                         vm_name: test-qcow2-kk
                        vm_state: Expunging
                         vm_type: User
                 vm_display_name: test-qcow2-kk
               volume_store_size: 0
                    download_pct: 0
                  download_state: NULL
                       error_str: NULL
                created_on_store: 2016-11-09 13:19:13
                disk_offering_id: 23
              disk_offering_uuid: 5cc82a5d-2755-42a0-880f-4b0c6c86936a
              disk_offering_name: Standard IO, shared storage, sparse volume
     disk_offering_display_text: Standard IO, shared storage, sparse volume
               use_local_storage: 0
                      system_use: 0
                 bytes_read_rate: NULL
                bytes_write_rate: NULL
                  iops_read_rate: NULL
                 iops_write_rate: NULL
                      cache_mode: NULL
                         pool_id: 9
                       pool_uuid: c69fb76e-f2f9-359e-bda0-1259786717af
                       pool_name: almacenamiento-primario-gluster
                 hypervisor_type: NULL
                     template_id: 245
                   template_uuid: 730001de-bdd9-464e-ba7b-f38668953e6d
                     extractable: 1
                   template_type: USER
                   template_name: centos7-comiteado-raw
           template_display_text: centos7-comiteado-raw
                          iso_id: NULL
                        iso_uuid: NULL
                        iso_name: NULL
                iso_display_text: NULL
                          tag_id: NULL
                        tag_uuid: NULL
                         tag_key: NULL
                       tag_value: NULL
                   tag_domain_id: NULL
                 tag_domain_uuid: c8665aea-7c12-11e6-a07c-02000a700064
                 tag_domain_name: ROOT
                  tag_account_id: NULL
                tag_account_name: admin
                 tag_resource_id: NULL
               tag_resource_uuid: NULL
               tag_resource_type: NULL
                    tag_customer: NULL
                          job_id: NULL
                        job_uuid: NULL
                      job_status: NULL
                  job_account_id: NULL
     1 row in set (0.00 sec)
ERROR: No query specified ** In the user interface: Name ROOT-1241 ID 88f8e37d-8d84-48d5-9671-912e5749a288
     Zone       zona1
     State      Expunged
     Status     
     Disk Offering      
     Type       ROOT
     Storage Type       shared
     Provisioning Type  sparse
     Hypervisor         KVM
     Size       10.00 GB
     Min IOPS   
     Max IOPS   
     VM ID      d4215497-d009-4349-8fb4-c4a739d50d6d
     VM display name    test-qcow2-kk
     VM state   Expunging
     Device ID  0
     Storage    almacenamiento-primario-gluster
     Created    09 Nov 2016 14:16:48
     Domain     ROOT
     Account    admin
** In the primary gluster storage: [root@c11-37 ~]# ls -lah
     
/mnt/c69fb76e-f2f9-359e-bda0-1259786717af/730001de-bdd9-464e-ba7b-f38668953e6d
     -rwxr--r-- 1 root root 3.8G Nov  9 12:41
     
/mnt/c69fb76e-f2f9-359e-bda0-1259786717af/730001de-bdd9-464e-ba7b-f38668953e6d
El 22/11/2016 a las 10:14, Dag Sonstebo escribió:
     > Hi Natalia,
     >
     > So in other words the database shows the volumes as “expunged” and 
removed set to a date, but you can still find the volumes on your primary storage?
     >
     > Regards,
     > Dag Sonstebo
     > Cloud Architect
     > ShapeBlue
     >
     >
     > [email protected]
     > www.shapeblue.com
     > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
     > @shapeblue
     >
     >
     >
     > On 21/11/2016, 20:33, "Natalia Costas Lago" <[email protected]> wrote:
     >
     >
     >      Dear Dag,
     >
     >      Those parameters are set to 86400, but before I also tried setting 
them
     >      to 60 seconds and restarting the management server. I have also 
been out
     >      of the office for a week so the volumes have been there long enough 
to
     >      be actually deleted.
     >
     >      Regards,
     >
     >
     >
     >      El 21/11/2016 a las 19:30, Dag Sonstebo escribió:
     >      > Natalia,
     >      >
     >      > What are your expunge.delay and expunge.interval global settings 
set to?
     >      >
     >      > Regards,
     >      > Dag Sonstebo
     >      > Cloud Architect
     >      > ShapeBlue
     >      >
     >      >
     >      > [email protected]
     >      > www.shapeblue.com
     >      > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
     >      > @shapeblue
     >      >
     >      >
     >      >
     >      > On 21/11/2016, 18:13, "Natalia Costas Lago" <[email protected]> 
wrote:
     >      >
     >      >
     >      >      Hi,
     >      >
     >      >
     >      >      At our cloudstack deployment we have volumes that have been 
expunged but
     >      >      not deleted. I think the problem is related with the next 
documented issue:
     >      >
     >      >      https://issues.apache.org/jira/browse/CLOUDSTACK-9119
     >      >
     >      >      Is there a way to force the deletion of expunged volumes in 
this situation?
     >      >
     >      >      Thanx in advance
     >      >
     >      >      --
     >      >      ====================================================
     >      >      Natalia Costas Lago
     >      >      Senior Communications Technician
     >      >      Galicia Supercomputing Centre (CESGA)
     >      >      (CESGA on Twitter  |  CESGA on Facebook)
     >      >
     >      >      Avenida de Vigo, s/n (Campus Vida)
     >      >      15705 Santiago de Compostela - SPAIN
     >      >
     >      >      E-mail: [email protected]
     >      >      Cell: +34 981 56 98 10 (ext. 237)
     >      >      Fax: +34 981 59 46 16
     >      >      Web: https://www.cesga.es/
     >      >      ====================================================
     >      >      [IMPORTANTE] La información contenida en este mensaje y
     >      >      sus posibles documentos adjuntos es privada y confidencial
     >      >      y está dirigida únicamente a su destinatario/a. Si usted no
     >      >      es el/la destinatario/a original de este mensaje, por favor
     >      >      elimínelo. La distribución o copia de este mensaje no está
     >      >      autorizada.
     >      >
     >      >
     >      >
     >
     >      --
     >      ====================================================
     >      Natalia Costas Lago
     >      Senior Communications Technician
     >      Galicia Supercomputing Centre (CESGA)
     >      (CESGA on Twitter  |  CESGA on Facebook)
     >
     >      Avenida de Vigo, s/n (Campus Vida)
     >      15705 Santiago de Compostela - SPAIN
     >
     >      E-mail: [email protected]
     >      Cell: +34 981 56 98 10 (ext. 237)
     >      Fax: +34 981 59 46 16
     >      Web: https://www.cesga.es/
     >      ====================================================
     >      [IMPORTANTE] La información contenida en este mensaje y
     >      sus posibles documentos adjuntos es privada y confidencial
     >      y está dirigida únicamente a su destinatario/a. Si usted no
     >      es el/la destinatario/a original de este mensaje, por favor
     >      elimínelo. La distribución o copia de este mensaje no está
     >      autorizada.
     >
     >
     >
--
     ====================================================
     Natalia Costas Lago
     Senior Communications Technician
     Galicia Supercomputing Centre (CESGA)
     (CESGA on Twitter  |  CESGA on Facebook)
Avenida de Vigo, s/n (Campus Vida)
     15705 Santiago de Compostela - SPAIN
E-mail: [email protected]
     Cell: +34 981 56 98 10 (ext. 237)
     Fax: +34 981 59 46 16
     Web: https://www.cesga.es/
     ====================================================
     [IMPORTANTE] La información contenida en este mensaje y
     sus posibles documentos adjuntos es privada y confidencial
     y está dirigida únicamente a su destinatario/a. Si usted no
     es el/la destinatario/a original de este mensaje, por favor
     elimínelo. La distribución o copia de este mensaje no está
     autorizada.



DISCLAIMER
==========
This e-mail may contain privileged and confidential information which is the 
property of Accelerite, a Persistent Systems business. It is intended only for 
the use of the individual or entity to which it is addressed. If you are not 
the intended recipient, you are not authorized to read, retain, copy, print, 
distribute or use this message. If you have received this communication in 
error, please notify the sender and delete all copies of this message. 
Accelerite, a Persistent Systems business does not accept any liability for 
virus infected mails.

--
====================================================
Natalia Costas Lago
Senior Communications Technician
Galicia Supercomputing Centre (CESGA)
(CESGA on Twitter  |  CESGA on Facebook)

Avenida de Vigo, s/n (Campus Vida)
15705 Santiago de Compostela - SPAIN

E-mail: [email protected]
Cell: +34 981 56 98 10 (ext. 237)
Fax: +34 981 59 46 16
Web: https://www.cesga.es/
====================================================
[IMPORTANTE] La información contenida en este mensaje y
sus posibles documentos adjuntos es privada y confidencial
y está dirigida únicamente a su destinatario/a. Si usted no
es el/la destinatario/a original de este mensaje, por favor
elimínelo. La distribución o copia de este mensaje no está
autorizada.

Reply via email to