Re: [PR] Fix automatic SystemVM template download to S3 secondary storage [cloudstack]

[via GitHub]

Damans227 commented on PR #12426:
URL: https://github.com/apache/cloudstack/pull/12426#issuecomment-3834637933

   > @Damans227
   > 
   > Please find the issues that i observed
   > 
   > Tested with the pr packages and on oracle linux 8.6
   > 
   > 1. Unable to use ceph s3 storage , got the following exception is logs
   > 
   > ```
   > 2026-01-30 07:52:30,770 DEBUG [o.a.c.s.r.NfsSecondaryStorageResource] 
(pool-11-thread-1:[ctx-a125d9e1]) (logid:7259f280) Executing command 
"DownloadCommand" [{"hvm":false,"description":"SystemVM Template 
(KVM)","checksum":"c059b0d051e0cd6fbe9d5d4fc40c7e5d","maxDownloadSizeInBytes":53687091200,"id":3,"resourceType":"TEMPLATE","installPath":"template/tmpl/1/3/routing-3","_store":{"id":1,"uuid":"fdb66906-6b57-4e32-a7df-cbb93a917fce","accessKey":"AFYT2BKNI1U8T6DY6435","secretKey":"kia5kyDAZuP7QjwxNmhVAEE5l5dzsSJWbxtSXCIA","endPoint":"https://10.0.33.100","bucketName":"testbucket","httpsFlag":true,"created":"Jan
 30, 2026, 7:52:20 
AM","enableRRS":false,"maxSingleUploadSizeInBytes":5368709120},"followRedirects":false,"url":"http://download.cloudstack.org/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2","format":"QCOW2","accountId":1,"name":"routing-3","contextMap":{},"wait":0,"bypassHostMaintenance":false}].
   > 2026-01-30 07:52:30,798 DEBUG [c.c.u.n.HTTPUtils] 
(pool-11-thread-1:[ctx-a125d9e1]) (logid:7259f280) Initializing new 
HttpMethodRetryHandler with retry count 5
   > 2026-01-30 07:52:30,892 INFO  [c.c.s.t.S3TemplateDownloader] 
(pool-10-thread-1:[ctx-2cad9dd2]) (logid:1b4a38df) Starting download from 
http://download.cloudstack.org/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2
 to S3 bucket testbucket and size (304.60 MB) 319401369 bytes
   > 2026-01-30 07:52:30,897 DEBUG [c.c.u.s.S.S3Utils] 
(pool-10-thread-1:[ctx-2cad9dd2]) (logid:1b4a38df) Sending stream as S3 object 
template/tmpl/1/3/routing-3/systemvm64template-4.6.0-kvm.qcow2.bz2 in bucket 
testbucket using PutObjectRequest
   > 2026-01-30 07:52:31,217 DEBUG [c.c.u.s.S.S3Utils] 
(pool-10-thread-1:[ctx-2cad9dd2]) (logid:1b4a38df) Creating S3 client with 
configuration: [protocol: https, signer: null, connectionTimeOut: 10000, 
maxErrorRetry: -1, socketTimeout: 50000, useTCPKeepAlive: null, connectionTtl: 
null]
   > 2026-01-30 07:52:31,468 DEBUG [c.c.u.s.S.S3Utils] 
(pool-10-thread-1:[ctx-2cad9dd2]) (logid:1b4a38df) Setting the end point for S3 
client with access key AFYT2BKNI1U8T6DY6435 to https://10.0.33.100.
   > 
   > 
   > 
   > 2026-01-30 07:52:33,803 INFO  [o.a.c.s.i.BaseImageStoreDriverImpl] 
(pool-11-thread-1:[ctx-a125d9e1]) (logid:7259f280) Updating store ref entry for 
template Template {"format":"QCOW2","id":3,"name":"SystemVM Template 
(KVM)","uniqueName":"routing-3","uuid":"56911227-fd0c-11f0-9d05-1e00e00002fb"}
   > 2026-01-30 07:52:33,817 WARN  [c.c.a.AlertManagerImpl] 
(pool-11-thread-1:[ctx-a125d9e1]) (logid:7259f280) alertType=[28] 
dataCenterId=[1] podId=[null] clusterId=[null] message=[Failed to register 
template: 56911227-fd0c-11f0-9d05-1e00e00002fb with error: ].
   > 2026-01-30 07:52:33,825 WARN  [c.c.a.AlertManagerImpl] 
(pool-11-thread-1:[ctx-a125d9e1]) (logid:7259f280) No recipients set in global 
setting 'alert.email.addresses', skipping sending alert with subject [Failed to 
register template: 56911227-fd0c-11f0-9d05-1e00e00002fb with error: ] and 
content [Failed to register template: 56911227-fd0c-11f0-9d05-1e00e00002fb with 
error: ].
   > 2026-01-30 07:52:33,825 ERROR [o.a.c.s.i.BaseImageStoreDriverImpl] 
(pool-11-thread-1:[ctx-a125d9e1]) (logid:7259f280) Failed to register template: 
56911227-fd0c-11f0-9d05-1e00e00002fb 
   > with error:
   > ```
   > 
   > 2. Used Minio s3 storage, the systemvm template got registered successfully
   > 
   > But it was of "systemvm64template-4.6.0-kvm.qcow2.bz2" and the systemvm 
were struck in starting state
   > 
   > <img alt="Image" width="1827" height="532" 
src="https://private-user-images.githubusercontent.com/1401014/542754813-f1361c5a-3e7e-4058-8cb3-1dac449dfd8a.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAwMzI4MzgsIm5iZiI6MTc3MDAzMjUzOCwicGF0aCI6Ii8xNDAxMDE0LzU0Mjc1NDgxMy1mMTM2MWM1YS0zZTdlLTQwNTgtOGNiMy0xZGFjNDQ5ZGZkOGEucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwMiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDJUMTE0MjE4WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9YTIxYTEwODRmNTljYzRkOGUzMGJmMTc0M2Y5NDRmMjA3NDVhZGJhMWZiYTFlNGM2MWJmMmQ5ZmQ1ODEwZWE1ZSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.imxjgRN1pwMqvTVWswcjnDLGRMwyB3JJWkp5BsMsXqI";>
   > 3. When the primary storage is of zone scope,
   > 
   > logs
   > 
   > ```
   > 2026-01-30 09:32:23,838 DEBUG [o.a.c.s.v.VolumeServiceImpl] 
(Work-Job-Executor-7:[ctx-45ba2dab, job-40/job-47, ctx-3f578420]) 
(logid:17e47580) Found template Template 
{"format":"QCOW2","id":3,"name":"SystemVM Template 
(KVM)","uniqueName":"routing-3","uuid":"56911227-fd0c-11f0-9d05-1e00e00002fb"} 
in storage pool StoragePool 
{"id":1,"name":"pri","poolType":"NetworkFilesystem","uuid":"cfc7f591-fc1e-36dd-b2c5-dc6712acf57e"}
 with VMTemplateStoragePool: TmplPool[3-3-1-null]
   > 2026-01-30 09:32:23,839 DEBUG [o.a.c.s.v.VolumeServiceImpl] 
(Work-Job-Executor-7:[ctx-45ba2dab, job-40/job-47, ctx-3f578420]) 
(logid:17e47580) Acquire lock on VMTemplateStoragePool 3 with timeout 3600 
seconds
   > ```
   > 
   > 4. When the primary storage is of cluster scope,
   > 
   > logs
   > 
   > ```
   > 
   > 2026-01-30 09:47:14,659 DEBUG [o.a.c.s.c.m.StorageCacheManagerImpl] 
(Work-Job-Executor-6:[ctx-fdef51b0, job-62/job-64, ctx-9c2c6347]) 
(logid:11a5fb7e) waiting cache copy completion type: template, id: 3, lock: 
638897157
   > 2026-01-30 09:47:24,659 DEBUG [o.a.c.s.c.m.StorageCacheManagerImpl] 
(Work-Job-Executor-6:[ctx-fdef51b0, job-62/job-64, ctx-9c2c6347]) 
(logid:11a5fb7e) waken up
   > 2026-01-30 09:47:24,661 DEBUG [o.a.c.s.c.m.StorageCacheManagerImpl] 
(Work-Job-Executor-6:[ctx-fdef51b0, job-62/job-64, ctx-9c2c6347]) 
(logid:11a5fb7e) waiting cache copy completion type: template, id: 3, lock: 
638897157
   > ```
   
   I see. Do you have the test env available that I can use for debugging? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@cloudstack.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org