hi mike,

i have figured out the issue, in NFS secondary storage the virtual size is
been calculated by the VHD Processor by accessing the vhd template.

but in case of S3, cloudstack is not able to access the template but it
only gets to know the physical size of the template!

in order to solve this, we need to download the template from S3 to another
secondary nfs storage and access the template to calculate the virtual size.

if the above solution seems to be complicated, we shall have a quick fix
where virtual size i.e the size of the SAN volume shall be created(like
small-20g, medium-40g) for people using the templates from S3.

any feedback's ?



On Tue, Sep 9, 2014 at 6:34 AM, Mike Tutkowski <mike.tutkow...@solidfire.com
> wrote:

> Hi Punith,
>
> Have you been able to make any progress with regards to this Swift/S3
> issue?
>
> Thanks!
> Mike
>
> On Wed, Aug 27, 2014 at 7:43 AM, Punith S <punit...@cloudbyte.com> wrote:
>
> > hi
> >
> > think i had a timeout problem!
> > on the second try the template has been downloaded to the S3 bucket and
> > the management server shows the status as download complete with template
> > size as 1.6G instead of its virtual size 20G.
> >
> > and i see the template's status as Download Complete but it seems it is
> > not getting installed ! refer the attachment
> >
> > can anyone explain the "installing template" after the download
> completes ?
> >
> >
> > On Wed, Aug 27, 2014 at 9:18 AM, Marcus <shadow...@gmail.com> wrote:
> >
> >> Per Edisons comments about not knowing the image size, can't we just set
> >> some headers and store metadata with the template in S3 to save the
> >> virtual
> >> size when the template is registered? I'm assuming here that the SSVM
> does
> >> the work of pulling the template in and uploading to S3. Or it could be
> >> stored in the template table?
> >> On Aug 26, 2014 9:11 PM, "Francois Gaudreault" <
> fgaudrea...@cloudops.com>
> >> wrote:
> >>
> >> > Looks like your SSVM cannot reach Internet properly?
> >> >
> >> > FG
> >> >
> >> > On 2014-08-26, 11:14 AM, Punith S wrote:
> >> >
> >> >> hi francois,
> >> >>
> >> >> since i'm not having a swift setup, i'm using the s3 bucket.
> >> >>
> >> >> and as you recommended i got the SSVM up with seeded nfs storage,
> >> >>
> >> >> post that i removed the nfs secondary storage and added the S3 with
> >> >> staging nfs store as the new sec storage, since you cannot have any
> nfs
> >> >> secondary storage while using the S3.
> >> >>
> >> >> on registering the a new template, i'm getting template status
> >> as*Unable
> >> >> to execute HTTP request: No route to host*
> >> >> in managementserver.log
> >> >>
> >> >> 2014-08-26 20:41:07,502 DEBUG [o.a.c.s.RemoteHostEndPoint]
> >> >> (Timer-24:ctx-b68380cd) Sending command
> org.apache.cloudstack.storage.
> >> >> command.DownloadProgressCommand to host: 10
> >> >> 2014-08-26 20:41:07,507 DEBUG [c.c.a.t.Request]
> (Timer-24:ctx-b68380cd)
> >> >> Seq 10-5684105679694996125: Sending  { Cmd , MgmtId: 52242179434,
> via:
> >> >> 10(s-142-VM), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.
> >> >>
> storage.command.DownloadProgressCommand":{"jobId":"d43a17c9-3b03-4ff9-
> >> >> 8906-e1d155981e86","request":"GET_STATUS","hvm":true,"
> >> >>
> description":"centext","maxDownloadSizeInBytes":53687091200,"id":209,"
> >> >> resourceType":"TEMPLATE","installPath":"template/tmpl/2/
> >> >> 209/209-2-b624436c-5f37-30d4-8eaf-81582eb0d39d","_store":{"
> >> >> com.cloud.agent.api.to.S3TO":{"id":14,"uuid":"e4afd7bb-39ea-
> >> >> 4128-ab93-f8a09b1d5e03","bucketName":"test-cloudstack",
> >> >> "httpsFlag":false,"created":"Aug 26, 2014 8:16:24
> >> PM","enableRRS":false,"
> >> >> maxSingleUploadSizeInBytes":5368709120}},"url":"http://
> >> >> download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> >> >>
> >>
> ","format":"VHD","accountId":2,"name":"209-2-b624436c-5f37-30d4-8eaf-81582eb0d39d","wait":0}}]
> >> >> }
> >> >> 2014-08-26 20:41:07,556 DEBUG [c.c.a.t.Request]
> >> >> (AgentManager-Handler-10:null) Seq 10-5684105679694996125:
> >> Processing:  {
> >> >> Ans: , MgmtId: 52242179434, via: 10, Ver: v1, Flags: 10,
> >> >> [{"com.cloud.agent.api.storage.DownloadAnswer":{"
> >> >> jobId":"d43a17c9-3b03-4ff9-8906-e1d155981e86","
> >> >> downloadPct":0,"errorString":"No route to host","downloadStatus":"
> >> >> DOWNLOAD_ERROR","installPath":"template/tmpl/2/209/209-2-
> >> >> b624436c-5f37-30d4-8eaf-81582eb0d39d","templateSize":
> >> >> 0,"templatePhySicalSize":0,"result":true,"details":"No route to
> >> >> host","wait":0}}] }
> >> >>
> >> >> but i don't see any logging happening in secondary storage vm's
> >> cloud.log
> >> >>
> >> >> not sure this error is happening due to S3!
> >> >>
> >> >>
> >> >> thanks!
> >> >>
> >> >
> >> >
> >> > --
> >> > Francois Gaudreault
> >> > Gestionnaire de Produit | Product Manager - Cloud Platform & Services
> >> > t:514-629-6775
> >> >
> >> > CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
> >> > 420 rue Guy | Montreal | Quebec | H3J 1S6
> >> > w: cloudops.com | tw: @CloudOps_
> >> >
> >> >
> >>
> >
> >
> >
> > --
> > regards,
> >
> > punith s
> > cloudbyte.com
> >
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the cloud
> <http://solidfire.com/solution/overview/?video=play>*™*
>



-- 
regards,

punith s
cloudbyte.com

Reply via email to