Re: DISCUSS : Vmware to Cloudstack migration support

[Shreya Nair]

Hi Paul,
We explored the XenConvert solution. The XenConvert utility has been
retired from XenServer 6.2 and upward. So the only solution would be using
an old copy or trial version of Xen Conversion Manager.

Instead of the qemu-img utility, we used the VirtualBox VBoxManage.exe to
support conversion of *.VMDK file to VHD. This VHD file was used to create
a CS template and create an instance. However, the VM was unable to mount
the drives as it was unable to find xvdXX partitions


I get the following error on CS instance on boot:
[image: Inline image 2]

and the logs shows us this:

*You might have to change the root from /dev/hd[a-d] to /dev/xvd[a-d]*



However, on using *lsblk *command on the source vmware instance, we
realized that the partitions on SCSI storage devices (Used by vmware) are
named as  /dev/sdXX while Xen supports /dev/xvdXX.
[image: Inline image 1]

Note: VMware tools has been removed from VM prior to migration


Thanks & Regards,

Shreya

On Thu, Jul 6, 2017 at 12:17 AM, Paul Angus 
wrote:

> There used to be a XenConvert utility that you do that conversion for
> you.  I'm not sure that its about anymore, but a bit of googling might dig
> up a copy.
>
> Alternatively there are linux and Windows versions of qemu-img convert ,
> which usually does a pretty good job of disk image conversions
>
> Otherwise you could use a P2V backup/recovery tool with an agent that runs
> inside your VMs
>
>
>
> Kind regards,
>
> Paul Angus
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Shreya Nair [mailto:shreya.n...@opcito.com]
> Sent: 05 July 2017 09:22
> To: us...@cloudstack.apache.org
> Subject: Re: DISCUSS : Vmware to Cloudstack migration support
>
> Hi Oliver,
>
> We are trying to migrate the vSphere environment to cloudstack (based on
> XenServer) due to some internal product dependency which can be addressed
> by the CloudStack environment.
>
>
> Thanks & Regards,
>
> Shreya
>
> On Tue, Jul 4, 2017 at 10:27 PM, Oliver Dzombic 
> wrote:
>
> > Hi,
> >
> > just our of intrest:
> >
> > Why do you want to go away from vmware ?
> >
> > And why do you prefere xen and not kvm ( which is as you already
> > experienced much more tricky compared to kvm ) ?
> >
> >
> > --
> > Mit freundlichen Gruessen / Best regards
> >
> > Oliver Dzombic
> > IP-Interactive
> >
> > mailto:i...@ip-interactive.de
> >
> > Anschrift:
> >
> > IP Interactive UG ( haftungsbeschraenkt ) Zum Sonnenberg 1-3
> > 63571 Gelnhausen
> >
> > HRB 93402 beim Amtsgericht Hanau
> > Geschäftsführung: Oliver Dzombic
> >
> > Steuer Nr.: 35 236 3622 1
> > UST ID: DE274086107
> >
> >
> > Am 04.07.2017 um 13:22 schrieb Shreya Nair:
> > > Hello,
> > >
> > > My team is working on a Vmware to Cloudstack migration task. The
> > CloudStack
> > > environment is set up on the Xenserver hypervisor.
> > >
> > > We are able to export a VM on vsphere to OVF template which also
> > > provides the OVF, VMDK disk image(s) and MF file for the particular VM.
> > > In order to create a CloudStack Template from these files, it can be
> > > done by 2 methods, namely, template creation from VHD(as the
> > > underlying hypervisor is XenServer) or template creation from ISO.
> > >
> > > VHD Template creation:
> > >  - The VMDK file (Obtained after export OVF operation of the VM) is
> > > converted to VHD format with VBoxManage.exe tool that is available
> > > with VirtualBox.
> > >  -  The VHD file can be used to create a CloudStack template and
> > > instantiate a VM.
> > >
> > >
> > > ISO Template creation:
> > >  - The OVF file (Obtained after export OVF operation of the VM) is
> > imported
> > > to Citrix XenCenter.
> > >  - XenCenter runs Operating system Fixup on the imported OVF file
> > > and creates a modified ISO file.
> > >  - The modified ISO file can be used for creating a template and
> > > instantiate a VM
> > >
> > > However, the newly created VM has booting issues as it requires "You
> > might
> > > have to change the root from /dev/hd[a-d] to /dev/xvd[a-d]"
> > > Is there an alternate way or support to migrate a vSphere VM to
> > CloudStack?
> > > Or a method to change the partitioning on the hard disk from sd[a-d]
> > > to xvd[a-d]
> > >
> > >
> > >
> > > Thanks & Regards,
> > >
> > > Shreya
> > >
> >
>

RE: DISCUSS : Vmware to Cloudstack migration support

[Paul Angus]

Maybe you should try qemu-img instead.


Kind regards,

Paul Angus


paul.an...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

From: Shreya Nair [mailto:shreya.n...@opcito.com]
Sent: 07 July 2017 11:30
To: us...@cloudstack.apache.org; dev@cloudstack.apache.org
Cc: Vinay Patil ; Siddheshwar More 

Subject: Re: DISCUSS : Vmware to Cloudstack migration support

Hi Paul,
We explored the XenConvert solution. The XenConvert utility has been retired 
from XenServer 6.2 and upward. So the only solution would be using an old copy 
or trial version of Xen Conversion Manager.

Instead of the qemu-img utility, we used the VirtualBox VBoxManage.exe to 
support conversion of *.VMDK file to VHD. This VHD file was used to create a CS 
template and create an instance. However, the VM was unable to mount the drives 
as it was unable to find xvdXX partitions


I get the following error on CS instance on boot:
[Inline image 2]

and the logs shows us this:

You might have to change the root from /dev/hd[a-d] to /dev/xvd[a-d]



However, on using lsblk command on the source vmware instance, we realized that 
the partitions on SCSI storage devices (Used by vmware) are named as  /dev/sdXX 
while Xen supports /dev/xvdXX.
[Inline image 1]

Note: VMware tools has been removed from VM prior to migration



Thanks & Regards,

Shreya

On Thu, Jul 6, 2017 at 12:17 AM, Paul Angus 
mailto:paul.an...@shapeblue.com>> wrote:
There used to be a XenConvert utility that you do that conversion for you.  I'm 
not sure that its about anymore, but a bit of googling might dig up a copy.

Alternatively there are linux and Windows versions of qemu-img convert , which 
usually does a pretty good job of disk image conversions

Otherwise you could use a P2V backup/recovery tool with an agent that runs 
inside your VMs



Kind regards,

Paul Angus

paul.an...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue




-Original Message-
From: Shreya Nair [mailto:shreya.n...@opcito.com]
Sent: 05 July 2017 09:22
To: us...@cloudstack.apache.org
Subject: Re: DISCUSS : Vmware to Cloudstack migration support

Hi Oliver,

We are trying to migrate the vSphere environment to cloudstack (based on
XenServer) due to some internal product dependency which can be addressed by 
the CloudStack environment.


Thanks & Regards,

Shreya

On Tue, Jul 4, 2017 at 10:27 PM, Oliver Dzombic 
mailto:i...@ip-interactive.de>>
wrote:

> Hi,
>
> just our of intrest:
>
> Why do you want to go away from vmware ?
>
> And why do you prefere xen and not kvm ( which is as you already
> experienced much more tricky compared to kvm ) ?
>
>
> --
> Mit freundlichen Gruessen / Best regards
>
> Oliver Dzombic
> IP-Interactive
>
> mailto:i...@ip-interactive.de
>
> Anschrift:
>
> IP Interactive UG ( haftungsbeschraenkt ) Zum Sonnenberg 1-3
> 63571 Gelnhausen
>
> HRB 93402 beim Amtsgericht Hanau
> Geschäftsführung: Oliver Dzombic
>
> Steuer Nr.: 35 236 3622 1
> UST ID: DE274086107
>
>
> Am 04.07.2017 um 13:22 schrieb Shreya Nair:
> > Hello,
> >
> > My team is working on a Vmware to Cloudstack migration task. The
> CloudStack
> > environment is set up on the Xenserver hypervisor.
> >
> > We are able to export a VM on vsphere to OVF template which also
> > provides the OVF, VMDK disk image(s) and MF file for the particular VM.
> > In order to create a CloudStack Template from these files, it can be
> > done by 2 methods, namely, template creation from VHD(as the
> > underlying hypervisor is XenServer) or template creation from ISO.
> >
> > VHD Template creation:
> >  - The VMDK file (Obtained after export OVF operation of the VM) is
> > converted to VHD format with VBoxManage.exe tool that is available
> > with VirtualBox.
> >  -  The VHD file can be used to create a CloudStack template and
> > instantiate a VM.
> >
> >
> > ISO Template creation:
> >  - The OVF file (Obtained after export OVF operation of the VM) is
> imported
> > to Citrix XenCenter.
> >  - XenCenter runs Operating system Fixup on the imported OVF file
> > and creates a modified ISO file.
> >  - The modified ISO file can be used for creating a template and
> > instantiate a VM
> >
> > However, the newly created VM has booting issues as it requires "You
> might
> > have to change the root from /dev/hd[a-d] to /dev/xvd[a-d]"
> > Is there an alternate way or support to migrate a vSphere VM to
> CloudStack?
> > Or a method to change the partitioning on the hard disk from sd[a-d]
> > to xvd[a-d]
> >
> >
> >
> > Thanks & Regards,
> >
> > Shreya
> >
>

[DISCUSS] Extending Marvin Smoketest Suite

[Boris Stoyanov]

Hi all,

I’ve started up this improvement, which is to extend Marvin smoketests with 
some more tests. I’ve indicated a few tests from the component tests that I 
think would be really good to have into smoketests, like for example Usage 
tests ( we don’t have any currently).
https://issues.apache.org/jira/browse/CLOUDSTACK-9989


Here’s a list of items that I think are suitable candidates:
test_accounts.py - There are no tests for accounts/users in the current suite
test_host_maintenance.py - We have received reports for multiple failures 
around moving VMs away from a Host set for Maintenance.
test_regions.py - there are no tests for this in the current suite
test_usage.py - No tests and this is quite vital to public and private cloud 
providers, CloudStack users rely on this usage metrics and we should be testing 
this on a daily basis.

In the JIRA ticket I’ve added up more details against each group of tests since 
there are some with problems at this stage.

Can you guys please review and add more areas that you would like to be smoke 
tested as part of each PR in the community repo?

Thanks
Boris Stoyanov

boris.stoya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: [DISCUSS] Extending Marvin Smoketest Suite

[Will Stevens]

I would like to see better testing of 'projects' as well, it is almost
entirely untested.

*Will Stevens*
CTO



On Fri, Jul 7, 2017 at 7:05 AM, Boris Stoyanov  wrote:

> Hi all,
>
> I’ve started up this improvement, which is to extend Marvin smoketests
> with some more tests. I’ve indicated a few tests from the component tests
> that I think would be really good to have into smoketests, like for example
> Usage tests ( we don’t have any currently).
> https://issues.apache.org/jira/browse/CLOUDSTACK-9989
>
>
> Here’s a list of items that I think are suitable candidates:
> test_accounts.py - There are no tests for accounts/users in the current
> suite
> test_host_maintenance.py - We have received reports for multiple failures
> around moving VMs away from a Host set for Maintenance.
> test_regions.py - there are no tests for this in the current suite
> test_usage.py - No tests and this is quite vital to public and private
> cloud providers, CloudStack users rely on this usage metrics and we should
> be testing this on a daily basis.
>
> In the JIRA ticket I’ve added up more details against each group of tests
> since there are some with problems at this stage.
>
> Can you guys please review and add more areas that you would like to be
> smoke tested as part of each PR in the community repo?
>
> Thanks
> Boris Stoyanov
>
> boris.stoya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>

ACS Release Note Generation

[Will Stevens]

Hey All,
I just sent Rajani a more detailed email including the actual output, but I
figured I might as well send out a more general email to let everyone know
about this work.

https://github.com/swill/generate_acs_rn

When I was the 4.9 RM, I added the ability to output the API changes in a
JSON format [1] in addition to the existing TXT format.  I did this so I
could use this output to script the formatting of the respective release
notes.

Today I finally got around to releasing the code I had written to produce
the 'API Changes' [2] and 'Fixed Issues' [3] sections of the release notes,
so I figured I would let people know about it.

Please feel free to offer suggestions or open Pull Requests if you would
like changes.

Cheers,

Will

[1] https://github.com/apache/cloudstack/pull/1658
[2]
http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.9.0/api-changes.html
[3]
http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.9.0/fixed_issues.html

Developer Guide - Current Setup Guide?

[Alex Hitchins]

Hello all,

 

I note this was last amended 2013, is there a better/more recent resource
for the aspiring CloudStack developer?

 

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Setting+up+CloudStack
+Development+Environment+on+Linux

 

 

 

 

Alexander Hitchins



E: a...@alexhitchins.com

W: alexhitchins.com

M: 07788 423 969

T: 01892 523 587

 

Re: Developer Guide - Current Setup Guide?

[Daan Hoogland]

Why do you ask, Alex? Is something not working?

Biligual auto correct use.  Read at your own risico

On 7 Jul 2017 9:54 pm, "Alex Hitchins"  wrote:

> Hello all,
>
>
>
> I note this was last amended 2013, is there a better/more recent resource
> for the aspiring CloudStack developer?
>
>
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/
> Setting+up+CloudStack
> +Development+Environment+on+Linux
>
>
>
>
>
>
>
>
>
> Alexander Hitchins
>
> 
>
> E: a...@alexhitchins.com
>
> W: alexhitchins.com
>
> M: 07788 423 969
>
> T: 01892 523 587
>
>
>
>