Re: [VOTE] Apache CloudStack 4.5.1-rc1

2015-03-20 Thread Rohit Yadav

(+ users)

Hi all,

I've built signed centos63/centos7/debian repository out of this RC for
your convenience: http://packages.shapeblue.com/cloudstack/testing/

4.5 systemvm templates: http://packages.shapeblue.com/systemvmtemplate/4.5/

(If you're on 4.5.0. There is no need to upgrade your SystemVM templates).

Happy testing!

On Friday 20 March 2015 02:06 AM, David Nalley wrote:

I did indeed - it's 4.5.1 RC - my apologies for not checking the
template closely enough to eliminate all of the fill in the blank
spots.

On Thu, Mar 19, 2015 at 11:01 AM, Geoff Higginbottom
 wrote:

Hi David,

You appear to have left x.x.x.x in the e-mail, I think you meant to put
4.5.1 here instead.

Regards

Geoff Higginbottom
CTO / Cloud Architect

D: +44 20 3603 0542  | S: +44 20 3603 0540
 | M: +447968161581 

geoff.higginbot...@shapeblue.com | www.shapeblue.com
 | Twitter:@cloudstackguru


ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS





On 19/03/2015 15:40, "David Nalley"  wrote:


Hi All,

I've created a X.X.X release, with the following artifacts up for a vote:

Git Branch and Commit SH:
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs
/heads/4.5-RC20150319T1429
Commit: 3c06466e208769f32c03767abc6bd2680fd8

Source release (checksums and signatures are available at the same
location):
https://dist.apache.org/repos/dist/dev/cloudstack/4.5.1-rc1/

PGP release keys (signed using 0x6fe50f1c):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

Vote will be open for 72 hours.

For sanity in tallying the vote, can PMC members please be sure to
indicate "(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)


Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended solely 
for the use of the individual to whom it is addressed. Any views or opinions 
expressed are solely those of the author and do not necessarily represent those of 
Shape Blue Ltd or related companies. If you are not the intended recipient of this 
email, you must neither take any action based upon its contents, nor copy or show 
it to anyone. Please contact the sender if you believe you have received this email 
in error. Shape Blue Ltd is a company incorporated in England & Wales. 
ShapeBlue Services India LLP is a company incorporated in India and is operated 
under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company 
incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue 
SA Pty Ltd is a company registered by The Republic of South Africa and is traded 
under license from Shape Blue Ltd. ShapeBlue is a registered trademark.


--
Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 8826230892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab
PS. If you see any footer below, I did not add it :)
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended solely 
for the use of the individual to whom it is addressed. Any views or opinions 
expressed are solely those of the author and do not necessarily represent those of 
Shape Blue Ltd or related companies. If you are not the intended recipient of this 
email, you must neither take any action based upon its contents, nor copy or show 
it to anyone. Please contact the sender if you believe you have received this email 
in error. Shape Blue Ltd is a company incorporated in England & Wales. 
ShapeBlue Services India LLP is a company incorporated in India and is operated 
under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company 
incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue 
SA Pty Ltd is a company registered by The Republic of South Africa and is traded 
under license from Shape Blue Ltd. ShapeBlue is a registe

Re: [DOCKER] cloudstack organisation

2015-03-20 Thread Sebastien Goasguen

> On Mar 20, 2015, at 2:43 AM, Pierre-Luc Dion  wrote:
> 
> Look like some work as been done to have a Dockerfile in our repo which
> build a CloudStack container easily. I'm curious to know if one of us own
> the cloudstack organisation and if so, if it would make sense to start to
> have our own automated build of container for CloudStack. I would easily
> see 2 build job for two containers:  cloudstack-management and
> cloudstack-simulator.
> we could easily build a nightly build of master and offer latest GA
> releases.
> 
> Look like it would be easy to automate builds and the simulator container
> could be use for the CI as it is for the fast-simulator jenkins tasks.
> 
> 
> any thought?

+1, I committed the Dockerfile.

But yes we should have a cloudstack organization in docker hub and setup 
automated builds.

Ideally we can also setup a drone.io instance to do some continuous 
deployment…but this ties with the overalll jenkins/testing infra that we really 
need to get cleaned up and organized.

-sebastuen



RE: [ANNOUNCE] New committer: Karen Vuong

2015-03-20 Thread Paul Angus
Congratulations Karen!

Regards,

Paul Angus
Cloud Architect
D: +44 20 3468 5163 |S: +44 20 3603 0540 | M: +44 7711 418 784 | T: @CloudyAngus
paul.an...@shapeblue.com

-Original Message-
From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com]
Sent: 20 March 2015 06:28
To: us...@cloudstack.apache.org
Cc: dev@cloudstack.apache.org
Subject: Re: [ANNOUNCE] New committer: Karen Vuong

Congratulations Karen, I appreciate your commitment to the project and its 
community!

> On 20-Mar-2015, at 10:10 am, Mike Tutkowski  
> wrote:
>
> Congratulations, Karen!
>
> On Thu, Mar 19, 2015 at 4:07 PM, Pierre-Luc Dion  wrote:
>
>> The Project Management Committee (PMC) for Apache CloudStack has
>> asked Karen Vuong to become a committer and we are pleased to
>> announce that she have accepted.
>>
>> Karen is doing a huge effort on promoting CloudStack and organizing
>> events such as CloudStack days, CloudStack collaboration conferences
>> and meetups. She is helping a lot on the marketing effort as well.
>>
>> Being a committer allows many contributors to contribute more
>> autonomously. For developers, it makes it easier to submit changes
>> and eliminates the need to have contributions reviewed via the patch
>> submission process. Whether contributions are development-related or
>> otherwise, it is a recognition of a contributor's participation in
>> the project and commitment to the project and the Apache Way.
>>
>> Please join me in congratulating Karen (karenv)
>>
>> --Pierre-Luc
>> on behalf of the CloudStack PMC
>>
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the cloud
> *™*

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 88 262 30892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.


Re: [ANNOUNCE] New committer: Karen Vuong

2015-03-20 Thread Daan Hoogland
thanks for everything Karen,

On Fri, Mar 20, 2015 at 9:20 AM, Paul Angus  wrote:
> Congratulations Karen!
>
> Regards,
>
> Paul Angus
> Cloud Architect
> D: +44 20 3468 5163 |S: +44 20 3603 0540 | M: +44 7711 418 784 | T: 
> @CloudyAngus
> paul.an...@shapeblue.com
>
> -Original Message-
> From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com]
> Sent: 20 March 2015 06:28
> To: us...@cloudstack.apache.org
> Cc: dev@cloudstack.apache.org
> Subject: Re: [ANNOUNCE] New committer: Karen Vuong
>
> Congratulations Karen, I appreciate your commitment to the project and its 
> community!
>
>> On 20-Mar-2015, at 10:10 am, Mike Tutkowski  
>> wrote:
>>
>> Congratulations, Karen!
>>
>> On Thu, Mar 19, 2015 at 4:07 PM, Pierre-Luc Dion  wrote:
>>
>>> The Project Management Committee (PMC) for Apache CloudStack has
>>> asked Karen Vuong to become a committer and we are pleased to
>>> announce that she have accepted.
>>>
>>> Karen is doing a huge effort on promoting CloudStack and organizing
>>> events such as CloudStack days, CloudStack collaboration conferences
>>> and meetups. She is helping a lot on the marketing effort as well.
>>>
>>> Being a committer allows many contributors to contribute more
>>> autonomously. For developers, it makes it easier to submit changes
>>> and eliminates the need to have contributions reviewed via the patch
>>> submission process. Whether contributions are development-related or
>>> otherwise, it is a recognition of a contributor's participation in
>>> the project and commitment to the project and the Apache Way.
>>>
>>> Please join me in congratulating Karen (karenv)
>>>
>>> --Pierre-Luc
>>> on behalf of the CloudStack PMC
>>>
>>
>>
>>
>> --
>> *Mike Tutkowski*
>> *Senior CloudStack Developer, SolidFire Inc.*
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the cloud
>> *™*
>
> Regards,
> Rohit Yadav
> Software Architect, ShapeBlue
> M. +91 88 262 30892 | rohit.ya...@shapeblue.com
> Blog: bhaisaab.org | Twitter: @_bhaisaab
>
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build
> CSForge – rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Software 
> Engineering
> CloudStack Infrastructure 
> Support
> CloudStack Bootcamp Training 
> Courses
>
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
> registered by The Republic of South Africa and is traded under license from 
> Shape Blue Ltd. ShapeBlue is a registered trademark.
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build
> CSForge – rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Software 
> Engineering
> CloudStack Infrastructure 
> Support
> CloudStack Bootcamp Training 
> Courses
>
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorp

[PROPOSAL] DHCP/DNS offload and config drive support for adv zone shared network

2015-03-20 Thread Jayapal Reddy Uradi

In advanced zone shared network if someone wants to use DHCP server outside the 
cloudstack, currently it can be done by not selecting the DHCP service
But the problem here is that the VM actual ip is different from what cloudstack 
showing.

If there are no services selected for the network offering there is no need of 
the VR.
In the absense of VR there should be way to provide password, 
userdata/metadata, ssh keys to user vm.

With this feature we can do the following.
1. Create network without VR.
2. Retrive the IP from the VM and update it in the cloudstack DB.
3. Add config drive support for the VMs in this network.

Please provide your comments for the below FS.

ACS ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-8324
FS: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53740797


Thanks,
Jayapal

Re: [PROPOSAL] DHCP/DNS offload and config drive support for adv zone shared network

2015-03-20 Thread Nux!
+1, good idea

One thing though:  let's make the config drive available for all types of 
zones, many people use the basic or adsg zones.

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -
> From: "Jayapal Reddy Uradi" 
> To: dev@cloudstack.apache.org
> Sent: Friday, 20 March, 2015 09:12:19
> Subject: [PROPOSAL]  DHCP/DNS offload and config drive support for adv zone 
> shared network

> In advanced zone shared network if someone wants to use DHCP server outside 
> the
> cloudstack, currently it can be done by not selecting the DHCP service
> But the problem here is that the VM actual ip is different from what 
> cloudstack
> showing.
> 
> If there are no services selected for the network offering there is no need of
> the VR.
> In the absense of VR there should be way to provide password, 
> userdata/metadata,
> ssh keys to user vm.
> 
> With this feature we can do the following.
> 1. Create network without VR.
> 2. Retrive the IP from the VM and update it in the cloudstack DB.
> 3. Add config drive support for the VMs in this network.
> 
> Please provide your comments for the below FS.
> 
> ACS ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-8324
> FS: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53740797
> 
> 
> Thanks,
> Jayapal


Need a Jenkins account

2015-03-20 Thread Gaurav Aradhye
Hello all,

I need a Jenkins account, to examine current jobs and also to create a new
job that will statically analyze the test cases added to repository and
generate a report with any issues found with the script. It will use static
code analyzers for python and we can expect a report generated for every
commit which modifies tests folder.

Can somebody please create an account for me and give me required access?

Regards,
Gaurav


Re: Need a Jenkins account

2015-03-20 Thread Srikanteswararao Talluri
Done. Details sent to your email.


~Talluri

On 20/03/15 3:03 pm, "Gaurav Aradhye"  wrote:

>Hello all,
>
>I need a Jenkins account, to examine current jobs and also to create a new
>job that will statically analyze the test cases added to repository and
>generate a report with any issues found with the script. It will use
>static
>code analyzers for python and we can expect a report generated for every
>commit which modifies tests folder.
>
>Can somebody please create an account for me and give me required access?
>
>Regards,
>Gaurav



Re: Need a Jenkins account

2015-03-20 Thread Gaurav Aradhye
Thanks Talluri!

Regards,
Gaurav

On Fri, Mar 20, 2015 at 3:10 PM, Srikanteswararao Talluri <
srikanteswararao.tall...@citrix.com> wrote:

> Done. Details sent to your email.
>
>
> ~Talluri
>
> On 20/03/15 3:03 pm, "Gaurav Aradhye"  wrote:
>
> >Hello all,
> >
> >I need a Jenkins account, to examine current jobs and also to create a new
> >job that will statically analyze the test cases added to repository and
> >generate a report with any issues found with the script. It will use
> >static
> >code analyzers for python and we can expect a report generated for every
> >commit which modifies tests folder.
> >
> >Can somebody please create an account for me and give me required access?
> >
> >Regards,
> >Gaurav
>
>


Re: [ANNOUNCE] New committer: Karen Vuong

2015-03-20 Thread Srikanteswararao Talluri
Congts Karen!

~Talluri

On 20/03/15 2:15 pm, "Daan Hoogland"  wrote:

>thanks for everything Karen,
>
>On Fri, Mar 20, 2015 at 9:20 AM, Paul Angus 
>wrote:
>> Congratulations Karen!
>>
>> Regards,
>>
>> Paul Angus
>> Cloud Architect
>> D: +44 20 3468 5163 |S: +44 20 3603 0540 | M: +44 7711 418 784 | T:
>>@CloudyAngus
>> paul.an...@shapeblue.com
>>
>> -Original Message-
>> From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com]
>> Sent: 20 March 2015 06:28
>> To: us...@cloudstack.apache.org
>> Cc: dev@cloudstack.apache.org
>> Subject: Re: [ANNOUNCE] New committer: Karen Vuong
>>
>> Congratulations Karen, I appreciate your commitment to the project and
>>its community!
>>
>>> On 20-Mar-2015, at 10:10 am, Mike Tutkowski
>>> wrote:
>>>
>>> Congratulations, Karen!
>>>
>>> On Thu, Mar 19, 2015 at 4:07 PM, Pierre-Luc Dion 
>>>wrote:
>>>
 The Project Management Committee (PMC) for Apache CloudStack has
 asked Karen Vuong to become a committer and we are pleased to
 announce that she have accepted.

 Karen is doing a huge effort on promoting CloudStack and organizing
 events such as CloudStack days, CloudStack collaboration conferences
 and meetups. She is helping a lot on the marketing effort as well.

 Being a committer allows many contributors to contribute more
 autonomously. For developers, it makes it easier to submit changes
 and eliminates the need to have contributions reviewed via the patch
 submission process. Whether contributions are development-related or
 otherwise, it is a recognition of a contributor's participation in
 the project and commitment to the project and the Apache Way.

 Please join me in congratulating Karen (karenv)

 --Pierre-Luc
 on behalf of the CloudStack PMC

>>>
>>>
>>>
>>> --
>>> *Mike Tutkowski*
>>> *Senior CloudStack Developer, SolidFire Inc.*
>>> e: mike.tutkow...@solidfire.com
>>> o: 303.746.7302
>>> Advancing the way the world uses the cloud
>>> **
>>
>> Regards,
>> Rohit Yadav
>> Software Architect, ShapeBlue
>> M. +91 88 262 30892 | rohit.ya...@shapeblue.com
>> Blog: bhaisaab.org | Twitter: @_bhaisaab
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>>services
>>
>> IaaS Cloud Design &
>>Build
>> CSForge ­ rapid IaaS deployment framework
>> CloudStack Consulting
>> CloudStack Software
>>Engineering
>> CloudStack Infrastructure
>>Support
>> CloudStack Bootcamp Training
>>Courses
>>
>> This email and any attachments to it may be confidential and are
>>intended solely for the use of the individual to whom it is addressed.
>>Any views or opinions expressed are solely those of the author and do
>>not necessarily represent those of Shape Blue Ltd or related companies.
>>If you are not the intended recipient of this email, you must neither
>>take any action based upon its contents, nor copy or show it to anyone.
>>Please contact the sender if you believe you have received this email in
>>error. Shape Blue Ltd is a company incorporated in England & Wales.
>>ShapeBlue Services India LLP is a company incorporated in India and is
>>operated under license from Shape Blue Ltd. Shape Blue Brasil
>>Consultoria Ltda is a company incorporated in Brasil and is operated
>>under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company
>>registered by The Republic of South Africa and is traded under license
>>from Shape Blue Ltd. ShapeBlue is a registered trademark.
>> Find out more about ShapeBlue and our range of CloudStack related
>>services
>>
>> IaaS Cloud Design &
>>Build
>> CSForge ­ rapid IaaS deployment framework
>> CloudStack Consulting
>> CloudStack Software
>>Engineering
>> CloudStack Infrastructure
>>Support
>> CloudStack Bootcamp Training
>>Courses
>>
>> This email and any attachments to it may be confidential and are
>>intended solely for the use of the individual to whom it is addressed.
>>Any views or opinions expressed are solely those of the author and do
>>not necessarily represent those of Shape Blue Ltd or related companies.
>>If you are not the intended recipient of this email, you must neither
>>take any action based upon its contents, nor copy or show it to anyone.
>>Please contact the sender if you believe you have received this email in
>>error. Shape Blue Ltd is a company incorporated in England & Wales.
>>ShapeBlue Services India LLP i

[DISCUSS] Automating SystemVM template creation for VMWare

2015-03-20 Thread Rohit Yadav

Hi,

The systemvm template build system does not do all the steps for
producing a valid systemvm template for VMWare, from wiki and past
discussions I know that some extra steps are needed but I'm not sure.

This wikis notes some of those steps:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Creating+System+VM+template+for+Vmware+from+generated+Vbox+template

Can anyone confirm this issue? And, update the wiki if more steps are
needed?

Also can we automate those additional steps using Jenkins? Or perhaps
semi-automate the creation process by writing scripts that do these
extra steps for us?

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 8826230892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab
PS. If you see any footer below, I did not add it :)
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended solely 
for the use of the individual to whom it is addressed. Any views or opinions 
expressed are solely those of the author and do not necessarily represent those of 
Shape Blue Ltd or related companies. If you are not the intended recipient of this 
email, you must neither take any action based upon its contents, nor copy or show 
it to anyone. Please contact the sender if you believe you have received this email 
in error. Shape Blue Ltd is a company incorporated in England & Wales. 
ShapeBlue Services India LLP is a company incorporated in India and is operated 
under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company 
incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue 
SA Pty Ltd is a company registered by The Republic of South Africa and is traded 
under license from Shape Blue Ltd. ShapeBlue is a registered trademark.


Build failed in Jenkins: simulator-4.5-singlerun #182

2015-03-20 Thread jenkins
See 

Changes:

[Rohit Yadav] appliance: after building systemvm template save the md5 checksums

--
[...truncated 8874 lines...]
> Running query: create database `cloudbridge`
> Running query: GRANT ALL ON cloudbridge.* to 'cloud'@`localhost` 
identified by 'cloud'
> Running query: GRANT ALL ON cloudbridge.* to 'cloud'@`%` 
identified by 'cloud'
> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ 
cloud-developer ---
[INFO] Installing 

 to 
/var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.1-SNAPSHOT/cloud-developer-4.5.1-SNAPSHOT.pom
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 1:52.882s
[INFO] Finished at: Fri Mar 20 06:19:34 EDT 2015
[INFO] Final Memory: 43M/221M
[INFO] 
[WARNING] The requested profile "simulator" could not be activated because it 
does not exist.
[simulator-4.5-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator
[INFO] Scanning for projects...
[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Developer Mode 4.5.1-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties 
(default) @ cloud-developer ---
[WARNING] Ignoring missing properties file: 

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (default) @ cloud-developer ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] >>> exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer >>>
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] <<< exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer <<<
[INFO] 
[INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer ---
log4j:WARN No appenders could be found for logger 
(org.springframework.core.env.StandardEnvironment).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more 
info.
> WARNING: Provided file does not exist: 


[GitHub] cloudstack pull request: CLOUDSTACK-8330: Tagging test cases which...

2015-03-20 Thread srikanteswartalluri
Github user srikanteswartalluri commented on the pull request:

https://github.com/apache/cloudstack/pull/121#issuecomment-83984324
  
Looks good.
As this change is only related to tagging the tests, i am not waiting for 
the CI build result to merge


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Build failed in Jenkins: simulator-singlerun #1037

2015-03-20 Thread jenkins
See 

Changes:

[Rohit Yadav] appliance: save md5 checksums after building systemvm templates

--
[...truncated 10388 lines...]
> Running query: create database `cloud_usage`
> Running query: GRANT ALL ON cloud_usage.* to 'cloud'@`localhost` 
identified by 'cloud'
> Running query: GRANT ALL ON cloud_usage.* to 'cloud'@`%` 
identified by 'cloud'
> Initializing database=cloudbridge with host=localhost port=3306 
username=cloud password=cloud
> Running query: drop database if exists `cloudbridge`
> Running query: create database `cloudbridge`
> Running query: GRANT ALL ON cloudbridge.* to 'cloud'@`localhost` 
identified by 'cloud'
> Running query: GRANT ALL ON cloudbridge.* to 'cloud'@`%` 
identified by 'cloud'
> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ 
cloud-developer ---
[INFO] Installing 
 
to 
/var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.6.0-SNAPSHOT/cloud-developer-4.6.0-SNAPSHOT.pom
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 2:02.560s
[INFO] Finished at: Fri Mar 20 06:53:55 EDT 2015
[INFO] Final Memory: 45M/165M
[INFO] 
[WARNING] The requested profile "simulator" could not be activated because it 
does not exist.
[simulator-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator
[INFO] Scanning for projects...
[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Developer Mode 4.6.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties 
(default) @ cloud-developer ---
[WARNING] Ignoring missing properties file: 

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (default) @ cloud-developer ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] >>> exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer >>>
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] <<< exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer <<<
[INFO] 
[INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer ---
l

Build failed in Jenkins: simulator-4.5-singlerun #183

2015-03-20 Thread jenkins
See 

Changes:

[Rohit Yadav] centos63: depend on java 1.7.0+ not java7 for packages

--
[...truncated 8848 lines...]
> Running query: GRANT ALL ON cloud_usage.* to 'cloud'@`localhost` 
identified by 'cloud'
> Running query: GRANT ALL ON cloud_usage.* to 'cloud'@`%` 
identified by 'cloud'
> Initializing database=cloudbridge with host=localhost port=3306 
username=cloud password=cloud
> Running query: drop database if exists `cloudbridge`
> Running query: create database `cloudbridge`
> Running query: GRANT ALL ON cloudbridge.* to 'cloud'@`localhost` 
identified by 'cloud'
> Running query: GRANT ALL ON cloudbridge.* to 'cloud'@`%` 
identified by 'cloud'
> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ 
cloud-developer ---
[INFO] Installing 

 to 
/var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.1-SNAPSHOT/cloud-developer-4.5.1-SNAPSHOT.pom
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 1:58.170s
[INFO] Finished at: Fri Mar 20 07:13:19 EDT 2015
[INFO] Final Memory: 41M/167M
[INFO] 
[WARNING] The requested profile "simulator" could not be activated because it 
does not exist.
[simulator-4.5-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator
[INFO] Scanning for projects...
[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Developer Mode 4.5.1-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties 
(default) @ cloud-developer ---
[WARNING] Ignoring missing properties file: 

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (default) @ cloud-developer ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] >>> exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer >>>
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] <<< exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer <<<
[INFO] 
[INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer ---
log4j:W

[GitHub] cloudstack pull request: CLOUDSTACK-8380: Adding automation test c...

2015-03-20 Thread pritisarap12
Github user pritisarap12 commented on the pull request:

https://github.com/apache/cloudstack/pull/117#issuecomment-83990945
  
Integrated review changes:
Testcase result:

Test Volume (root) Snapshot ... === TestName: test_01_volume_snapshot | 
Status : SUCCESS ===
ok

--
Ran 1 test in 3265.552s

OK


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [VOTE] Apache CloudStack 4.5.1-rc1

2015-03-20 Thread Rohit Yadav

+1 (with one centos6 rpm build fix required, read below)

Advance zone testing with/without local storage, KVM:

- VM lifecycle with and without local storage and vm's volume migrations
(after vm was stopped) across 2 hosts
- Password server, reset password. Stress tested password server, served
1000 req/second with 95.7% successful http request completion (though I
realize ab is not really a good tool)
- Egress rules, Firewall rules, port forwarding SNAT usage, load balancing
- Register template and ISO
- VM statistics, dashboard capacity values
- Observed normal CPVM, SSVM behaviours
- Use of both NFS and local primary storage
- Download volume, iso, template
- VPC: multiple tiers, password server + load tests, vm lifecycle
with/without local storage, SNAT for vms in tiers, ACL rules
create/update/delete/apply etc

Basic Zone testing with/without local storage, KVM:

- Basic zone with local storage, vm lifecycle
- Volume migration (after stopped)
- Attach/detach volumes
- NFS primary+secondary and local storage primary
- Normal CPVM, SSVM behaviour seen
- Register template/iso worked
- Download volume, iso, template
- Shared network with SG worked
- Password server tested, reset password

Minor issues:

- RC1 will require this minor centos6 rpm build fix that we can slip in
https://github.com/apache/cloudstack/commit/d70937aeb92e89efa8fcc39d7f89bdd8c885b2a2
Note: centos7 builds are fine.
- UI logs out on refresh (due to known CSRF fix) or opening in another tab.

On Thursday 19 March 2015 08:10 PM, David Nalley wrote:

Hi All,

I've created a X.X.X release, with the following artifacts up for a vote:

Git Branch and Commit SH:
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.5-RC20150319T1429
Commit: 3c06466e208769f32c03767abc6bd2680fd8

Source release (checksums and signatures are available at the same
location):
https://dist.apache.org/repos/dist/dev/cloudstack/4.5.1-rc1/

PGP release keys (signed using 0x6fe50f1c):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

Vote will be open for 72 hours.

For sanity in tallying the vote, can PMC members please be sure to
indicate "(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)



--
Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 8826230892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab
PS. If you see any footer below, I did not add it :)
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended solely 
for the use of the individual to whom it is addressed. Any views or opinions 
expressed are solely those of the author and do not necessarily represent those of 
Shape Blue Ltd or related companies. If you are not the intended recipient of this 
email, you must neither take any action based upon its contents, nor copy or show 
it to anyone. Please contact the sender if you believe you have received this email 
in error. Shape Blue Ltd is a company incorporated in England & Wales. 
ShapeBlue Services India LLP is a company incorporated in India and is operated 
under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company 
incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue 
SA Pty Ltd is a company registered by The Republic of South Africa and is traded 
under license from Shape Blue Ltd. ShapeBlue is a registered trademark.


[GitHub] cloudstack pull request: CLOUDSTACK-8380: Adding automation test c...

2015-03-20 Thread gauravaradhye
Github user gauravaradhye commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/117#discussion_r26833696
  
--- Diff: tools/marvin/marvin/lib/base.py ---
@@ -1086,7 +1092,7 @@ def create(cls, apiclient, services, volumeid=None,
 @classmethod
 def register(cls, apiclient, services, zoneid=None,
  account=None, domainid=None, hypervisor=None,
- projectid=None, details=None):
--- End diff --

Any reason to remove the existing parameter? Are you sure it won't affect 
any of the existing test cases?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8380: Adding automation test c...

2015-03-20 Thread gauravaradhye
Github user gauravaradhye commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/117#discussion_r26833707
  
--- Diff: tools/marvin/marvin/lib/base.py ---
@@ -1143,9 +1149,6 @@ def register(cls, apiclient, services, zoneid=None,
 elif "projectid" in services:
 cmd.projectid = services["projectid"]
 
-if details:
--- End diff --

Same as above


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8380: Adding automation test c...

2015-03-20 Thread gauravaradhye
Github user gauravaradhye commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/117#discussion_r26833788
  
--- Diff: tools/marvin/marvin/lib/common.py ---
@@ -1395,3 +1396,218 @@ def isNetworkDeleted(apiclient, networkid, 
timeout=600):
 time.sleep(60)
 #end while
 return networkDeleted
+
+
+def createChecksum(testdata, 
+   virtual_machine, 
+   disk, 
+   disk_type):
+
+""" Calculate the MD5 checksum of the disk by writing \
+   data on the disk where disk_type is either root disk or data 
disk 
+   @return: returns the calculated checksum"""
+
+random_data_0 = random_gen(size=100)
+# creating checksum(MD5)
+m = hashlib.md5()
+m.update(random_data_0)
+ckecksum_random_data_0 = m.hexdigest()
+try:
+ssh_client = SshClient(
+virtual_machine.ssh_ip,
+virtual_machine.ssh_port,
+virtual_machine.username,
+virtual_machine.password
+)
+except Exception: 
+raise Exception("SSH access failed for server with IP address: %s" 
%
+virtual_machine.ssh_ip)
+
+# Format partition using ext3
+
+format_volume_to_ext3(
+ssh_client,
+testdata["volume_write_path"][
+virtual_machine.hypervisor][disk_type]
+)
+cmds = ["fdisk -l",
+"mkdir -p %s" % testdata["data_write_paths"]["mount_dir"],
+"mount -t ext3 %s1 %s" % (
+testdata["volume_write_path"][
+virtual_machine.hypervisor][disk_type],
+testdata["data_write_paths"]["mount_dir"]
+),
+"mkdir -p %s/%s/%s " % (
+testdata["data_write_paths"]["mount_dir"],
+testdata["data_write_paths"]["sub_dir"],
+testdata["data_write_paths"]["sub_lvl_dir1"],
+),
+"echo %s > %s/%s/%s/%s" % (
+random_data_0,
+testdata["data_write_paths"]["mount_dir"],
+testdata["data_write_paths"]["sub_dir"],
+testdata["data_write_paths"]["sub_lvl_dir1"],
+testdata["data_write_paths"]["random_data"]
+),
+"cat %s/%s/%s/%s" % (
+testdata["data_write_paths"]["mount_dir"],
+testdata["data_write_paths"]["sub_dir"],
+testdata["data_write_paths"]["sub_lvl_dir1"],
+testdata["data_write_paths"]["random_data"]
+)
+]
+
+for c in cmds:
+ssh_client.execute(c)
+
+# Unmount the storage
+cmds = [
+"umount %s" % (testdata["data_write_paths"]["mount_dir"]),
+]
+
+for c in cmds:
+ssh_client.execute(c)
+
+return ckecksum_random_data_0
+
+
+def compareChecksum(
+apiclient,
+testdata,
+original_checksum,
+disk_type,
+template_id,
+account_name,
+account_domainid,
+service_offering_id,
+zone_id,
+zone_networktype,
+virt_machine=None,
+disk=None,
+new_vm=False,
+):
+"""
+Create md5 checksum of the data present on the disk and compare
+it with the given checksum
+"""
+
+if disk_type == "datadiskdevice_1" and new_vm:
+new_virtual_machine = VirtualMachine.create(
+apiclient,
+testdata["small"],
+templateid=template_id,
+accountid=account_name,
+domainid=account_domainid,
+serviceofferingid=service_offering_id,
+zoneid=zone_id,
+mode=zone_networktype
+)
+
+new_virtual_machine.start(apiclient)
+
+
+new_virtual_machine.attach_volume(
+apiclient,
+disk
+)
+
+# Rebooting is required so that newly attached disks are detected
+new_virtual_machine.reboot(apiclient)
+
+else:
+# If the disk is root disk then no need to create new VM
+# Just start the original machine on which root disk is
+new_virtual_machine = virt_machine
+if new_virtual_machine.state != "Running":
+new_virtual_machine.start(apiclient)
+
+try:
+# Login to VM to verify test directories and files
+
+ssh = SshClient(
+new_virtual_machine.ssh_ip,
+new_virtual_machine.ssh_port,
+   

[GitHub] cloudstack pull request: CLOUDSTACK-8380: Adding automation test c...

2015-03-20 Thread gauravaradhye
Github user gauravaradhye commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/117#discussion_r26833819
  
--- Diff: tools/marvin/marvin/lib/common.py ---
@@ -1395,3 +1396,218 @@ def isNetworkDeleted(apiclient, networkid, 
timeout=600):
 time.sleep(60)
 #end while
 return networkDeleted
+
+
+def createChecksum(testdata, 
+   virtual_machine, 
+   disk, 
+   disk_type):
+
+""" Calculate the MD5 checksum of the disk by writing \
+   data on the disk where disk_type is either root disk or data 
disk 
+   @return: returns the calculated checksum"""
+
+random_data_0 = random_gen(size=100)
+# creating checksum(MD5)
+m = hashlib.md5()
+m.update(random_data_0)
+ckecksum_random_data_0 = m.hexdigest()
+try:
+ssh_client = SshClient(
+virtual_machine.ssh_ip,
+virtual_machine.ssh_port,
+virtual_machine.username,
+virtual_machine.password
+)
+except Exception: 
+raise Exception("SSH access failed for server with IP address: %s" 
%
+virtual_machine.ssh_ip)
+
+# Format partition using ext3
+
+format_volume_to_ext3(
+ssh_client,
+testdata["volume_write_path"][
+virtual_machine.hypervisor][disk_type]
+)
+cmds = ["fdisk -l",
+"mkdir -p %s" % testdata["data_write_paths"]["mount_dir"],
+"mount -t ext3 %s1 %s" % (
+testdata["volume_write_path"][
+virtual_machine.hypervisor][disk_type],
+testdata["data_write_paths"]["mount_dir"]
+),
+"mkdir -p %s/%s/%s " % (
+testdata["data_write_paths"]["mount_dir"],
+testdata["data_write_paths"]["sub_dir"],
+testdata["data_write_paths"]["sub_lvl_dir1"],
+),
+"echo %s > %s/%s/%s/%s" % (
+random_data_0,
+testdata["data_write_paths"]["mount_dir"],
+testdata["data_write_paths"]["sub_dir"],
+testdata["data_write_paths"]["sub_lvl_dir1"],
+testdata["data_write_paths"]["random_data"]
+),
+"cat %s/%s/%s/%s" % (
+testdata["data_write_paths"]["mount_dir"],
+testdata["data_write_paths"]["sub_dir"],
+testdata["data_write_paths"]["sub_lvl_dir1"],
+testdata["data_write_paths"]["random_data"]
+)
+]
+
+for c in cmds:
+ssh_client.execute(c)
+
+# Unmount the storage
+cmds = [
+"umount %s" % (testdata["data_write_paths"]["mount_dir"]),
+]
+
+for c in cmds:
+ssh_client.execute(c)
+
+return ckecksum_random_data_0
+
+
+def compareChecksum(
+apiclient,
+testdata,
+original_checksum,
+disk_type,
+template_id,
+account_name,
+account_domainid,
+service_offering_id,
+zone_id,
+zone_networktype,
+virt_machine=None,
+disk=None,
+new_vm=False,
+):
+"""
+Create md5 checksum of the data present on the disk and compare
+it with the given checksum
+"""
+
+if disk_type == "datadiskdevice_1" and new_vm:
+new_virtual_machine = VirtualMachine.create(
--- End diff --

Can we create the VM outside the function and pass it as parameter? 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8330: Tagging test cases which...

2015-03-20 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack/pull/121


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8336: Adding tests for shared ...

2015-03-20 Thread srikanteswartalluri
Github user srikanteswartalluri commented on the pull request:

https://github.com/apache/cloudstack/pull/120#issuecomment-83993591
  
Looks good to me.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8336: Adding tests for shared ...

2015-03-20 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack/pull/120


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Build failed in Jenkins: simulator-singlerun #1038

2015-03-20 Thread jenkins
See 

Changes:

[Gaurav Aradhye] CLOUDSTACK-8330: Tagging test cases which should be run with 
vmware dvs configuration

[talluri] Revert "Merge branch '8330' of 
https://github.com/gauravaradhye/cloudstack";

[talluri] CLOUDSTACK-8330: Tagging test cases which should be run with vmware 
dvs configuration

[Rohit Yadav] CLOUDSTACK-8312: Fix NPE regression, copy template can have NULL 
volume size

--
[...truncated 10365 lines...]
> Running query: GRANT ALL ON cloud.* to 'cloud'@`localhost` 
identified by 'cloud'
> Running query: GRANT ALL ON cloud.* to 'cloud'@`%` identified by 
'cloud'
> Initializing database=cloud_usage with host=localhost port=3306 
username=cloud password=cloud
> Running query: drop database if exists `cloud_usage`
> Running query: create database `cloud_usage`
> Running query: GRANT ALL ON cloud_usage.* to 'cloud'@`localhost` 
identified by 'cloud'
> Running query: GRANT ALL ON cloud_usage.* to 'cloud'@`%` 
identified by 'cloud'
> Initializing database=cloudbridge with host=localhost port=3306 
username=cloud password=cloud
> Running query: drop database if exists `cloudbridge`
> Running query: create database `cloudbridge`
> Running query: GRANT ALL ON cloudbridge.* to 'cloud'@`localhost` 
identified by 'cloud'
> Running query: GRANT ALL ON cloudbridge.* to 'cloud'@`%` 
identified by 'cloud'
> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ 
cloud-developer ---
[INFO] Installing 
 
to 
/var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.6.0-SNAPSHOT/cloud-developer-4.6.0-SNAPSHOT.pom
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 1:50.269s
[INFO] Finished at: Fri Mar 20 08:19:18 EDT 2015
[INFO] Final Memory: 45M/181M
[INFO] 
[WARNING] The requested profile "simulator" could not be activated because it 
does not exist.
[simulator-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator
[INFO] Scanning for projects...
[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Developer Mode 4.6.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties 
(default) @ cloud-developer ---
[WARNING] Ignoring missing properties file: 


RE: [PROPOSAL] DHCP/DNS offload and config drive support for adv zone shared network

2015-03-20 Thread Adrian Lewis
Can't see the wiki at the moment as it's down for maintenance but on a
slightly different but related note, would it be feasible to use DHCP relay
functionality in dnsmasq on a VR and still get the IP address assigned by an
external DHCP server registered into the ACS MS? Not quite sure if under
normal circumstances ACS picks up the IP from dnsmasq or if ACS manages the
pool and sends dnsmasq static leases. If it's picking up what dnsmasq
decides to lease out, what is this mechanism and does/would it also work for
DHCP relay?

This doesn’t solve the issue of a DHCP server on the same network however
and would still require a VR on the network with upstream connectivity to
the DHCP server.

I'm definitely definitely up for the concept of simple networks with no VR
if we can provision some of the essentials without one. Big +1


-Original Message-
From: Nux! [mailto:n...@li.nux.ro]
Sent: 20 March 2015 09:34
To: dev@cloudstack.apache.org
Subject: Re: [PROPOSAL] DHCP/DNS offload and config drive support for adv
zone shared network

+1, good idea

One thing though:  let's make the config drive available for all types of
zones, many people use the basic or adsg zones.

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -
> From: "Jayapal Reddy Uradi" 
> To: dev@cloudstack.apache.org
> Sent: Friday, 20 March, 2015 09:12:19
> Subject: [PROPOSAL]  DHCP/DNS offload and config drive support for adv
> zone shared network

> In advanced zone shared network if someone wants to use DHCP server
> outside the cloudstack, currently it can be done by not selecting the
> DHCP service But the problem here is that the VM actual ip is
> different from what cloudstack showing.
>
> If there are no services selected for the network offering there is no
> need of the VR.
> In the absense of VR there should be way to provide password,
> userdata/metadata, ssh keys to user vm.
>
> With this feature we can do the following.
> 1. Create network without VR.
> 2. Retrive the IP from the VM and update it in the cloudstack DB.
> 3. Add config drive support for the VMs in this network.
>
> Please provide your comments for the below FS.
>
> ACS ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-8324
> FS:
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53740
> 797
>
>
> Thanks,
> Jayapal


Jenkins build is unstable: simulator-4.5-singlerun #184

2015-03-20 Thread jenkins
See 



Build failed in Jenkins: simulator-singlerun #1039

2015-03-20 Thread jenkins
See 

Changes:

[talluri] CLOUDSTACK-8336: Adding test for shared network restart, with and 
without cleanup

[talluri] Adding more test case for shared network

--
[...truncated 10369 lines...]
> Running query: create database `cloud_usage`
> Running query: GRANT ALL ON cloud_usage.* to 'cloud'@`localhost` 
identified by 'cloud'
> Running query: GRANT ALL ON cloud_usage.* to 'cloud'@`%` 
identified by 'cloud'
> Initializing database=cloudbridge with host=localhost port=3306 
username=cloud password=cloud
> Running query: drop database if exists `cloudbridge`
> Running query: create database `cloudbridge`
> Running query: GRANT ALL ON cloudbridge.* to 'cloud'@`localhost` 
identified by 'cloud'
> Running query: GRANT ALL ON cloudbridge.* to 'cloud'@`%` 
identified by 'cloud'
> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing SQL file at 

> Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ 
cloud-developer ---
[INFO] Installing 
 
to 
/var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.6.0-SNAPSHOT/cloud-developer-4.6.0-SNAPSHOT.pom
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 1:49.331s
[INFO] Finished at: Fri Mar 20 09:41:47 EDT 2015
[INFO] Final Memory: 43M/187M
[INFO] 
[WARNING] The requested profile "simulator" could not be activated because it 
does not exist.
[simulator-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator
[INFO] Scanning for projects...
[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Developer Mode 4.6.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties 
(default) @ cloud-developer ---
[WARNING] Ignoring missing properties file: 

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (default) @ cloud-developer ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] >>> exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer >>>
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] <<< exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer <<<
[INFO] 
[INFO] --- exec-maven-p

Re: [VOTE] Apache CloudStack 4.5.1-rc1

2015-03-20 Thread Nux!
+1 from me as well based on upgrade from 4.4.1 and ADV+SG zone tests.

Thanks Rohit for the packages.

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -
> From: "Rohit Yadav" 
> To: dev@cloudstack.apache.org
> Sent: Friday, 20 March, 2015 11:38:42
> Subject: Re: [VOTE] Apache CloudStack 4.5.1-rc1

> +1 (with one centos6 rpm build fix required, read below)
> 
> Advance zone testing with/without local storage, KVM:
> 
> - VM lifecycle with and without local storage and vm's volume migrations
> (after vm was stopped) across 2 hosts
> - Password server, reset password. Stress tested password server, served
> 1000 req/second with 95.7% successful http request completion (though I
> realize ab is not really a good tool)
> - Egress rules, Firewall rules, port forwarding SNAT usage, load balancing
> - Register template and ISO
> - VM statistics, dashboard capacity values
> - Observed normal CPVM, SSVM behaviours
> - Use of both NFS and local primary storage
> - Download volume, iso, template
> - VPC: multiple tiers, password server + load tests, vm lifecycle
> with/without local storage, SNAT for vms in tiers, ACL rules
> create/update/delete/apply etc
> 
> Basic Zone testing with/without local storage, KVM:
> 
> - Basic zone with local storage, vm lifecycle
> - Volume migration (after stopped)
> - Attach/detach volumes
> - NFS primary+secondary and local storage primary
> - Normal CPVM, SSVM behaviour seen
> - Register template/iso worked
> - Download volume, iso, template
> - Shared network with SG worked
> - Password server tested, reset password
> 
> Minor issues:
> 
> - RC1 will require this minor centos6 rpm build fix that we can slip in
> https://github.com/apache/cloudstack/commit/d70937aeb92e89efa8fcc39d7f89bdd8c885b2a2
> Note: centos7 builds are fine.
> - UI logs out on refresh (due to known CSRF fix) or opening in another tab.
> 
> On Thursday 19 March 2015 08:10 PM, David Nalley wrote:
>> Hi All,
>>
>> I've created a X.X.X release, with the following artifacts up for a vote:
>>
>> Git Branch and Commit SH:
>> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.5-RC20150319T1429
>> Commit: 3c06466e208769f32c03767abc6bd2680fd8
>>
>> Source release (checksums and signatures are available at the same
>> location):
>> https://dist.apache.org/repos/dist/dev/cloudstack/4.5.1-rc1/
>>
>> PGP release keys (signed using 0x6fe50f1c):
>> https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>>
>> Vote will be open for 72 hours.
>>
>> For sanity in tallying the vote, can PMC members please be sure to
>> indicate "(binding)" with their vote?
>>
>> [ ] +1  approve
>> [ ] +0  no opinion
>> [ ] -1  disapprove (and reason why)
>>
> 
> --
> Regards,
> Rohit Yadav
> Software Architect, ShapeBlue
> M. +91 8826230892 | rohit.ya...@shapeblue.com
> Blog: bhaisaab.org | Twitter: @_bhaisaab
> PS. If you see any footer below, I did not add it :)
> Find out more about ShapeBlue and our range of CloudStack related services
> 
> IaaS Cloud Design & Build
> CSForge – rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Software
> Engineering
> CloudStack Infrastructure
> Support
> CloudStack Bootcamp Training 
> Courses
> 
> This email and any attachments to it may be confidential and are intended 
> solely
> for the use of the individual to whom it is addressed. Any views or opinions
> expressed are solely those of the author and do not necessarily represent 
> those
> of Shape Blue Ltd or related companies. If you are not the intended recipient
> of this email, you must neither take any action based upon its contents, nor
> copy or show it to anyone. Please contact the sender if you believe you have
> received this email in error. Shape Blue Ltd is a company incorporated in
> England & Wales. ShapeBlue Services India LLP is a company incorporated in
> India and is operated under license from Shape Blue Ltd. Shape Blue Brasil
> Consultoria Ltda is a company incorporated in Brasil and is operated under
> license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by
> The Republic of South Africa and is traded under license from Shape Blue Ltd.
> ShapeBlue is a registered trademark.


RE: [VOTE] Apache CloudStack 4.5.1-rc1

2015-03-20 Thread Paul Angus
-1
Regression caused by https://issues.apache.org/jira/browse/CLOUDSTACK-8312
Causes:
Unable to start instance due to can't find mapping in ObjectInDataStore table 
for: org.apache.cloudstack.storage.image.store.TemplateObject

When trying to deploy system VM templates.

Template gets copied to primary storage but no entries appear to be added to 
the db
Systemvm.iso not copied to secondary storage.
SSVM and CPVM do not get created

Rohit has created a fix for RC2 - testing on that now.

Regards,

Paul Angus
Cloud Architect
D: +44 20 3468 5163 |S: +44 20 3603 0540 | M: +44 7711 418 784 | T: @CloudyAngus
paul.an...@shapeblue.com

-Original Message-
From: Nux! [mailto:n...@li.nux.ro]
Sent: 20 March 2015 14:12
To: dev@cloudstack.apache.org
Subject: Re: [VOTE] Apache CloudStack 4.5.1-rc1

+1 from me as well based on upgrade from 4.4.1 and ADV+SG zone tests.

Thanks Rohit for the packages.

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -
> From: "Rohit Yadav" 
> To: dev@cloudstack.apache.org
> Sent: Friday, 20 March, 2015 11:38:42
> Subject: Re: [VOTE] Apache CloudStack 4.5.1-rc1

> +1 (with one centos6 rpm build fix required, read below)
>
> Advance zone testing with/without local storage, KVM:
>
> - VM lifecycle with and without local storage and vm's volume
> migrations (after vm was stopped) across 2 hosts
> - Password server, reset password. Stress tested password server,
> served
> 1000 req/second with 95.7% successful http request completion (though
> I realize ab is not really a good tool)
> - Egress rules, Firewall rules, port forwarding SNAT usage, load
> balancing
> - Register template and ISO
> - VM statistics, dashboard capacity values
> - Observed normal CPVM, SSVM behaviours
> - Use of both NFS and local primary storage
> - Download volume, iso, template
> - VPC: multiple tiers, password server + load tests, vm lifecycle
> with/without local storage, SNAT for vms in tiers, ACL rules
> create/update/delete/apply etc
>
> Basic Zone testing with/without local storage, KVM:
>
> - Basic zone with local storage, vm lifecycle
> - Volume migration (after stopped)
> - Attach/detach volumes
> - NFS primary+secondary and local storage primary
> - Normal CPVM, SSVM behaviour seen
> - Register template/iso worked
> - Download volume, iso, template
> - Shared network with SG worked
> - Password server tested, reset password
>
> Minor issues:
>
> - RC1 will require this minor centos6 rpm build fix that we can slip
> in
> https://github.com/apache/cloudstack/commit/d70937aeb92e89efa8fcc39d7f
> 89bdd8c885b2a2
> Note: centos7 builds are fine.
> - UI logs out on refresh (due to known CSRF fix) or opening in another tab.
>
> On Thursday 19 March 2015 08:10 PM, David Nalley wrote:
>> Hi All,
>>
>> I've created a X.X.X release, with the following artifacts up for a vote:
>>
>> Git Branch and Commit SH:
>> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h
>> =refs/heads/4.5-RC20150319T1429
>> Commit: 3c06466e208769f32c03767abc6bd2680fd8
>>
>> Source release (checksums and signatures are available at the same
>> location):
>> https://dist.apache.org/repos/dist/dev/cloudstack/4.5.1-rc1/
>>
>> PGP release keys (signed using 0x6fe50f1c):
>> https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>>
>> Vote will be open for 72 hours.
>>
>> For sanity in tallying the vote, can PMC members please be sure to
>> indicate "(binding)" with their vote?
>>
>> [ ] +1  approve
>> [ ] +0  no opinion
>> [ ] -1  disapprove (and reason why)
>>
>
> --
> Regards,
> Rohit Yadav
> Software Architect, ShapeBlue
> M. +91 8826230892 | rohit.ya...@shapeblue.com
> Blog: bhaisaab.org | Twitter: @_bhaisaab PS. If you see any footer
> below, I did not add it :) Find out more about ShapeBlue and our range
> of CloudStack related services
>
> IaaS Cloud Design &
> Build
> CSForge – rapid IaaS deployment
> framework
> CloudStack Consulting
> CloudStack Software
> Engineering
> CloudStack Infrastructure
> Support
> CloudStack Bootcamp Training
> Courses
>
> This email and any attachments to it may be confidential and are
> intended solely for the use of the individual to whom it is addressed.
> Any views or opinions expressed are solely those of the author and do
> not necessarily represent those of Shape Blue Ltd or related
> companies. If you are not the intended recipient of this email, you
> must neither take any action based upon its contents, nor copy or show
> it to anyone. Please contact the sender if you believe you have
> received this email in error. Shape Blue Ltd is a company incorporated
> in England & Wales. ShapeBlue Services India LLP is a company
> incorporated 

Re: [DISCUSS] Automating SystemVM template creation for VMWare

2015-03-20 Thread Daan Hoogland
Rohit, why don't you look into the systemvm jobs. These should produce
vmware images as well. If not, we have some jobs that do work on our
internal jenkins. Those we use for a vmware zone so these must work
correctly.

On Fri, Mar 20, 2015 at 10:57 AM, Rohit Yadav  wrote:
> Hi,
>
> The systemvm template build system does not do all the steps for
> producing a valid systemvm template for VMWare, from wiki and past
> discussions I know that some extra steps are needed but I'm not sure.
>
> This wikis notes some of those steps:
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Creating+System+VM+template+for+Vmware+from+generated+Vbox+template
>
> Can anyone confirm this issue? And, update the wiki if more steps are
> needed?
>
> Also can we automate those additional steps using Jenkins? Or perhaps
> semi-automate the creation process by writing scripts that do these
> extra steps for us?
>
> Regards,
> Rohit Yadav
> Software Architect, ShapeBlue
> M. +91 8826230892 | rohit.ya...@shapeblue.com
> Blog: bhaisaab.org | Twitter: @_bhaisaab
> PS. If you see any footer below, I did not add it :)
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design &
> Build
> CSForge – rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Software
> Engineering
> CloudStack Infrastructure
> Support
> CloudStack Bootcamp Training
> Courses
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a
> company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.



-- 
Daan


Re: cloudstack 4.4.2 + kvm resize data disk fail on ceph/rbd

2015-03-20 Thread Marcus
I don't think we want to return null, it was changed in master because
that method was prone to failing coverity scans and requiring a null
check. It should just return 'RBD' when needed and then that format
should be handled, null should not mean RBD.

On Thu, Mar 19, 2015 at 11:50 PM, Star Guo  wrote:
> Yes, I have found the difference between branch 4.4 and branch master:
>
>
>
> 4.4: 
> https://github.com/apache/cloudstack/blob/4.4/plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtComputingResource.java
>
> …
>
> 1844 try {
>
> 1845 KVMStoragePool pool = 
> _storagePoolMgr.getStoragePool(spool.getType(), spool.getUuid());
>
> 1846 KVMPhysicalDisk vol = pool.getPhysicalDisk(volid);
>
> 1847 String path = vol.getPath();
>
> 1848 String type = getResizeScriptType(pool, vol);
>
> 1849
>
> 1850 if (type == null) {
>
> 1851 return new ResizeVolumeAnswer(cmd, false, "Unsupported 
> volume format: pool type '" + pool.getType() +  "' and volume format '" + 
> vol.getFormat() + "'");1852 } else if (type.equals("QCOW2") && 
> shrinkOk) {
>
> 1853 return new ResizeVolumeAnswer(cmd, false, "Unable to 
> shrink volumes of type " + type);
>
> 1854 }
>
> 1855
>
> 1856 s_logger.debug("Resizing volume: " + path + "," + 
> currentSize + "," + newSize + "," + type + "," + vmInsta nceName + "," + 
> shrinkOk);1857
>
> 1858 /* libvirt doesn't support resizing (C)LVM devices, and 
> corrupts QCOW2 in some scenarios, so we have to do  these via Bash script 
> */1859 if (pool.getType() != StoragePoolType.CLVM && 
> vol.getFormat() != PhysicalDiskFormat.QCOW2) {
>
> 1860 s_logger.debug("Volume " + path +  " can be resized by 
> libvirt. Asking libvirt to resize the volume.") ;
>
> 1861 try {
>
> 1862 Connect conn = LibvirtConnection.getConnection();
>
> 1863 StorageVol v = conn.storageVolLookupByPath(path);
>
> 1864 int flags = 0;
>
> 1865
>
> 1866 if (conn.getLibVirVersion() > 1001000 && 
> vol.getFormat() == PhysicalDiskFormat.RAW) {
>
> 1867 flags = 1;
>
> 1868 }
>
> 1869 if (shrinkOk) {
>
> 1870 flags = 4;
>
> 1871 }
>
> …
>
>
>
>
>
>
>
> Master: 
> https://github.com/apache/cloudstack/blob/master/plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtComputingResource.java
>
> …
>
> 1863 try {
>
> 1864 KVMStoragePool pool = 
> _storagePoolMgr.getStoragePool(spool.getType(), spool.getUuid());
>
> 1865 KVMPhysicalDisk vol = pool.getPhysicalDisk(volid);
>
> 1866 String path = vol.getPath();
>
> 1867 String type = getResizeScriptType(pool, vol);
>
> 1868
>
> 1869 if (pool.getType() != StoragePoolType.RBD) {
>
> 1870 if (type.equals("QCOW2") && shrinkOk) {
>
> 1871 return new ResizeVolumeAnswer(cmd, false, "Unable to 
> shrink volumes of type " + type);
>
> 1872 }
>
> 1873 } else {
>
> 1874 s_logger.debug("Volume " + path + " is on a RBD storage 
> pool. No need to query for additional information.");
>
> 1875 }
>
> 1876
>
> 1877 s_logger.debug("Resizing volume: " + path + "," + 
> currentSize + "," + newSize + "," + type + "," + vmInsta nceName + "," + 
> shrinkOk);
>
> 1878
>
> 1879 /* libvirt doesn't support resizing (C)LVM devices, and 
> corrupts QCOW2 in some scenarios, so we have to do  these via Bash script 
> */
>
> 1880 if (pool.getType() != StoragePoolType.CLVM && 
> vol.getFormat() != PhysicalDiskFormat.QCOW2) {
>
> 1881 s_logger.debug("Volume " + path +  " can be resized by 
> libvirt. Asking libvirt to resize the volume.") ;
>
> 1882 try {
>
> 1883 Connect conn = LibvirtConnection.getConnection();
>
> 1884 StorageVol v = conn.storageVolLookupByPath(path);
>
> 1885 int flags = 0;
>
> 1886
>
> 1887 if (conn.getLibVirVersion() > 1001000 && 
> vol.getFormat() == PhysicalDiskFormat.RAW && pool.getType() != 
> StoragePoolType.RBD) {
>
> 1888 flags = 1;
>
> 1889 }
>
> …
>
>
>
> And then , I check the scripts file: scripts/storage/qcow2/resizevolume.sh ., 
> backport the feature to my source code. After complie, cover the 
> cloud-plugin-hypervisor-kvm-4.4.2.jar to MS and kvm agent, then it works.
>
>
>
> BTW, in Master the method “private String getResizeScriptType(KVMStoragePool 
> pool, KVMPhysicalDisk vol)”  in LibvirtComputingResource.java should be 
> return null at the end, and branch 4.4 fix it.
>
>
>
> Best Regards,
>
> Star Guo
>
>
>

Re: [ANNOUNCE] New committer: Karen Vuong

2015-03-20 Thread Karen Vuong
Thank you all!

- Karen

On Fri, Mar 20, 2015 at 2:43 AM, Srikanteswararao Talluri <
srikanteswararao.tall...@citrix.com> wrote:

> Congts Karen!
>
> ~Talluri
>
> On 20/03/15 2:15 pm, "Daan Hoogland"  wrote:
>
> >thanks for everything Karen,
> >
> >On Fri, Mar 20, 2015 at 9:20 AM, Paul Angus 
> >wrote:
> >> Congratulations Karen!
> >>
> >> Regards,
> >>
> >> Paul Angus
> >> Cloud Architect
> >> D: +44 20 3468 5163 |S: +44 20 3603 0540 | M: +44 7711 418 784 | T:
> >>@CloudyAngus
> >> paul.an...@shapeblue.com
> >>
> >> -Original Message-
> >> From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com]
> >> Sent: 20 March 2015 06:28
> >> To: us...@cloudstack.apache.org
> >> Cc: dev@cloudstack.apache.org
> >> Subject: Re: [ANNOUNCE] New committer: Karen Vuong
> >>
> >> Congratulations Karen, I appreciate your commitment to the project and
> >>its community!
> >>
> >>> On 20-Mar-2015, at 10:10 am, Mike Tutkowski
> >>> wrote:
> >>>
> >>> Congratulations, Karen!
> >>>
> >>> On Thu, Mar 19, 2015 at 4:07 PM, Pierre-Luc Dion 
> >>>wrote:
> >>>
>  The Project Management Committee (PMC) for Apache CloudStack has
>  asked Karen Vuong to become a committer and we are pleased to
>  announce that she have accepted.
> 
>  Karen is doing a huge effort on promoting CloudStack and organizing
>  events such as CloudStack days, CloudStack collaboration conferences
>  and meetups. She is helping a lot on the marketing effort as well.
> 
>  Being a committer allows many contributors to contribute more
>  autonomously. For developers, it makes it easier to submit changes
>  and eliminates the need to have contributions reviewed via the patch
>  submission process. Whether contributions are development-related or
>  otherwise, it is a recognition of a contributor's participation in
>  the project and commitment to the project and the Apache Way.
> 
>  Please join me in congratulating Karen (karenv)
> 
>  --Pierre-Luc
>  on behalf of the CloudStack PMC
> 
> >>>
> >>>
> >>>
> >>> --
> >>> *Mike Tutkowski*
> >>> *Senior CloudStack Developer, SolidFire Inc.*
> >>> e: mike.tutkow...@solidfire.com
> >>> o: 303.746.7302
> >>> Advancing the way the world uses the cloud
> >>> * *
> >>
> >> Regards,
> >> Rohit Yadav
> >> Software Architect, ShapeBlue
> >> M. +91 88 262 30892 | rohit.ya...@shapeblue.com
> >> Blog: bhaisaab.org | Twitter: @_bhaisaab
> >>
> >>
> >>
> >> Find out more about ShapeBlue and our range of CloudStack related
> >>services
> >>
> >> IaaS Cloud Design &
> >>Build
> >> CSForge ­ rapid IaaS deployment framework >
> >> CloudStack Consulting
> >> CloudStack Software
> >>Engineering
> >> CloudStack Infrastructure
> >>Support
> >> CloudStack Bootcamp Training
> >>Courses
> >>
> >> This email and any attachments to it may be confidential and are
> >>intended solely for the use of the individual to whom it is addressed.
> >>Any views or opinions expressed are solely those of the author and do
> >>not necessarily represent those of Shape Blue Ltd or related companies.
> >>If you are not the intended recipient of this email, you must neither
> >>take any action based upon its contents, nor copy or show it to anyone.
> >>Please contact the sender if you believe you have received this email in
> >>error. Shape Blue Ltd is a company incorporated in England & Wales.
> >>ShapeBlue Services India LLP is a company incorporated in India and is
> >>operated under license from Shape Blue Ltd. Shape Blue Brasil
> >>Consultoria Ltda is a company incorporated in Brasil and is operated
> >>under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company
> >>registered by The Republic of South Africa and is traded under license
> >>from Shape Blue Ltd. ShapeBlue is a registered trademark.
> >> Find out more about ShapeBlue and our range of CloudStack related
> >>services
> >>
> >> IaaS Cloud Design &
> >>Build
> >> CSForge ­ rapid IaaS deployment framework >
> >> CloudStack Consulting
> >> CloudStack Software
> >>Engineering
> >> CloudStack Infrastructure
> >>Support
> >> CloudStack Bootcamp Training
> >>Courses
> >>
> >> This email and any attachments to it may be confidential and are
> >>intended solely for the use of the individual to whom it is addressed.
> >>Any views or opinions expressed are solely those of the author and do
> >>not necessarily 

[GitHub] cloudstack pull request:

2015-03-20 Thread serverchief
Github user serverchief commented on the pull request:


https://github.com/apache/cloudstack/commit/d70937aeb92e89efa8fcc39d7f89bdd8c885b2a2#commitcomment-10319442
  
thanks for this fix!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [VOTE] Apache CloudStack 4.5.1-rc1

2015-03-20 Thread Rohit Yadav
Hi everyone,

Don’t get discouraged by the minor regressions found as they are fixed. Note: 
they would only affect VMWare/Xen and the rpm bug will affect only CentOS6 
users.

In case you’re building from source, apply these two patches on top of RC1 and 
please continue testing:

https://github.com/apache/cloudstack/commit/53ca0b1861c743caf61ec04f776c87eac334f185
https://github.com/apache/cloudstack/commit/d70937aeb92e89efa8fcc39d7f89bdd8c885b2a2

> On 20-Mar-2015, at 7:51 pm, Paul Angus  wrote:
>
> -1
> Regression caused by https://issues.apache.org/jira/browse/CLOUDSTACK-8312
> Causes:
> Unable to start instance due to can't find mapping in ObjectInDataStore table 
> for: org.apache.cloudstack.storage.image.store.TemplateObject
>
> When trying to deploy system VM templates.
>
> Template gets copied to primary storage but no entries appear to be added to 
> the db
> Systemvm.iso not copied to secondary storage.
> SSVM and CPVM do not get created
>
> Rohit has created a fix for RC2 - testing on that now.
>
> Regards,
>
> Paul Angus
> Cloud Architect
> D: +44 20 3468 5163 |S: +44 20 3603 0540 | M: +44 7711 418 784 | T: 
> @CloudyAngus
> paul.an...@shapeblue.com
>
> -Original Message-
> From: Nux! [mailto:n...@li.nux.ro]
> Sent: 20 March 2015 14:12
> To: dev@cloudstack.apache.org
> Subject: Re: [VOTE] Apache CloudStack 4.5.1-rc1
>
> +1 from me as well based on upgrade from 4.4.1 and ADV+SG zone tests.
>
> Thanks Rohit for the packages.
>
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>
> - Original Message -
>> From: "Rohit Yadav" 
>> To: dev@cloudstack.apache.org
>> Sent: Friday, 20 March, 2015 11:38:42
>> Subject: Re: [VOTE] Apache CloudStack 4.5.1-rc1
>
>> +1 (with one centos6 rpm build fix required, read below)
>>
>> Advance zone testing with/without local storage, KVM:
>>
>> - VM lifecycle with and without local storage and vm's volume
>> migrations (after vm was stopped) across 2 hosts
>> - Password server, reset password. Stress tested password server,
>> served
>> 1000 req/second with 95.7% successful http request completion (though
>> I realize ab is not really a good tool)
>> - Egress rules, Firewall rules, port forwarding SNAT usage, load
>> balancing
>> - Register template and ISO
>> - VM statistics, dashboard capacity values
>> - Observed normal CPVM, SSVM behaviours
>> - Use of both NFS and local primary storage
>> - Download volume, iso, template
>> - VPC: multiple tiers, password server + load tests, vm lifecycle
>> with/without local storage, SNAT for vms in tiers, ACL rules
>> create/update/delete/apply etc
>>
>> Basic Zone testing with/without local storage, KVM:
>>
>> - Basic zone with local storage, vm lifecycle
>> - Volume migration (after stopped)
>> - Attach/detach volumes
>> - NFS primary+secondary and local storage primary
>> - Normal CPVM, SSVM behaviour seen
>> - Register template/iso worked
>> - Download volume, iso, template
>> - Shared network with SG worked
>> - Password server tested, reset password
>>
>> Minor issues:
>>
>> - RC1 will require this minor centos6 rpm build fix that we can slip
>> in
>> https://github.com/apache/cloudstack/commit/d70937aeb92e89efa8fcc39d7f
>> 89bdd8c885b2a2
>> Note: centos7 builds are fine.
>> - UI logs out on refresh (due to known CSRF fix) or opening in another tab.
>>
>> On Thursday 19 March 2015 08:10 PM, David Nalley wrote:
>>> Hi All,
>>>
>>> I've created a X.X.X release, with the following artifacts up for a vote:
>>>
>>> Git Branch and Commit SH:
>>> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h
>>> =refs/heads/4.5-RC20150319T1429
>>> Commit: 3c06466e208769f32c03767abc6bd2680fd8
>>>
>>> Source release (checksums and signatures are available at the same
>>> location):
>>> https://dist.apache.org/repos/dist/dev/cloudstack/4.5.1-rc1/
>>>
>>> PGP release keys (signed using 0x6fe50f1c):
>>> https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>>>
>>> Vote will be open for 72 hours.
>>>
>>> For sanity in tallying the vote, can PMC members please be sure to
>>> indicate "(binding)" with their vote?
>>>
>>> [ ] +1  approve
>>> [ ] +0  no opinion
>>> [ ] -1  disapprove (and reason why)
>>>
>>
>> --
>> Regards,
>> Rohit Yadav
>> Software Architect, ShapeBlue
>> M. +91 8826230892 | rohit.ya...@shapeblue.com
>> Blog: bhaisaab.org | Twitter: @_bhaisaab PS. If you see any footer
>> below, I did not add it :) Find out more about ShapeBlue and our range
>> of CloudStack related services
>>
>> IaaS Cloud Design &
>> Build
>> CSForge – rapid IaaS deployment
>> framework
>> CloudStack Consulting
>> CloudStack Software
>> Engineering
>> CloudStack Infrastructure
>> Support
>> CloudStack Bootcamp Training
>> Courses

Re: [DISCUSS] Automating SystemVM template creation for VMWare

2015-03-20 Thread Rohit Yadav
Hi Daan,

The Jenkins job do produce ova images, the issue is that an additional cdrom 
device is added and some secret sauce needs to be injected in the template to 
make it work on vmware. I’m not sure what that is, perhaps a VMWare guru can 
comment. I’ll try to explore more next week and fix the automation as much as I 
can.

> On 20-Mar-2015, at 8:25 pm, Daan Hoogland  wrote:
>
> Rohit, why don't you look into the systemvm jobs. These should produce
> vmware images as well. If not, we have some jobs that do work on our
> internal jenkins. Those we use for a vmware zone so these must work
> correctly.
>
> On Fri, Mar 20, 2015 at 10:57 AM, Rohit Yadav  
> wrote:
>> Hi,
>>
>> The systemvm template build system does not do all the steps for
>> producing a valid systemvm template for VMWare, from wiki and past
>> discussions I know that some extra steps are needed but I'm not sure.
>>
>> This wikis notes some of those steps:
>>
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Creating+System+VM+template+for+Vmware+from+generated+Vbox+template
>>
>> Can anyone confirm this issue? And, update the wiki if more steps are
>> needed?
>>
>> Also can we automate those additional steps using Jenkins? Or perhaps
>> semi-automate the creation process by writing scripts that do these
>> extra steps for us?
>>
>> Regards,
>> Rohit Yadav
>> Software Architect, ShapeBlue
>> M. +91 8826230892 | rohit.ya...@shapeblue.com
>> Blog: bhaisaab.org | Twitter: @_bhaisaab
>> PS. If you see any footer below, I did not add it :)
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design &
>> Build
>> CSForge – rapid IaaS deployment framework
>> CloudStack Consulting
>> CloudStack Software
>> Engineering
>> CloudStack Infrastructure
>> Support
>> CloudStack Bootcamp Training
>> Courses
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a
>> company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
> --
> Daan

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 88 262 30892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.


Re: [DISCUSS] Automating SystemVM template creation for VMWare

2015-03-20 Thread ilya
++Lucian, i know i mentioned i can help with rolling vmware ovf 
templates but did not get to - here are the instructions..


Rohit,

We roll vmware templates continuously via jenkins without the need of 
vagrant. Only using virt-install with KVM and ovftool from vmware.


You dont have to use virt-install, if img file is created and vmware 
tools are installed, here is what i did to make it vmware ova image.


On high level,
1) create dummy VMX file - via stage_vmx function
2) convert raw/img file to vdml via qemu-img
3) inject content into vmx file
3) use ovftool from vmware to roll ova image

### stage_vmx
function stage_vmx (){
cat << VMXFILE > "$3/$1.vmx"
.encoding = "UTF-8"
config.version = "8"
virtualHW.version = "9"
pciBridge0.present = "true"
pciBridge4.present = "true"
pciBridge4.virtualDev = "pcieRootPort"
pciBridge4.functions = "8"
pciBridge5.present = "true"
pciBridge5.virtualDev = "pcieRootPort"
pciBridge5.functions = "8"
pciBridge6.present = "true"
pciBridge6.virtualDev = "pcieRootPort"
pciBridge6.functions = "8"
pciBridge7.present = "true"
pciBridge7.virtualDev = "pcieRootPort"
pciBridge7.functions = "8"
vmci0.present = "true"
hpet0.present = "true"
nvram = "$1.nvram"
virtualHW.productCompatibility = "hosted"
powerType.powerOff = "soft"
powerType.powerOn = "hard"
powerType.suspend = "hard"
powerType.reset = "soft"
displayName = "$1"
extendedConfigFile = "$1.vmxf"
scsi0.present = "true"
scsi0.sharedBus = "none"
scsi0.virtualDev = "lsilogic"
memsize = "1024"
svga.autodetect = "true"
guestOS = "other-64"
sched.cpu.min = "0"
sched.cpu.units = "mhz"
sched.mem.min = "0"
sched.mem.max = "1024"
scsi0:1.present = "true"
scsi0:1.fileName = "$2"
scsi0:1.deviceType = "scsi-hardDisk"
ide0:0.present = "true"
ide0:0.clientDevice = "true"
ide0:0.deviceType = "cdrom-raw"
ide0:0.allowGuestConnectionControl = "false"
ethernet0.present = "true"
ethernet0.virtualDev = "e1000"
ethernet0.wakeOnPcktRcv = "false"
ethernet0.networkName = "vSwitch0"
ethernet0.addressType = "static"
ethernet0.address = "06:e6:20:00:00:1a"
machine.id = ""
devices.hotplug = "true"
nicAdapter = "E1000"
keyboard.typematicMindelay = "200"
floppy0.present = "FALSE"
scsi0.pciSlotNumber = "16"
ethernet0.pciSlotNumber = "32"
vmci0.id = "1572826102"
vmci0.pciSlotNumber = "33"
tools.syncTime = "FALSE"
uuid.location = "56 4d ab 75 73 c1 95 3d-f4 af c4 ce 75 fb ac 37"
cleanShutdown = "FALSE"
replay.supported = "FALSE"
sched.swap.derivedName = "$1.vswp"
pciBridge0.pciSlotNumber = "17"
pciBridge4.pciSlotNumber = "21"
pciBridge5.pciSlotNumber = "22"
pciBridge6.pciSlotNumber = "23"
pciBridge7.pciSlotNumber = "24"
softPowerOff = "FALSE"
VMXFILE
}

#convert to vmdk
qemu-img convert -f raw -O vmdk $myvmimage $myvmimagevmdk && echo "NOTE: 
The VMDK image for $myvmname is $myvmimagevmdk" || echo "ERROR: qemu-img 
conversion from img to vmdk failed!"


# create vmx staging file
stage_vmx $VMNAME $VMDK-FILE  $DIR-OF-VMDK

#create ova with vmx and vmdk, ovftool binary must be available
OVFTOOL=$(which ovftool)
$OVFTOOL $NAME.vmx $NAME.ova

Regards
ilya


On 3/20/15 2:57 AM, Rohit Yadav wrote:

Hi,

The systemvm template build system does not do all the steps for
producing a valid systemvm template for VMWare, from wiki and past
discussions I know that some extra steps are needed but I'm not sure.

This wikis notes some of those steps:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Creating+System+VM+template+for+Vmware+from+generated+Vbox+template 



Can anyone confirm this issue? And, update the wiki if more steps are
needed?

Also can we automate those additional steps using Jenkins? Or perhaps
semi-automate the creation process by writing scripts that do these
extra steps for us?

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 8826230892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab
PS. If you see any footer below, I did not add it :)
Find out more about ShapeBlue and our range of CloudStack related 
services


IaaS Cloud Design & 
Build

CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training 
Courses


This email and any attachments to it may be confidential and are 
intended solely for the use of the individual to whom it is addressed. 
Any views or opinions expressed are solely those of the author and do 
not necessarily represent those of Shape Blue Ltd or related 
companies. If you are not the intended recipient of this email, you 
must neither take any action based upon its contents, nor copy or show 
it to anyone. Please contact the sender if you believe you have 
received this email in error. Shape Blue Ltd is a compan

Jenkins access

2015-03-20 Thread ilya

How do i get access to Jenkins?

Thanks
ilya


Re: [PROPOSAL] DHCP/DNS offload and config drive support for adv zone shared network

2015-03-20 Thread Alena Prokharchyk
>From the FS:

"Create empty network offering with no service selected. Only DHCP, DNS
services are provided by external servers.
Metadata - information is included in the config drive
Userdata, vm password, ssh key - If these are passed then included in
the config drive with user data service."
"Retrieving IP assigned by external DHCP server to userVM. Store it in CS
DB."


Why not just introduce the notion of the external provider for the
DHCP/DNS/UserData service? Not specifying the services on the offering and
implementing the service and storing the service data - UserData/MetaData
and IP  - in the CloudStack DB, is confusing. Unless all the
metadata/userdata is stored/managed on/by the external provider side.

On Fri, Mar 20, 2015 at 6:20 AM, Adrian Lewis 
wrote:

> Can't see the wiki at the moment as it's down for maintenance but on a
> slightly different but related note, would it be feasible to use DHCP relay
> functionality in dnsmasq on a VR and still get the IP address assigned by
> an
> external DHCP server registered into the ACS MS? Not quite sure if under
> normal circumstances ACS picks up the IP from dnsmasq or if ACS manages the
> pool and sends dnsmasq static leases. If it's picking up what dnsmasq
> decides to lease out, what is this mechanism and does/would it also work
> for
> DHCP relay?
>
> This doesn’t solve the issue of a DHCP server on the same network however
> and would still require a VR on the network with upstream connectivity to
> the DHCP server.
>
> I'm definitely definitely up for the concept of simple networks with no VR
> if we can provision some of the essentials without one. Big +1
>
>
> -Original Message-
> From: Nux! [mailto:n...@li.nux.ro]
> Sent: 20 March 2015 09:34
> To: dev@cloudstack.apache.org
> Subject: Re: [PROPOSAL] DHCP/DNS offload and config drive support for adv
> zone shared network
>
> +1, good idea
>
> One thing though:  let's make the config drive available for all types of
> zones, many people use the basic or adsg zones.
>
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>
> - Original Message -
> > From: "Jayapal Reddy Uradi" 
> > To: dev@cloudstack.apache.org
> > Sent: Friday, 20 March, 2015 09:12:19
> > Subject: [PROPOSAL]  DHCP/DNS offload and config drive support for adv
> > zone shared network
>
> > In advanced zone shared network if someone wants to use DHCP server
> > outside the cloudstack, currently it can be done by not selecting the
> > DHCP service But the problem here is that the VM actual ip is
> > different from what cloudstack showing.
> >
> > If there are no services selected for the network offering there is no
> > need of the VR.
> > In the absense of VR there should be way to provide password,
> > userdata/metadata, ssh keys to user vm.
> >
> > With this feature we can do the following.
> > 1. Create network without VR.
> > 2. Retrive the IP from the VM and update it in the cloudstack DB.
> > 3. Add config drive support for the VMs in this network.
> >
> > Please provide your comments for the below FS.
> >
> > ACS ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-8324
> > FS:
> > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53740
> > 797
> >
> >
> > Thanks,
> > Jayapal
>



-- 
Alena Prokharchyk
https://twitter.com/Lemonjet
http://www.linkedin.com/pub/alena-prokharchyk/13/282/a7b


Ways to monitor Virtual Router disk space

2015-03-20 Thread Erik Weber
I've had a few incidents where conntrack logging has filled the /var
partition, and break provisioning of new VMs (unable to save password).

And this got me thinking that there must be a way to monitor VR disk space..

Some things to consider:

 - I'm using XenServer, so AFAIK the VR ssh is only available from the XS
link-local network.
 - I'd prefer to not build my own systemvm templates, ie. I'd like to use
them as is
 - The monitoring should eventually end up in Nagios

My idea so far is to make a collectd script or similar, that uses the
CloudStack API to fetch a list of routers and its XS host, connect to the
VR through the right XS Host and then push the data to graphite or similar.

Then use the check_graphite plugin in Nagios to monitor the disk space.

Does anyone have any insight to this, experience with doing something
similar or other inputs?

 --
Erik


Re: Jenkins access

2015-03-20 Thread David Nalley
which jenkins?


On Fri, Mar 20, 2015 at 2:40 PM, ilya  wrote:
> How do i get access to Jenkins?
>
> Thanks
> ilya


Re: [PROPOSAL] DHCP/DNS offload and config drive support for adv zone shared network

2015-03-20 Thread Marcus
I agree, that's generally the model, right? The network offering
describes where the services come from.

On Fri, Mar 20, 2015 at 12:16 PM, Alena Prokharchyk  wrote:
> From the FS:
>
> "Create empty network offering with no service selected. Only DHCP, DNS
> services are provided by external servers.
> Metadata - information is included in the config drive
> Userdata, vm password, ssh key - If these are passed then included in
> the config drive with user data service."
> "Retrieving IP assigned by external DHCP server to userVM. Store it in CS
> DB."
>
>
> Why not just introduce the notion of the external provider for the
> DHCP/DNS/UserData service? Not specifying the services on the offering and
> implementing the service and storing the service data - UserData/MetaData
> and IP  - in the CloudStack DB, is confusing. Unless all the
> metadata/userdata is stored/managed on/by the external provider side.
>
> On Fri, Mar 20, 2015 at 6:20 AM, Adrian Lewis 
> wrote:
>
>> Can't see the wiki at the moment as it's down for maintenance but on a
>> slightly different but related note, would it be feasible to use DHCP relay
>> functionality in dnsmasq on a VR and still get the IP address assigned by
>> an
>> external DHCP server registered into the ACS MS? Not quite sure if under
>> normal circumstances ACS picks up the IP from dnsmasq or if ACS manages the
>> pool and sends dnsmasq static leases. If it's picking up what dnsmasq
>> decides to lease out, what is this mechanism and does/would it also work
>> for
>> DHCP relay?
>>
>> This doesn’t solve the issue of a DHCP server on the same network however
>> and would still require a VR on the network with upstream connectivity to
>> the DHCP server.
>>
>> I'm definitely definitely up for the concept of simple networks with no VR
>> if we can provision some of the essentials without one. Big +1
>>
>>
>> -Original Message-
>> From: Nux! [mailto:n...@li.nux.ro]
>> Sent: 20 March 2015 09:34
>> To: dev@cloudstack.apache.org
>> Subject: Re: [PROPOSAL] DHCP/DNS offload and config drive support for adv
>> zone shared network
>>
>> +1, good idea
>>
>> One thing though:  let's make the config drive available for all types of
>> zones, many people use the basic or adsg zones.
>>
>> Lucian
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
>>
>> - Original Message -
>> > From: "Jayapal Reddy Uradi" 
>> > To: dev@cloudstack.apache.org
>> > Sent: Friday, 20 March, 2015 09:12:19
>> > Subject: [PROPOSAL]  DHCP/DNS offload and config drive support for adv
>> > zone shared network
>>
>> > In advanced zone shared network if someone wants to use DHCP server
>> > outside the cloudstack, currently it can be done by not selecting the
>> > DHCP service But the problem here is that the VM actual ip is
>> > different from what cloudstack showing.
>> >
>> > If there are no services selected for the network offering there is no
>> > need of the VR.
>> > In the absense of VR there should be way to provide password,
>> > userdata/metadata, ssh keys to user vm.
>> >
>> > With this feature we can do the following.
>> > 1. Create network without VR.
>> > 2. Retrive the IP from the VM and update it in the cloudstack DB.
>> > 3. Add config drive support for the VMs in this network.
>> >
>> > Please provide your comments for the below FS.
>> >
>> > ACS ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-8324
>> > FS:
>> > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53740
>> > 797
>> >
>> >
>> > Thanks,
>> > Jayapal
>>
>
>
>
> --
> Alena Prokharchyk
> https://twitter.com/Lemonjet
> http://www.linkedin.com/pub/alena-prokharchyk/13/282/a7b


Re: [PROPOSAL] DHCP/DNS offload and config drive support for adv zone shared network

2015-03-20 Thread ilya

I think config drive is not the best design choice.

You are relying on external ISO to deliver content private to VM. The 
ISO is stored in secondary or primary storage, if exposed - I get the 
private data of all the VMs. There maybe issues with storage migration 
and general vmotion if ISO is attached.


If we are following this model because openstack has chosen this path - 
i think its just wasted effort and wrong.


In my opinion, an external service is much better solution, i.e. AWS - 
not OpenStack.


Also, how does this work "CS retrieves the ip from the VM and update in 
the DB nics table. "?



On 3/20/15 4:56 PM, Marcus wrote:

I agree, that's generally the model, right? The network offering
describes where the services come from.

On Fri, Mar 20, 2015 at 12:16 PM, Alena Prokharchyk  wrote:

 From the FS:

"Create empty network offering with no service selected. Only DHCP, DNS
services are provided by external servers.
 Metadata - information is included in the config drive
 Userdata, vm password, ssh key - If these are passed then included in
the config drive with user data service."
"Retrieving IP assigned by external DHCP server to userVM. Store it in CS
DB."


Why not just introduce the notion of the external provider for the
DHCP/DNS/UserData service? Not specifying the services on the offering and
implementing the service and storing the service data - UserData/MetaData
and IP  - in the CloudStack DB, is confusing. Unless all the
metadata/userdata is stored/managed on/by the external provider side.

On Fri, Mar 20, 2015 at 6:20 AM, Adrian Lewis 
wrote:


Can't see the wiki at the moment as it's down for maintenance but on a
slightly different but related note, would it be feasible to use DHCP relay
functionality in dnsmasq on a VR and still get the IP address assigned by
an
external DHCP server registered into the ACS MS? Not quite sure if under
normal circumstances ACS picks up the IP from dnsmasq or if ACS manages the
pool and sends dnsmasq static leases. If it's picking up what dnsmasq
decides to lease out, what is this mechanism and does/would it also work
for
DHCP relay?

This doesn’t solve the issue of a DHCP server on the same network however
and would still require a VR on the network with upstream connectivity to
the DHCP server.

I'm definitely definitely up for the concept of simple networks with no VR
if we can provision some of the essentials without one. Big +1


-Original Message-
From: Nux! [mailto:n...@li.nux.ro]
Sent: 20 March 2015 09:34
To: dev@cloudstack.apache.org
Subject: Re: [PROPOSAL] DHCP/DNS offload and config drive support for adv
zone shared network

+1, good idea

One thing though:  let's make the config drive available for all types of
zones, many people use the basic or adsg zones.

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -

From: "Jayapal Reddy Uradi" 
To: dev@cloudstack.apache.org
Sent: Friday, 20 March, 2015 09:12:19
Subject: [PROPOSAL]  DHCP/DNS offload and config drive support for adv
zone shared network
In advanced zone shared network if someone wants to use DHCP server
outside the cloudstack, currently it can be done by not selecting the
DHCP service But the problem here is that the VM actual ip is
different from what cloudstack showing.

If there are no services selected for the network offering there is no
need of the VR.
In the absense of VR there should be way to provide password,
userdata/metadata, ssh keys to user vm.

With this feature we can do the following.
1. Create network without VR.
2. Retrive the IP from the VM and update it in the cloudstack DB.
3. Add config drive support for the VMs in this network.

Please provide your comments for the below FS.

ACS ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-8324
FS:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53740
797


Thanks,
Jayapal



--
Alena Prokharchyk
https://twitter.com/Lemonjet
http://www.linkedin.com/pub/alena-prokharchyk/13/282/a7b




Re: [PROPOSAL] DHCP/DNS offload and config drive support for adv zone shared network

2015-03-20 Thread Marcus
There are some native hypervisor options, like virtio-socket for KVM,
vmx file parameters for VMware. We already use something like this for
the system vm bootstrap on KVM, that's how system vms get their ips.

On Fri, Mar 20, 2015 at 6:12 PM, ilya  wrote:
> I think config drive is not the best design choice.
>
> You are relying on external ISO to deliver content private to VM. The ISO is
> stored in secondary or primary storage, if exposed - I get the private data
> of all the VMs. There maybe issues with storage migration and general
> vmotion if ISO is attached.
>
> If we are following this model because openstack has chosen this path - i
> think its just wasted effort and wrong.
>
> In my opinion, an external service is much better solution, i.e. AWS - not
> OpenStack.
>
> Also, how does this work "CS retrieves the ip from the VM and update in the
> DB nics table. "?
>
>
>
> On 3/20/15 4:56 PM, Marcus wrote:
>>
>> I agree, that's generally the model, right? The network offering
>> describes where the services come from.
>>
>> On Fri, Mar 20, 2015 at 12:16 PM, Alena Prokharchyk 
>> wrote:
>>>
>>>  From the FS:
>>>
>>> "Create empty network offering with no service selected. Only DHCP, DNS
>>> services are provided by external servers.
>>>  Metadata - information is included in the config drive
>>>  Userdata, vm password, ssh key - If these are passed then included
>>> in
>>> the config drive with user data service."
>>> "Retrieving IP assigned by external DHCP server to userVM. Store it in CS
>>> DB."
>>>
>>>
>>> Why not just introduce the notion of the external provider for the
>>> DHCP/DNS/UserData service? Not specifying the services on the offering
>>> and
>>> implementing the service and storing the service data - UserData/MetaData
>>> and IP  - in the CloudStack DB, is confusing. Unless all the
>>> metadata/userdata is stored/managed on/by the external provider side.
>>>
>>> On Fri, Mar 20, 2015 at 6:20 AM, Adrian Lewis
>>> 
>>> wrote:
>>>
 Can't see the wiki at the moment as it's down for maintenance but on a
 slightly different but related note, would it be feasible to use DHCP
 relay
 functionality in dnsmasq on a VR and still get the IP address assigned
 by
 an
 external DHCP server registered into the ACS MS? Not quite sure if under
 normal circumstances ACS picks up the IP from dnsmasq or if ACS manages
 the
 pool and sends dnsmasq static leases. If it's picking up what dnsmasq
 decides to lease out, what is this mechanism and does/would it also work
 for
 DHCP relay?

 This doesn’t solve the issue of a DHCP server on the same network
 however
 and would still require a VR on the network with upstream connectivity
 to
 the DHCP server.

 I'm definitely definitely up for the concept of simple networks with no
 VR
 if we can provision some of the essentials without one. Big +1


 -Original Message-
 From: Nux! [mailto:n...@li.nux.ro]
 Sent: 20 March 2015 09:34
 To: dev@cloudstack.apache.org
 Subject: Re: [PROPOSAL] DHCP/DNS offload and config drive support for
 adv
 zone shared network

 +1, good idea

 One thing though:  let's make the config drive available for all types
 of
 zones, many people use the basic or adsg zones.

 Lucian

 --
 Sent from the Delta quadrant using Borg technology!

 Nux!
 www.nux.ro

 - Original Message -
>
> From: "Jayapal Reddy Uradi" 
> To: dev@cloudstack.apache.org
> Sent: Friday, 20 March, 2015 09:12:19
> Subject: [PROPOSAL]  DHCP/DNS offload and config drive support for adv
> zone shared network
> In advanced zone shared network if someone wants to use DHCP server
> outside the cloudstack, currently it can be done by not selecting the
> DHCP service But the problem here is that the VM actual ip is
> different from what cloudstack showing.
>
> If there are no services selected for the network offering there is no
> need of the VR.
> In the absense of VR there should be way to provide password,
> userdata/metadata, ssh keys to user vm.
>
> With this feature we can do the following.
> 1. Create network without VR.
> 2. Retrive the IP from the VM and update it in the cloudstack DB.
> 3. Add config drive support for the VMs in this network.
>
> Please provide your comments for the below FS.
>
> ACS ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-8324
> FS:
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53740
> 797
>
>
> Thanks,
> Jayapal
>>>
>>>
>>>
>>> --
>>> Alena Prokharchyk
>>> https://twitter.com/Lemonjet
>>> http://www.linkedin.com/pub/alena-prokharchyk/13/282/a7b
>
>