Re: database creator

[Prasanna Santhanam]

On Tue, Apr 16, 2013 at 07:33:28PM +0530, Abhinandan Prateek wrote:
> 
> I have some queries regarding Database Creator:
> 
> Can this feature be tested on 4.1 ?
> 
> Could someone also provide more details on the following:
>  
> 1. Outline the exact steps that are involved in rolling upgrade procedure?
> 2. Can you confirm if rolling upgrades are specific to only upgrade
> procedure involving multiple management servers in a cluster?
> 3. Would rolling upgrades mean that there will be zero downtime for
> customers when upgrading? Are we also dealing with NOT having to restart all
> system Vms ? Currently restarting system Vms is part of our upgrade
> procedure.
> 
Rohit has written most of the design goals and implementation in the
wiki:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Database+Creator

The term 'rolling upgrade' might be loaded here. I don't see anything
in the spec/code that guarantees that no downtime is reqd. It only
alters the way upgrades are done - sticking to a base schema at 4.0
and doing incremental upgrades from there.

-- 
Prasanna.,

RE: Review Request: CLOUDSTACK-1966 Primary Storage Limits are not validated while deploying the VM

[Sanjay Tripathi]

Nitin,
Sailaja is testing this feature and I think she covered all the possible 
operations related to this feature in the Test cases she shared with the 
community.

--Sanjay

> -Original Message-
> From: Nitin Mehta
> Sent: Wednesday, April 17, 2013 12:12 PM
> To: dev@cloudstack.apache.org; Sanjay Tripathi; Sateesh Chodapuneedi; Min
> Chen; Devdeep Singh
> Cc: cloudstack
> Subject: Re: Review Request: CLOUDSTACK-1966 Primary Storage Limits are
> not validated while deploying the VM
> 
> Probably not a bad time to ask if we have put in this check in all the
> operations - can you please enlist it ?
> 
> On 16/04/13 5:17 PM, "Sanjay Tripathi"  wrote:
> 
> >
> >---
> >This is an automatically generated e-mail. To reply, visit:
> >https://reviews.apache.org/r/10541/
> >---
> >
> >Review request for cloudstack, Devdeep Singh, Sateesh Chodapuneedi, and
> >Min Chen.
> >
> >
> >Description
> >---
> >
> >CLOUDSTACK-1966 Primary Storage Limits are not validated while
> >deploying the VM.
> >
> >
> >This addresses bug CLOUDSTACK-1966.
> >
> >
> >Diffs
> >-
> >
> >  server/src/com/cloud/vm/UserVmManagerImpl.java d281e5b
> >
> >Diff: https://reviews.apache.org/r/10541/diff/
> >
> >
> >Testing
> >---
> >
> >Tests:
> >1. Create a user account.
> >2. Set the primary storage limit for this user account to 2GiB.
> >3. Log into the user account.
> >4. Deploy instance with template size > 2GiB 5. CloudStack displays the
> >appropriate error message.
> >
> >
> >Thanks,
> >
> >Sanjay Tripathi
> >

Re: strange output on cs4.0.1 gui when restarted

[Sebastien Goasguen]

Jason,

Just to clarify, you only saw this in the global settings page ?
The rest of the UI is fine ?

thanks

-sebastien

On Apr 16, 2013, at 1:12 PM, Jason Pavao  wrote:

> Sure! It'll be my first bug! Exciting!
> 
> Issue CLOUDSTACK-2050 - encode.api.response in global settings when set to 
> true will create garbled % output int he gui and json output has been 
> successfully created.
> 
> Yay!
> 
> Thanks again for all help.
> -jason
> 
> On 4/16/2013 10:03 AM, David Nalley wrote:
>> On Tue, Apr 16, 2013 at 12:16 PM, Jason Pavao  wrote:
>>> Thanks Sebastian for checking in with me.
>>> 
>>> It turned out that I or one of my jenkins users switched-
>>> encode.api.response in global settings from false to true
>>> 
>>> This caused all that garbled output. Once we set it back and performed a
>>> reboot of the management server, we were back in business.
>>> 
>>> What is the purpose of encode.api.response ? I found no documentation on
>>> it's use/functionality.
>>> 
>>> Thanks again to everyone on the lists for the assistance!
>>> -jason
>>> 
>> 
>> Sounds like a bug - do you mind filing it?
>> http://issues.apache.org/jira
>> 
>> --David
> 
> -- 
> Thanks.
> -Jason
> 

[QA][PROPOSAL][ACS4.2] Test plan review: "Storage Backup Object Store Plugin Framework"

[Sanjeev Neelarapu]

Hi,

Test plan for the feature "Storage Backup Object Store Plugin Framework" is 
developed and placed @ 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Storage_Backup_ObjectStore_Plugin_TestPlan
Please review and let me know your comments.

Test cases are mentioned in excel sheet named "ObjectStoreTestPlan.xlsx" 
attached to the page.
Reference to FS link also given in the page.


Thanks,
Sanjeev

Re: [DOCS][TRANSLATIONS] Upate

[Sebastien Goasguen]

On Apr 16, 2013, at 11:10 AM, Milamber  wrote:

> 
> 
> Le 16/04/2013 13:41, Gavin Lee a ecrit :
>> Yes, Traditional Chinese moving very quickly.
>> Hopefully, the other languages can have more contributors.
>> 
>> For the UI part, I saw the characters are not recognizable (browser
>> encoding setting: auto detect&  Unicode UTF-8):
>> ja: http://snag.gy/AVsbU.jpg
>> zh_CN: http://snag.gy/MxbBS.jpg
> This screenshots shows some characters with a incorrect encoding (try to 
> display a char as a ISO-8859-1 (or japanese charset) but the encoding is a 
> UTF-8, I think)
> 
> With Sebgoa, we have correct all UI ressource file to have only one encoding 
> charset in this files (ASCII with unicode). The transifex data isn't 
> up-to-date.
> 
> Sebgoa, I think we must upload the last version of this (all) resources files 
> (except FR already done) from branch 4.1 to transifex.
> The last version of resources files is ASCII with unicode for *all chars* in 
> each file, and now transifex keep the unicode char (check with FR download 
> for use)

The way the original workflow was:
-Upload new versions of the resources file in english
-Translators create a new language in transifex.
-Download new language resources file 
-Fix encoding

So I never uploaded the language specific resource file to transifex. Won't we 
have a problem that they won't stay in sync with the en-US resource file, if it 
gets changed ?

In any case I uploaded the ja-JP resource file and the result on transifex is 
less than optimal, check the unreviewed strings, there is a mix of encoding.


> 
> Milamber
> 
> 
> 
> 
>> The other languages are ok.
>> 
>> 
>> On Tue, Apr 16, 2013 at 8:25 PM, Sebastien Goasguenwrote:
>> 
>>> Hi,
>>> 
>>> There has been some terrific progress on the translations.
>>> 
>>> The easiest way to share it is to check the Transifex dashboard, below are
>>> some screenshots:
>>> 
>>> The runbook:
>>> http://awesomescreenshot.com/0bd163zldd
>>> 
>>> The UI:
>>> http://awesomescreenshot.com/089163zva2
>>> 
>>> The entire docs set:
>>> http://awesomescreenshot.com/01c163zq63
>>> 
>>> Since 4.1 is not out yet, there is time to finish those last 3% on the UI
>>> translations.
>>> 
>>> Keep getting the word out, forward to friends and let's all make
>>> CloudStack a truly worldwide project.
>>> 
>>> Cheers,
>>> 
>>> -Sebastien
>> 
>> 
>> 
> 

Re: apidocs build failing on master?

[Prasanna Santhanam]

On Tue, Apr 16, 2013 at 03:09:39PM -0700, Vijayendra Bhamidipati wrote:
> Hi,
> 
> I'm running into the following error when trying mvn install -P 
> developer,systemvm -Dnonoss  on top of master:
> 
> 
> [INFO] 
> 
> [INFO] Building Apache CloudStack apidocs 4.2.0-SNAPSHOT
> [INFO] 
> 
> [INFO]
> [INFO] --- maven-remote-resources-plugin:1.3:process (default) @ cloud-apidoc 
> ---
> [INFO]
> [INFO] --- exec-maven-plugin:1.2.1:exec (compile) @ cloud-apidoc ---
> Check, is this api part of another build profile? Null value for key: 
> addBaremetalHost preProcessedCommand=1
> Traceback (most recent call last):
>   File 
> "/root/mywork/cloudstack/asf/latest/cloudstack/tools/apidoc/gen_toc.py", line 
> 173, in 
> category = choose_category(fn)
>   File 
> "/root/mywork/cloudstack/asf/latest/cloudstack/tools/apidoc/gen_toc.py", line 
> 153, in choose_category
> (fn, __file__))
> Exception: Need to add a category for listCiscoVnmcResources.xml to 
> /root/mywork/cloudstack/asf/latest/cloudstack/tools/apidoc/gen_toc.py:known_categories
> [INFO] 
> 
> [INFO] Reactor Summary:
> 
> 
Fixed.

-- 
Prasanna.,

Re: Add/Remove Network for VM : VMware Support

[Saksham Srivastava]

FS is available at :
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Add+Remove+Networks+to+VMs+%28Enhanced%29

Thanks,
Saksham

On Monday 15 April 2013 11:11 PM, Saksham Srivastava wrote:
> Following the discussion on bug: 
> https://issues.apache.org/jira/browse/CLOUDSTACK-645 , there needs to be some 
> work done for enhancing  VMware support for the feature Add/Remove Network on 
> VM.
>
> I will be updating the FS soon and will send out for review.
>
> Thanks,
> Saksham
>

Connection to http://repo.maven.apache.org refused

[Denic]

Escuxe me Rohit recently I have problems building CS4.1 branch, 
when I pull on 04.16. I got this error: 
WARNING] The requested profile "deps" could not be activated because it does 
not exist. 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-remote-resources-plugin:1.3:process (default) on 
project cloud-client-ui: Error resolving project artifact: Could not transfer 
artifact org.libvirt:libvirt:pom:0.4.9 from/to central 
(http://repo.maven.apache.org/maven2): Connection to 
http://repo.maven.apache.org refused for project org.libvirt:libvirt:jar:0.4.9: 
Connection timed out -> [Help 1]. 

Today(04.17.) I pull and try again to build and ended at even earlier point: 
[INFO] Apache CloudStack Usage Server  FAILURE [1:03.454s] 
SKIPED. 
. 
. 
[ERROR] Failed to execute goal on project cloud-usage: Could not resolve 
dependencies for project org.apache.cloudstack:cloud-usage:jar:4.1.0-SNAPSHOT: 
Failed to collect dependencies for 
[org.apache.cloudstack:cloud-server:jar:4.1.0-SNAPSHOT (compile), 
mysql:mysql-connector-java:jar:5.1.21 (runtime), 
commons-daemon:commons-daemon:jar:1.0.10 (compile), junit:junit:jar:4.10 
(test), org.springframework:spring-core:jar:3.1.2.RELEASE (compile), 
org.springframework:spring-context:jar:3.1.2.RELEASE (compile), 
org.springframework:spring-web:jar:3.1.2.RELEASE (compile), 
org.mockito:mockito-all:jar:1.9.5 (test), 
org.springframework:spring-test:jar:3.1.2.RELEASE (test), 
org.aspectj:aspectjrt:jar:1.7.1 (compile), org.aspectj:aspectjweaver:jar:1.7.1 
(compile), javax.inject:javax.inject:jar:1 (compile)]: Failed to read artifact 
descriptor for commons-daemon:commons-daemon:jar:1.0.10: Could not transfer 
artifact commons-daemon:commons-daemon:pom:1.0.10 from/to central 
(http://repo.maven.apache.org/maven2): Connection to 
http://repo.maven.apache.org refused: Connection timed out -> [Help 1] 

What could be wrong? 
Thank you, regards. 

Re: Review Request: CLOUDSTACK-1966 Primary Storage Limits are not validated while deploying the VM

[Nitin Mehta]

I see thanks Sanjay.
When you see a bug in your area its generally a good practice to see
holistically something similar you missed while feature development :).

On 17/04/13 12:41 PM, "Sanjay Tripathi"  wrote:

>Nitin,
>Sailaja is testing this feature and I think she covered all the possible
>operations related to this feature in the Test cases she shared with the
>community.
>
>--Sanjay
>
>> -Original Message-
>> From: Nitin Mehta
>> Sent: Wednesday, April 17, 2013 12:12 PM
>> To: dev@cloudstack.apache.org; Sanjay Tripathi; Sateesh Chodapuneedi;
>>Min
>> Chen; Devdeep Singh
>> Cc: cloudstack
>> Subject: Re: Review Request: CLOUDSTACK-1966 Primary Storage Limits are
>> not validated while deploying the VM
>> 
>> Probably not a bad time to ask if we have put in this check in all the
>> operations - can you please enlist it ?
>> 
>> On 16/04/13 5:17 PM, "Sanjay Tripathi" 
>>wrote:
>> 
>> >
>> >---
>> >This is an automatically generated e-mail. To reply, visit:
>> >https://reviews.apache.org/r/10541/
>> >---
>> >
>> >Review request for cloudstack, Devdeep Singh, Sateesh Chodapuneedi, and
>> >Min Chen.
>> >
>> >
>> >Description
>> >---
>> >
>> >CLOUDSTACK-1966 Primary Storage Limits are not validated while
>> >deploying the VM.
>> >
>> >
>> >This addresses bug CLOUDSTACK-1966.
>> >
>> >
>> >Diffs
>> >-
>> >
>> >  server/src/com/cloud/vm/UserVmManagerImpl.java d281e5b
>> >
>> >Diff: https://reviews.apache.org/r/10541/diff/
>> >
>> >
>> >Testing
>> >---
>> >
>> >Tests:
>> >1. Create a user account.
>> >2. Set the primary storage limit for this user account to 2GiB.
>> >3. Log into the user account.
>> >4. Deploy instance with template size > 2GiB 5. CloudStack displays the
>> >appropriate error message.
>> >
>> >
>> >Thanks,
>> >
>> >Sanjay Tripathi
>> >
>

Re: database creator

[Abhinandan Prateek]

On 17/04/13 12:33 PM, "Prasanna Santhanam"  wrote:

>On Tue, Apr 16, 2013 at 07:33:28PM +0530, Abhinandan Prateek wrote:
>> 
>> I have some queries regarding Database Creator:
>> 
>> Can this feature be tested on 4.1 ?
>> 
>> Could someone also provide more details on the following:
>>  
>> 1. Outline the exact steps that are involved in rolling upgrade
>>procedure?
>> 2. Can you confirm if rolling upgrades are specific to only upgrade
>> procedure involving multiple management servers in a cluster?
>> 3. Would rolling upgrades mean that there will be zero downtime for
>> customers when upgrading? Are we also dealing with NOT having to
>>restart all
>> system Vms ? Currently restarting system Vms is part of our upgrade
>> procedure.
>> 
>Rohit has written most of the design goals and implementation in the
>wiki:
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Database+Creator
>
>The term 'rolling upgrade' might be loaded here. I don't see anything
>in the spec/code that guarantees that no downtime is reqd. It only
>alters the way upgrades are done - sticking to a base schema at 4.0
>and doing incremental upgrades from there.

Also what exactly does no downtime means ? Is it just that the one of the
MS in the cluster will be running providing minimal services during
upgrade Or that there will be no disruption of services.

We also need to figure out who db locking by running MS may have its
affect on running db upgrades.

>
>-- 
>Prasanna.,

Re: Create rbd primary storage fail in CS 4.0.1

[Wido den Hollander]

Hi,

On 04/17/2013 01:44 AM, Guangjian Liu wrote:

Create rbd primary storage fail in CS 4.0.1
Anybody can help about it!

Environment:
1. Server A: CS 4.0.1 OS: RHEL 6.2 x86-64
2. Server B: Ceph 0.56.4  OS: RHEL 6.2 x86-64
3. Server C: KVM/Qemu OS: Ubuntu 12.04
 compile libvirt and Qemu as document
root@ubuntu:/usr/local/lib# virsh version
Compiled against library: libvirt 0.10.2
Using library: libvirt 0.10.2
Using API: QEMU 0.10.2
Running hypervisor: QEMU 1.0.0



Are you sure both libvirt and Qemu are compiled with RBD enabled?

On your CentOS system you should make sure librbd-dev is installed 
during compilation of libvirt and Qemu.


The most important part is the RBD storage pool support in libvirt, that 
should be enabled.


In the e-mail you send me directly I saw this:

root@ubuntu:~/scripts# virsh pool-define rbd-pool.xml error: Failed to 
define pool from rbd-pool.xml error: internal error missing backend for 
pool type 8


That suggest RBD storage pool support is not enabled in libvirt.

Wido


Problem:
create primary storage fail with rbd device.

Fail log:
2013-04-16 16:27:14,224 DEBUG [cloud.storage.StorageManagerImpl]
(catalina-exec-9:null) createPool Params @ scheme - rbd storageHost -
10.0.0.41 hostPath - /cloudstack port - -1
2013-04-16 16:27:14,270 DEBUG [cloud.storage.StorageManagerImpl]
(catalina-exec-9:null) In createPool Setting poolId - 218 uuid -
5924a2df-d658-3119-8aba-f90307683206 zoneId - 4 podId - 4 poolName - ceph
2013-04-16 16:27:14,318 DEBUG [cloud.storage.StorageManagerImpl]
(catalina-exec-9:null) creating pool ceph on  host 18
2013-04-16 16:27:14,320 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162275: Sending  { Cmd , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 100011,
[{"CreateStoragePoolCommand":{"add":true,"pool":{"id":218,"uuid":"5924a2df-d658-3119-8aba-f90307683206","host":"10.0.0.41","path":"cloudstack","userInfo":":","port":6789,"type":"RBD"},"localPath":"/mnt//3cf4f0e8-781d-39d8-b81c-9896da212335","wait":0}}]
}
2013-04-16 16:27:14,323 DEBUG [agent.transport.Request]
(AgentManager-Handler-2:null) Seq 18-1625162275: Processing:  { Ans: ,
MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10,
[{"Answer":{"result":true,"details":"success","wait":0}}] }
2013-04-16 16:27:14,323 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162275: Received:  { Ans: , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 10, { Answer } }
2013-04-16 16:27:14,323 DEBUG [agent.manager.AgentManagerImpl]
(catalina-exec-9:null) Details from executing class
com.cloud.agent.api.CreateStoragePoolCommand: success
2013-04-16 16:27:14,323 DEBUG [cloud.storage.StorageManagerImpl]
(catalina-exec-9:null) In createPool Adding the pool to each of the hosts
2013-04-16 16:27:14,323 DEBUG [cloud.storage.StorageManagerImpl]
(catalina-exec-9:null) Adding pool ceph to  host 18
2013-04-16 16:27:14,326 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162276: Sending  { Cmd , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 100011,
[{"ModifyStoragePoolCommand":{"add":true,"pool":{"id":218,"uuid":"5924a2df-d658-3119-8aba-f90307683206","host":"10.0.0.41","path":"cloudstack","userInfo":":","port":6789,"type":"RBD"},"localPath":"/mnt//3cf4f0e8-781d-39d8-b81c-9896da212335","wait":0}}]
}
2013-04-16 16:27:14,411 DEBUG [agent.transport.Request]
(AgentManager-Handler-6:null) Seq 18-1625162276: Processing:  { Ans: ,
MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10,
[{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat
com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat
com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.createStoragePool(KVMStoragePoolManager.java:57)\n\tat
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2087)\n\tat
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1053)\n\tat
com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat
com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat
com.cloud.utils.nio.Task.run(Task.java:83)\n\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)\n\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat
java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
2013-04-16 16:27:14,412 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162276: Received:  { Ans: , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 10, { Answer } }
2013-04-16 16:27:14,412 DEBUG [agent.manager.AgentManagerImpl]
(catalina-exec-9:null) Details from executing class
com.cloud.agent.api.ModifyStoragePoolCommand: java.lang.NullPointerException
 at
com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
 at
com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.createStoragePool(KVMStoragePoolMan

Re: [PROPOSAL] [CLOUDSTACK-2056] DeploymentPlanner choice via ServiceOffering

[Nitin Mehta]

Thanks for sharing this with the community Prachi. I read the wiki and had
a few questions.

Is there a requirement doc for this ? I wanted to understand the use cases
for this.

Since all the attributes are visible in service offering to the end user
what is it we are trying to do here ? Give the flexibility to the end user
? Ideally it should give more flexibility to the admin right ?

You talked about the vm.allocation.algorithms but talking about the
planners so I am little confused what is that we are trying to do here.

I see that Hari also proposed changing vm allocation config to zone level.
Is that required any more with this change ?

I didn't understand "in a CS deployment multiple planners will have to
co-exist." bit can you please elaborate with an example here ?

Thanks,
-Nitin

On 17/04/13 5:10 AM, "Prachi Damle"  wrote:

>I would like to propose a new feature - DeploymentPlanner choice via
>ServiceOffering
>
>Jira ticket created: https://issues.apache.org/jira/browse/CLOUDSTACK-2056
>
>This is to expose the choice of Deployment Planner via Service Offering
>and let Admin use a mix of Planners in a CS deployment.
>
>The initial draft of the FS is here
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/DeploymentPlanner+c
>hoice+via+ServiceOffering
>
>Please review and comment.
>
>Thanks,
>Prachi

Re: [ACS42][QA]Issues with latest Master Build (Xenserver)

[Abhinandan Prateek]

On 17/04/13 12:28 PM, "Prasanna Santhanam"  wrote:

>On Tue, Apr 16, 2013 at 04:33:40PM -0700, Sangeetha Hariharan wrote:
>> I am not able to start user Vms successfully using the build from
>>master. I am testing with Xenserver 6.0.2 hosts.
>> User Vm starts successfully but it gets to stopped state after few
>>seconds.
>> 
>> deployVM reports success . But later on  cluster sync sees this Vm
>> in stopped state and sends a StopCommand for this VM.
>
>It's not clustersync from the logs really. Something is going wrong on
>your xenserver. I've seen this happen when the VM deployed has mem
>limits outside the static-max and static-min defined by xenserver. So
>anything below 64MB memory starts and then stops. Not sure if that's
>the case with your deployed VM.

ClusterSync in this case is only detecting that the Vms are stopped on
Hypervisor and issues a stop command to clean up the state.
It will be a good idea to monitor your Xenserver using Xencenter to see if
the Vms are really getting stopped outside etc.
I am assuming that you are not running a cluster of management servers ?

-abhi

>
>
>-- 
>Prasanna., 

Re: [RFC][FS]PVLAN for isolation within a VLAN

[Murali Reddy]

Sheng,

Thanks for the FS. Couple of points in FS that made me curious of the
rational behind it.

Why do you want to all the end user VM's (except for DHCP server VM) in
shared network to be connected only to I-port's. This means that even VM's
of same user can not talk to each other, right? Is'nt it too restrictive?
How about having community secondary VLAN per user with which they gets
the isolation and their VM's can talk to each other? Only down side is
there is additional effort of managing pool of secondary community VLAN's
or there are other challenges?

Approach proposed for Xen and KVM which does not support PVLAN is
interesting. So do you expect the admin to setup these flows on each
KVM/Xen hypervisor? Or CloudStack will be responsible for set-up of flow
tables as well?

Thanks.


On 17/04/13 5:01 AM, "Sheng Yang"  wrote:

>Hi all,
>
>I am current working on a new mechanism to archive isolation for advance
>shared network. It took advantage of PVLAN feature of Cisco switch, to
>achieve isolation using a simpler way.
>
>Here is the FS. You probably need to read references(in the link) to get
>an
>idea of PVLAN first.
>
>https://cwiki.apache.org/CLOUDSTACK/pvlan-for-isolation-within-a-vlan.html
>
>Thanks!
>
>--Sheng
>

Re: Create rbd primary storage fail in CS 4.0.1

[Guangjian Liu]

Thanks for your mail, you suggest compile libvirt with RBD enable.
I already build libvirt-0.10.2.tar.gz as document
http://ceph.com/docs/master/rbd/libvirt/ in my SERVER C(Ubuntu 12.04),
 Shall I build libvirt-0.10.2.tar.gz with RBD enable?  use ./configure
--enable-rbd instead autogen.sh?

cd libvirt
./autogen.sh
make
sudo make install



On Wed, Apr 17, 2013 at 4:37 PM, Wido den Hollander  wrote:

> Hi,
>
>
> On 04/17/2013 01:44 AM, Guangjian Liu wrote:
>
>> Create rbd primary storage fail in CS 4.0.1
>> Anybody can help about it!
>>
>> Environment:
>> 1. Server A: CS 4.0.1 OS: RHEL 6.2 x86-64
>> 2. Server B: Ceph 0.56.4  OS: RHEL 6.2 x86-64
>> 3. Server C: KVM/Qemu OS: Ubuntu 12.04
>>  compile libvirt and Qemu as document
>> root@ubuntu:/usr/local/lib# virsh version
>> Compiled against library: libvirt 0.10.2
>> Using library: libvirt 0.10.2
>> Using API: QEMU 0.10.2
>> Running hypervisor: QEMU 1.0.0
>>
>>
> Are you sure both libvirt and Qemu are compiled with RBD enabled?
>
> On your CentOS system you should make sure librbd-dev is installed during
> compilation of libvirt and Qemu.
>
> The most important part is the RBD storage pool support in libvirt, that
> should be enabled.
>
> In the e-mail you send me directly I saw this:
>
> root@ubuntu:~/scripts# virsh pool-define rbd-pool.xml error: Failed to
> define pool from rbd-pool.xml error: internal error missing backend for
> pool type 8
>
> That suggest RBD storage pool support is not enabled in libvirt.
>
> Wido
>
>
>  Problem:
>> create primary storage fail with rbd device.
>>
>> Fail log:
>> 2013-04-16 16:27:14,224 DEBUG [cloud.storage.**StorageManagerImpl]
>> (catalina-exec-9:null) createPool Params @ scheme - rbd storageHost -
>> 10.0.0.41 hostPath - /cloudstack port - -1
>> 2013-04-16 16:27:14,270 DEBUG [cloud.storage.**StorageManagerImpl]
>> (catalina-exec-9:null) In createPool Setting poolId - 218 uuid -
>> 5924a2df-d658-3119-8aba-**f90307683206 zoneId - 4 podId - 4 poolName -
>> ceph
>> 2013-04-16 16:27:14,318 DEBUG [cloud.storage.**StorageManagerImpl]
>> (catalina-exec-9:null) creating pool ceph on  host 18
>> 2013-04-16 16:27:14,320 DEBUG [agent.transport.Request]
>> (catalina-exec-9:null) Seq 18-1625162275: Sending  { Cmd , MgmtId:
>> 37528005876872, via: 18, Ver: v1, Flags: 100011,
>> [{"CreateStoragePoolCommand":{**"add":true,"pool":{"id":218,"**
>> uuid":"5924a2df-d658-3119-**8aba-f90307683206","host":"10.**
>> 0.0.41","path":"cloudstack","**userInfo":":","port":6789,"**
>> type":"RBD"},"localPath":"/**mnt//3cf4f0e8-781d-39d8-b81c-**
>> 9896da212335","wait":0}}]
>> }
>> 2013-04-16 16:27:14,323 DEBUG [agent.transport.Request]
>> (AgentManager-Handler-2:null) Seq 18-1625162275: Processing:  { Ans: ,
>> MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10,
>> [{"Answer":{"result":true,"**details":"success","wait":0}}] }
>> 2013-04-16 16:27:14,323 DEBUG [agent.transport.Request]
>> (catalina-exec-9:null) Seq 18-1625162275: Received:  { Ans: , MgmtId:
>> 37528005876872, via: 18, Ver: v1, Flags: 10, { Answer } }
>> 2013-04-16 16:27:14,323 DEBUG [agent.manager.**AgentManagerImpl]
>> (catalina-exec-9:null) Details from executing class
>> com.cloud.agent.api.**CreateStoragePoolCommand: success
>> 2013-04-16 16:27:14,323 DEBUG [cloud.storage.**StorageManagerImpl]
>> (catalina-exec-9:null) In createPool Adding the pool to each of the hosts
>> 2013-04-16 16:27:14,323 DEBUG [cloud.storage.**StorageManagerImpl]
>> (catalina-exec-9:null) Adding pool ceph to  host 18
>> 2013-04-16 16:27:14,326 DEBUG [agent.transport.Request]
>> (catalina-exec-9:null) Seq 18-1625162276: Sending  { Cmd , MgmtId:
>> 37528005876872, via: 18, Ver: v1, Flags: 100011,
>> [{"ModifyStoragePoolCommand":{**"add":true,"pool":{"id":218,"**
>> uuid":"5924a2df-d658-3119-**8aba-f90307683206","host":"10.**
>> 0.0.41","path":"cloudstack","**userInfo":":","port":6789,"**
>> type":"RBD"},"localPath":"/**mnt//3cf4f0e8-781d-39d8-b81c-**
>> 9896da212335","wait":0}}]
>> }
>> 2013-04-16 16:27:14,411 DEBUG [agent.transport.Request]
>> (AgentManager-Handler-6:null) Seq 18-1625162276: Processing:  { Ans: ,
>> MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10,
>> [{"Answer":{"result":false,"**details":"java.lang.**
>> NullPointerException\n\tat
>> com.cloud.hypervisor.kvm.**storage.LibvirtStorageAdaptor.**
>> createStoragePool(**LibvirtStorageAdaptor.java:**462)\n\tat
>> com.cloud.hypervisor.kvm.**storage.KVMStoragePoolManager.**
>> createStoragePool(**KVMStoragePoolManager.java:57)**\n\tat
>> com.cloud.hypervisor.kvm.**resource.**LibvirtComputingResource.**execute(
>> **LibvirtComputingResource.java:**2087)\n\tat
>> com.cloud.hypervisor.kvm.**resource.**LibvirtComputingResource.**
>> executeRequest(**LibvirtComputingResource.java:**1053)\n\tat
>> com.cloud.agent.Agent.**processRequest(Agent.java:518)**\n\tat
>> com.cloud.agent.Agent$**AgentRequestHandler.doTask(**
>> Agent.java:831)\n\tat
>> com.cloud.utils.nio.Task.run(**Task.java:83)\n\tat
>> java.util.concurrent.**ThreadPoolExecutor.run

RE: [ACS42][QA]Issues with latest Master Build (Xenserver)

[Suresh Sadhu]

Me too not seen issues with Xen6.1 with latest templates. Able to deploy VMs 
and VMs are up and running state. Build number 219


Regards
Sadhu




-Original Message-
From: Sailaja Mada [mailto:sailaja.m...@citrix.com] 
Sent: 17 April 2013 12:21
To: dev@cloudstack.apache.org
Subject: RE: [ACS42][QA]Issues with latest Master Build (Xenserver)

Hi,

My instances are running with no issues. I am using Xen 6.1 host.

Thanks,
Sailaja.M

-Original Message-
From: Sangeetha Hariharan [mailto:sangeetha.hariha...@citrix.com] 
Sent: Wednesday, April 17, 2013 5:04 AM
To: dev@cloudstack.apache.org
Subject: RE: [ACS42][QA]Issues with latest Master Build (Xenserver)

I am not able to start user Vms successfully using the build from master. I am 
testing with Xenserver 6.0.2 hosts.
User Vm starts successfully but it gets to stopped state after few seconds.

deployVM reports success . But later on  cluster sync sees this Vm in stopped 
state and sends a StopCommand for this VM.

Is anyone seeing this issue?

Management server logs:

2013-04-16 16:21:13,805 DEBUG [xen.resource.CitrixResourceBase] 
(DirectAgent-21:null) 2. The VM i-2-10-VM is in Running state.
2013-04-16 16:21:13,806 DEBUG [agent.manager.DirectAgentAttache] 
(DirectAgent-21:null) Seq 5-1032650792: Response Received:
2013-04-16 16:21:13,806 DEBUG [agent.transport.Request] (DirectAgent-21:null) 
Seq 5-1032650792: Processing:  { Ans: , MgmtId: 7508777239729, via: 5, Ver: v1, 
Flags: 110, [ 
{"StartAnswer":{"vm":{"id":10,"name":"i-2-10-VM","bootloader":"PyGrub","type":"User","cpus":1,"minSpeed":100,"maxSpeed":100,"minRam":130023424,"maxRam":130023424,"arch":"x
86_64","os":"CentOS 5.3 
(64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"vncPassword":"10394489c81710b9","params":{},"uuid":"c0c0ee3a-af
91-4595-a1a3-4c3317489a03","disks":[{"id":10,"name":"ROOT-10","mountPoint":"/export/home/sangeetha/asf42-2/primary2","path":"eeeccffd-a86d-44ec-89f0-0e7923712ac2","size":8
589934592,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"f483cba6-d7e9-38ad-ad5f-4c4971a2b06f","deviceId":0},{"id":10,"name":"test-123","size":0,"t
ype":"ISO","storagePoolType":"ISO","deviceId":3}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"c726c8bf-3d17-4d9b-bae1-3e885461e4ab","ip":"10.1.1.
224","netmask":"255.255.255.0","gateway":"10.1.1.1","mac":"02:00:1a:b3:00:06","dns1":"72.52.126.11","dns2":"72.52.126.12","broadcastType":"Vlan","type":"Guest","broadcastU
ri":"vlan://2090","isolationUri":"vlan://2090","isSecurityGroupEnabled":false}]},"result":true,"wait":0}}]
 }
2013-04-16 16:21:13,806 DEBUG [agent.transport.Request] (Job-Executor-3:job-39) 
Seq 5-1032650792: Received:  { Ans: , MgmtId: 7508777239729, via: 5, Ver: v1, 
Flags: 110, {  StartAnswer } }
2013-04-16 16:21:13,808 DEBUG [agent.manager.AgentAttache] 
(DirectAgent-21:null) Seq 5-1032650792: No more commands found
2013-04-16 16:21:13,838 DEBUG [cloud.network.NetworkModelImpl] 
(Job-Executor-3:job-39) Service SecurityGroup is not supported in the network 
id=205
2013-04-16 16:21:13,841 DEBUG [cloud.network.NetworkModelImpl] 
(Job-Executor-3:job-39) Service SecurityGroup is not supported in the network 
id=205
2013-04-16 16:21:13,846 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-3:job-39) VM state transitted from :Starting to Running with 
event: OperationSucceededvm's  original host id: 5 new host id: 5 host id 
before state transition: 5
2013-04-16 16:21:13,846 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(Job-Executor-3:job-39) Start completed for VM VM[User|again]


2013-04-16 16:22:04,873 DEBUG [agent.manager.AgentManagerImpl] 
(AgentManager-Handler-14:null) Ping from 4
2013-04-16 16:22:08,511 DEBUG [agent.manager.DirectAgentAttache] 
(DirectAgent-60:null) Ping from 5
2013-04-16 16:22:08,637 DEBUG [agent.manager.DirectAgentAttache] 
(DirectAgent-61:null) Ping from 1
2013-04-16 16:22:09,046 DEBUG [agent.manager.DirectAgentAttache] 
(DirectAgent-9:null) Seq 5-1032650756: Executing request
2013-04-16 16:22:09,289 WARN  [xen.resource.CitrixResourceBase] 
(DirectAgent-9:null) The VM is now missing marking it as Stopped i-2-10-VM
2013-04-16 16:22:09,290 DEBUG [agent.manager.DirectAgentAttache] 
(DirectAgent-9:null) Seq 5-1032650756: Response Received:
2013-04-16 16:22:09,290 DEBUG [agent.transport.Request] (DirectAgent-9:null) 
Seq 5-1032650756: Processing:  { Ans: , MgmtId: 7508777239729, via: 5, Ver: v1, 
Flags: 10, 
[{"ClusterSyncAnswer":{"_clusterId":2,"_newStates":{"i-2-10-VM":{"t":"b8f8a7e3-a6af-499f-9168-94691ca06b20","u":"Stopped"}},"_isExecuted":false,"result":true,"wait":0}}]
 }
2013-04-16 16:22:09,294 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(DirectAgent-9:null) VM i-2-10-VM: cs state = Running and realState = Stopped
2013-04-16 16:22:09,294 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(DirectAgent-9:null) VM i-2-10-VM: cs state = Running and realState = Stopped
2013-04-16 16:22:09,294 DEBUG [cloud.ha.HighAvailabilityM

Re: Review Request: CLOUDSTACL-2046 Primary Storage & Secondary Storage is max limit is set 0 with listResourceLimits API response as ROOT admin

[Devdeep Singh]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10566/#review19312
---

Ship it!


Ship It!

- Devdeep Singh


On April 17, 2013, 6:38 a.m., Sanjay Tripathi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10566/
> ---
> 
> (Updated April 17, 2013, 6:38 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh and Sateesh Chodapuneedi.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-2046 Primary Storage & Secondary Storage is max limit is set 0 
> with listResourceLimits API response as ROOT admin 
> 
> 
> This addresses bug CLOUDSTACK-2046.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/api/ApiResponseHelper.java cfe0e00 
> 
> Diff: https://reviews.apache.org/r/10566/diff/
> 
> 
> Testing
> ---
> 
> Tests:
> 1. Log into CloudStack as Root Admin.
> 2. Navigate to Accounts tab and then click on Admin account to open account 
> detail view.
> 3. The limits for Primary & Secondary storage space are displaying as "-1" 
> i.e. Unlimited (initially it was displaying Zero).
> 
> 
> Thanks,
> 
> Sanjay Tripathi
> 
>

Re: Review Request: CLOUDSTACL-2046 Primary Storage & Secondary Storage is max limit is set 0 with listResourceLimits API response as ROOT admin

[Devdeep Singh]

> On April 17, 2013, 10:20 a.m., Devdeep Singh wrote:
> > Ship It!

Someone with the right karma should commit this change.


- Devdeep


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10566/#review19312
---


On April 17, 2013, 6:38 a.m., Sanjay Tripathi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10566/
> ---
> 
> (Updated April 17, 2013, 6:38 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh and Sateesh Chodapuneedi.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-2046 Primary Storage & Secondary Storage is max limit is set 0 
> with listResourceLimits API response as ROOT admin 
> 
> 
> This addresses bug CLOUDSTACK-2046.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/api/ApiResponseHelper.java cfe0e00 
> 
> Diff: https://reviews.apache.org/r/10566/diff/
> 
> 
> Testing
> ---
> 
> Tests:
> 1. Log into CloudStack as Root Admin.
> 2. Navigate to Accounts tab and then click on Admin account to open account 
> detail view.
> 3. The limits for Primary & Secondary storage space are displaying as "-1" 
> i.e. Unlimited (initially it was displaying Zero).
> 
> 
> Thanks,
> 
> Sanjay Tripathi
> 
>

Re: database creator

[Prasanna Santhanam]

On Wed, Apr 17, 2013 at 02:07:20PM +0530, Abhinandan Prateek wrote:
> On 17/04/13 12:33 PM, "Prasanna Santhanam"  wrote:
> 
> >On Tue, Apr 16, 2013 at 07:33:28PM +0530, Abhinandan Prateek wrote:
> >> 
> >> I have some queries regarding Database Creator:
> >> 
> >> Can this feature be tested on 4.1 ?
> >> 
> >> Could someone also provide more details on the following:
> >>  
> >> 1. Outline the exact steps that are involved in rolling upgrade
> >>procedure?
> >> 2. Can you confirm if rolling upgrades are specific to only upgrade
> >> procedure involving multiple management servers in a cluster?
> >> 3. Would rolling upgrades mean that there will be zero downtime for
> >> customers when upgrading? Are we also dealing with NOT having to
> >>restart all
> >> system Vms ? Currently restarting system Vms is part of our upgrade
> >> procedure.
> >> 
> >Rohit has written most of the design goals and implementation in the
> >wiki:
> >https://cwiki.apache.org/confluence/display/CLOUDSTACK/Database+Creator
> >
> >The term 'rolling upgrade' might be loaded here. I don't see anything
> >in the spec/code that guarantees that no downtime is reqd. It only
> >alters the way upgrades are done - sticking to a base schema at 4.0
> >and doing incremental upgrades from there.
> 
> Also what exactly does no downtime means ? Is it just that the one of the
> MS in the cluster will be running providing minimal services during
> upgrade Or that there will be no disruption of services.

I don't think the dbcreator right now guarantees consistency of the db
when one MS is down and the other functional. So I don't see one MS in
the cluster functional because the other was brought down while you
are tinkering the db in the background.

Besides, only the portal is down. Tenant VMs are unaffected and will
be functional in all this. SystemVMs are separate from this and
shouldn't be mixed with the db issue I think.

IMO, it's better to invest in a solution proven for the purpose of db
change management, rolling upgrades as you refer to it than building
our own. Something like liquibase, dbMaintain. That will enable easier
upgrade testing without the presence of a running management server as
well.

Thoughts?

-- 
Prasanna.,

Re: Create rbd primary storage fail in CS 4.0.1

[Wido den Hollander]

Hi,

On 04/17/2013 11:37 AM, Guangjian Liu wrote:

Thanks for your mail, you suggest compile libvirt with RBD enable.
I already build libvirt-0.10.2.tar.gz as document
http://ceph.com/docs/master/rbd/libvirt/ in my SERVER C(Ubuntu 12.04),
  Shall I build libvirt-0.10.2.tar.gz with RBD enable?  use ./configure
--enable-rbd instead autogen.sh?



Well, you don't have to add --enable-rbd to configure nor autogen.sh, 
but you have to make sure the development libraries for librbd are 
installed.


On CentOS do this:

yum install librbd-devel

And retry autogen.sh for libvirt, it should tell you RBD is enabled.

Wido


cd libvirt
./autogen.sh
make
sudo make install



On Wed, Apr 17, 2013 at 4:37 PM, Wido den Hollander  wrote:


Hi,


On 04/17/2013 01:44 AM, Guangjian Liu wrote:


Create rbd primary storage fail in CS 4.0.1
Anybody can help about it!

Environment:
1. Server A: CS 4.0.1 OS: RHEL 6.2 x86-64
2. Server B: Ceph 0.56.4  OS: RHEL 6.2 x86-64
3. Server C: KVM/Qemu OS: Ubuntu 12.04
  compile libvirt and Qemu as document
root@ubuntu:/usr/local/lib# virsh version
Compiled against library: libvirt 0.10.2
Using library: libvirt 0.10.2
Using API: QEMU 0.10.2
Running hypervisor: QEMU 1.0.0



Are you sure both libvirt and Qemu are compiled with RBD enabled?

On your CentOS system you should make sure librbd-dev is installed during
compilation of libvirt and Qemu.

The most important part is the RBD storage pool support in libvirt, that
should be enabled.

In the e-mail you send me directly I saw this:

root@ubuntu:~/scripts# virsh pool-define rbd-pool.xml error: Failed to
define pool from rbd-pool.xml error: internal error missing backend for
pool type 8

That suggest RBD storage pool support is not enabled in libvirt.

Wido


  Problem:

create primary storage fail with rbd device.

Fail log:
2013-04-16 16:27:14,224 DEBUG [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) createPool Params @ scheme - rbd storageHost -
10.0.0.41 hostPath - /cloudstack port - -1
2013-04-16 16:27:14,270 DEBUG [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) In createPool Setting poolId - 218 uuid -
5924a2df-d658-3119-8aba-**f90307683206 zoneId - 4 podId - 4 poolName -
ceph
2013-04-16 16:27:14,318 DEBUG [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) creating pool ceph on  host 18
2013-04-16 16:27:14,320 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162275: Sending  { Cmd , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 100011,
[{"CreateStoragePoolCommand":{**"add":true,"pool":{"id":218,"**
uuid":"5924a2df-d658-3119-**8aba-f90307683206","host":"10.**
0.0.41","path":"cloudstack","**userInfo":":","port":6789,"**
type":"RBD"},"localPath":"/**mnt//3cf4f0e8-781d-39d8-b81c-**
9896da212335","wait":0}}]
}
2013-04-16 16:27:14,323 DEBUG [agent.transport.Request]
(AgentManager-Handler-2:null) Seq 18-1625162275: Processing:  { Ans: ,
MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10,
[{"Answer":{"result":true,"**details":"success","wait":0}}] }
2013-04-16 16:27:14,323 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162275: Received:  { Ans: , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 10, { Answer } }
2013-04-16 16:27:14,323 DEBUG [agent.manager.**AgentManagerImpl]
(catalina-exec-9:null) Details from executing class
com.cloud.agent.api.**CreateStoragePoolCommand: success
2013-04-16 16:27:14,323 DEBUG [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) In createPool Adding the pool to each of the hosts
2013-04-16 16:27:14,323 DEBUG [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) Adding pool ceph to  host 18
2013-04-16 16:27:14,326 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162276: Sending  { Cmd , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 100011,
[{"ModifyStoragePoolCommand":{**"add":true,"pool":{"id":218,"**
uuid":"5924a2df-d658-3119-**8aba-f90307683206","host":"10.**
0.0.41","path":"cloudstack","**userInfo":":","port":6789,"**
type":"RBD"},"localPath":"/**mnt//3cf4f0e8-781d-39d8-b81c-**
9896da212335","wait":0}}]
}
2013-04-16 16:27:14,411 DEBUG [agent.transport.Request]
(AgentManager-Handler-6:null) Seq 18-1625162276: Processing:  { Ans: ,
MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10,
[{"Answer":{"result":false,"**details":"java.lang.**
NullPointerException\n\tat
com.cloud.hypervisor.kvm.**storage.LibvirtStorageAdaptor.**
createStoragePool(**LibvirtStorageAdaptor.java:**462)\n\tat
com.cloud.hypervisor.kvm.**storage.KVMStoragePoolManager.**
createStoragePool(**KVMStoragePoolManager.java:57)**\n\tat
com.cloud.hypervisor.kvm.**resource.**LibvirtComputingResource.**execute(
**LibvirtComputingResource.java:**2087)\n\tat
com.cloud.hypervisor.kvm.**resource.**LibvirtComputingResource.**
executeRequest(**LibvirtComputingResource.java:**1053)\n\tat
com.cloud.agent.Agent.**processRequest(Agent.java:518)**\n\tat
com.cloud.agent.Agent$**AgentRequestHandler.doTask(**
Agent.java:831)\n\tat
com.cloud.utils.nio.Task.r

physical network is in incorrect state:Disabled

[Sanjay Tripathi]

Hi,

While setting up the environment with the latest master code, the 
"createNetwork" API fails with this error message: "failed to create a guest 
network for basic zone Error: Specified physical network id is in incorrect 
state:Disabled". I checked the DB and found that in physical_network table the 
data entry is in disabled state.

Is anyone else facing the same issue, or is there any use case why physical 
network is in disabled state?

--Sanjay

Re: Review Request: CLOUDSTACK-741: Granular Global Parameters

[Harikrishna Patnala]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10548/
---

(Updated April 17, 2013, 11:09 a.m.)


Review request for cloudstack, Abhinandan Prateek, Kishan Kavala, and Nitin 
Mehta.


Changes
---

updated patch with suggested changes.


Description
---

CLOUDSTACK-741: Granular Global Parameters

Modified UpdateConfiguration API and ListConfiguration API by adding additional 
parameter scope and resource id (zone/cluster/pool/account).
Scope decides the parameter which level we can update the value and id is the 
corresponding id based on the scope.
This scope is defined in the config.java file where we are creating groups for 
each level(zone/cluster/pool/account).
Currently submitted the patch for the zone level parameter use.external.dns.

Included unit tests and marvin tests.


This addresses bug CLOUDSTACK-741.


Diffs (updated)
-

  api/src/org/apache/cloudstack/api/command/admin/config/ListCfgsByCmd.java 
aabfd4a 
  api/src/org/apache/cloudstack/api/command/admin/config/UpdateCfgCmd.java 
ffeb586 
  api/src/org/apache/cloudstack/api/response/ConfigurationResponse.java 95b8af2 
  api/test/org/apache/cloudstack/api/command/test/ListCfgCmdTest.java 
PRE-CREATION 
  api/test/org/apache/cloudstack/api/command/test/UpdateCfgCmdTest.java 
PRE-CREATION 
  server/src/com/cloud/configuration/Config.java 2993966 
  server/src/com/cloud/configuration/ConfigurationManager.java afaf0d6 
  server/src/com/cloud/configuration/ConfigurationManagerImpl.java 4fc2db7 
  server/src/com/cloud/configuration/dao/ConfigurationDao.java c86c024 
  server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
ab91059 
  server/src/com/cloud/server/ConfigurationServer.java f441b1f 
  server/src/com/cloud/server/ConfigurationServerImpl.java 852c00b 
  server/src/com/cloud/server/ManagementServerImpl.java 98f789a 
  server/test/com/cloud/vpc/MockConfigurationManagerImpl.java 9443815 
  test/integration/smoke/test_UpdateCfg.py PRE-CREATION 

Diff: https://reviews.apache.org/r/10548/diff/


Testing
---

Tested locally
- tested the modified UpdateConfiguration API and ListConfiguration API by 
providing the zone scope and zone id
- tested the modified parameter to take the updated value at zone level(after 
updation).


Thanks,

Harikrishna Patnala

Re: Review Request: CLOUDSTACK-741: Granular Global Parameters

[Harikrishna Patnala]

> On April 16, 2013, 3:12 p.m., Nitin Mehta wrote:
> > server/src/com/cloud/configuration/Config.java, line 342
> > 
> >
> > So this is available only at zone level and not at the global level is 
> > it ?

By default every parameter is at global, we specify only if there are 
additional scopes.


> On April 16, 2013, 3:12 p.m., Nitin Mehta wrote:
> > server/src/com/cloud/configuration/Config.java, line 432
> > 
> >
> > Do u need this ?

Yes, to put back the new list in the map.


> On April 16, 2013, 3:12 p.m., Nitin Mehta wrote:
> > server/src/com/cloud/configuration/ConfigurationParameterScope.java, line 18
> > 
> >
> > Can we not add this in Configuration interface itself ?

Added in the config file where we create group of parameters at each level 
using this enum.


> On April 16, 2013, 3:12 p.m., Nitin Mehta wrote:
> > server/src/com/cloud/server/ConfigurationServerImpl.java, line 689
> > 
> >
> > I would like to see a clean switch statement here...

Currently this patch support zone level parameter, so 'll add switch case when 
I put other parameters at different levels(cluster/pool/account) 


- Harikrishna


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10548/#review19248
---


On April 17, 2013, 11:09 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10548/
> ---
> 
> (Updated April 17, 2013, 11:09 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek, Kishan Kavala, and Nitin 
> Mehta.
> 
> 
> Description
> ---
> 
> CLOUDSTACK-741: Granular Global Parameters
> 
> Modified UpdateConfiguration API and ListConfiguration API by adding 
> additional parameter scope and resource id (zone/cluster/pool/account).
> Scope decides the parameter which level we can update the value and id is the 
> corresponding id based on the scope.
> This scope is defined in the config.java file where we are creating groups 
> for each level(zone/cluster/pool/account).
> Currently submitted the patch for the zone level parameter use.external.dns.
> 
> Included unit tests and marvin tests.
> 
> 
> This addresses bug CLOUDSTACK-741.
> 
> 
> Diffs
> -
> 
>   api/src/org/apache/cloudstack/api/command/admin/config/ListCfgsByCmd.java 
> aabfd4a 
>   api/src/org/apache/cloudstack/api/command/admin/config/UpdateCfgCmd.java 
> ffeb586 
>   api/src/org/apache/cloudstack/api/response/ConfigurationResponse.java 
> 95b8af2 
>   api/test/org/apache/cloudstack/api/command/test/ListCfgCmdTest.java 
> PRE-CREATION 
>   api/test/org/apache/cloudstack/api/command/test/UpdateCfgCmdTest.java 
> PRE-CREATION 
>   server/src/com/cloud/configuration/Config.java 2993966 
>   server/src/com/cloud/configuration/ConfigurationManager.java afaf0d6 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 4fc2db7 
>   server/src/com/cloud/configuration/dao/ConfigurationDao.java c86c024 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> ab91059 
>   server/src/com/cloud/server/ConfigurationServer.java f441b1f 
>   server/src/com/cloud/server/ConfigurationServerImpl.java 852c00b 
>   server/src/com/cloud/server/ManagementServerImpl.java 98f789a 
>   server/test/com/cloud/vpc/MockConfigurationManagerImpl.java 9443815 
>   test/integration/smoke/test_UpdateCfg.py PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/10548/diff/
> 
> 
> Testing
> ---
> 
> Tested locally
> - tested the modified UpdateConfiguration API and ListConfiguration API by 
> providing the zone scope and zone id
> - tested the modified parameter to take the updated value at zone level(after 
> updation).
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>

VM with multiple nics connected to vpc n/w and isolated n/w - what is the usecase?

[Venkata SwamyBabu Budumuru]

Currently I see that we allow VM to have multiple nics one in VPC n/w another 
in isolate network. Is there any use case for this?

Thanks,
SWAMY

Re: Review Request: Remove 2k limitation for user data on a deployVMCmd issued as an HTTP POST request

[Prasanna Santhanam]

On Wed, Apr 17, 2013 at 11:52:08AM +0530, Prasanna Santhanam wrote:
> On Wed, Apr 17, 2013 at 11:10:01AM +0530, Rohit Yadav wrote:
> > 
> > 
> > If it does not cost much, let's introduce a new dependency for requesting
> > stuff (get or post etc.) using "requests" [1] for both marvin and
> > cloudmonkey. Vijay, you can write your own requester, as it's not much
> > effort required to implement your own requester once you how signature is
> > calculated.
> > 
> > IMO, cloudstackConnection could be rewritten using latest ways and better
> > libraries as it's not much code and is totally do-able with much less
> > effort. A lot of flows for auth or non-auth are inter-dependent, the
> > json->obj and obj->json parts and requesting logic is not straight forward
> > (each method does *only* one thing). We need to make it generic by
> > providing both raw and processed outputs, for example the result expects to
> > return an obj and not json (maybe I need json and not an obj), one reason
> > why I chose to write my own for cloudmonkey after I tried to reuse it.
> > Lastly, host marvin on pypi so it's easier for any developer to get it off
> > the shelf and start hacking some cool clients.
> > 
> > Cheers.
> > 
> > [1] http://docs.python-requests.org/en/latest/
> > 
> > 
> 
> Yeah - we should simplify cloudstackConnection and make it easily
> exportable for both cloudmonkey,marvin and any other tools that might
> require to make connections to CS mgmt. requests certainly looks
> elegant. I'm trying to experiment with it to see if I can cook up
> something for marvin. 
> 
> At one point I moved from httplib to urllib2 to overcome an annoying
> BadStatusLine issue from httplib. I still find it hard to throttle
> multiple tests through a single connection and urllib3 seems to handle
> that. requests appears to be based on urllib3. So it would make sense
> to move to it.
> 
> The json decode,encode is not done within cloudstackConnection. That
> part is annoying and I explored json and simplejson and there doesn't
> seem to be an easy way to accomplish marvin's case. Esp. with nested
> json objects I find it easier to use a recursive json decoder as in
> jsonHelper. I've switched to simplejson and find that it performs
> better for large jsons like our listXxx calls. jsonHelper right now
> makes plain python objects which can be improved to make it a response
> object as returned by the API. So a createPhysicalNetworkResponse
> looks like the physicalNetworkResponse and not a plain python dict.
> 

I refactored the cloudstackconnection and pushed a wip branch
requestsformarvin. Just need to iron out the POST data passing for
cmds and the key signing. I think we can add the login mechanism based
on session-based auth that the UI does with requests as well. That way
we have a single module for all forms of auth done by CS.


-- 
Prasanna.,

Review Request: Fixed CLOUDSTACK-1849 [AWS Style Health Checks] Creation of LB Health Check policy fails if the value of "Unhealthy Threshold" parameter is 3 or more.

[Rajesh Battala]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10570/
---

Review request for cloudstack, Murali Reddy, Vijay Venkatachalam, and Ram 
Ganesh.


Description
---

By default monitor retires value is '3'.
Fixed the issue, while creating the monitor setting the retires value in 
monitor object  to max of (HealthcheckThresshold , UnhealthThresshold) + 1


Diffs
-

  
plugins/network-elements/netscaler/src/com/cloud/network/resource/NetscalerResource.java
 b82176b 

Diff: https://reviews.apache.org/r/10570/diff/


Testing
---

1. Verified the creation of monitor with params value more than '3' monitor is 
getting created.
2. verified the monitor properties in the Netscaler properties are saved 
accordingly.
3. Verified creating the monitor for TCP/HTTP types.
4. deletion of monitor works well.


Thanks,

Rajesh Battala

devcloud hanging

[Daan Hoogland]

<<< text/html; charset=ISO-8859-1: Unrecognized >>>
<>

Re: devcloud hanging

[Sebastien Goasguen]

On Apr 17, 2013, at 6:55 AM, Daan Hoogland  wrote:

> LS,
> 
> I tried both the devcloud and devcloud2 images. both seem to hang when 
> started with the default (xen) kernel.
> I am running macosx 10.6.8 and virtualbox 4.2.12
> I enabled pae
> 
> In both cases it hangs right after loading initial ramdisk.
> 
> Is there any clue I am missing?
> 

enable nested paging ?
enable VT-X ?
enable IO APIC ?

> thanks
> -- 
> <="" a="" border="0">
> 

Review Request: component tests:populate mode in the "services" dictionary from the network type in the list zones API response

[SrikanteswaraRao Talluri]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10571/
---

Review request for cloudstack and Prasanna Santhanam.


Description
---

This review request for tests in this folder test/integration/components

Instead of hard coding the networking type of the zone in "services" dictionary 
, populate it from the zone.networktype 


This addresses bug CLOUDSTACK-2032.


Diffs
-

  test/integration/component/test_accounts.py cdb3e58 
  test/integration/component/test_allocation_states.py 103cb10 
  test/integration/component/test_blocker_bugs.py 33e4a73 
  test/integration/component/test_egress_rules.py 6b9cd4f 
  test/integration/component/test_eip_elb.py 89fdd25 
  test/integration/component/test_network_offering.py 0de03aa 
  test/integration/component/test_project_configs.py 854b5a4 
  test/integration/component/test_project_limits.py afae180 
  test/integration/component/test_project_resources.py 24091d2 
  test/integration/component/test_project_usage.py 9f0488d 
  test/integration/component/test_projects.py 3e45cae 
  test/integration/component/test_resource_limits.py c20770a 
  test/integration/component/test_routers.py 02a08de 
  test/integration/component/test_security_groups.py 39f6d6f 
  test/integration/component/test_snapshots.py 825b8c6 
  test/integration/component/test_templates.py 65d9fe0 
  test/integration/component/test_usage.py 82d13e5 
  test/integration/component/test_vm_passwdenabled.py fb88170 
  test/integration/component/test_volumes.py bedf6ef 

Diff: https://reviews.apache.org/r/10571/diff/


Testing
---

tested


Thanks,

SrikanteswaraRao Talluri

Re: Create rbd primary storage fail in CS 4.0.1

[Guangjian Liu]

I still meet the same result.

In ubuntu 12.04,
1. I install libvirt-dev as below,
   apt-get install libvirt-dev
2. rebuild libvirt, see detail build log in attach.
root@ubuntu:~/install/libvirt-0.10.2# ./autogen.sh
running CONFIG_SHELL=/bin/bash /bin/bash ./configure --enable-rbd
--no-create --no-recursion
configure: WARNING: unrecognized options: --enable-rbd
.
make
make install



On Wed, Apr 17, 2013 at 6:25 PM, Wido den Hollander  wrote:

> Hi,
>
>
> On 04/17/2013 11:37 AM, Guangjian Liu wrote:
>
>> Thanks for your mail, you suggest compile libvirt with RBD enable.
>> I already build libvirt-0.10.2.tar.gz as document
>> http://ceph.com/docs/master/**rbd/libvirt/in
>>  my SERVER C(Ubuntu 12.04),
>>   Shall I build libvirt-0.10.2.tar.gz with RBD enable?  use ./configure
>> --enable-rbd instead autogen.sh?
>>
>>
> Well, you don't have to add --enable-rbd to configure nor autogen.sh, but
> you have to make sure the development libraries for librbd are installed.
>
> On CentOS do this:
>
> yum install librbd-devel
>
> And retry autogen.sh for libvirt, it should tell you RBD is enabled.
>
> Wido
>
>  cd libvirt
>> ./autogen.sh
>> make
>> sudo make install
>>
>>
>>
>> On Wed, Apr 17, 2013 at 4:37 PM, Wido den Hollander 
>> wrote:
>>
>>  Hi,
>>>
>>>
>>> On 04/17/2013 01:44 AM, Guangjian Liu wrote:
>>>
>>>  Create rbd primary storage fail in CS 4.0.1
 Anybody can help about it!

 Environment:
 1. Server A: CS 4.0.1 OS: RHEL 6.2 x86-64
 2. Server B: Ceph 0.56.4  OS: RHEL 6.2 x86-64
 3. Server C: KVM/Qemu OS: Ubuntu 12.04
   compile libvirt and Qemu as document
 root@ubuntu:/usr/local/lib# virsh version
 Compiled against library: libvirt 0.10.2
 Using library: libvirt 0.10.2
 Using API: QEMU 0.10.2
 Running hypervisor: QEMU 1.0.0


  Are you sure both libvirt and Qemu are compiled with RBD enabled?
>>>
>>> On your CentOS system you should make sure librbd-dev is installed during
>>> compilation of libvirt and Qemu.
>>>
>>> The most important part is the RBD storage pool support in libvirt, that
>>> should be enabled.
>>>
>>> In the e-mail you send me directly I saw this:
>>>
>>> root@ubuntu:~/scripts# virsh pool-define rbd-pool.xml error: Failed to
>>> define pool from rbd-pool.xml error: internal error missing backend for
>>> pool type 8
>>>
>>> That suggest RBD storage pool support is not enabled in libvirt.
>>>
>>> Wido
>>>
>>>
>>>   Problem:
>>>
 create primary storage fail with rbd device.

 Fail log:
 2013-04-16 16:27:14,224 DEBUG [cloud.storage.StorageManagerImpl]

 (catalina-exec-9:null) createPool Params @ scheme - rbd storageHost -
 10.0.0.41 hostPath - /cloudstack port - -1
 2013-04-16 16:27:14,270 DEBUG [cloud.storage.StorageManagerImpl]

 (catalina-exec-9:null) In createPool Setting poolId - 218 uuid -
 5924a2df-d658-3119-8aba-f90307683206 zoneId - 4 podId - 4 poolName
 -
 ceph
 2013-04-16 16:27:14,318 DEBUG [cloud.storage.StorageManagerImpl]

 (catalina-exec-9:null) creating pool ceph on  host 18
 2013-04-16 16:27:14,320 DEBUG [agent.transport.Request]
 (catalina-exec-9:null) Seq 18-1625162275: Sending  { Cmd , MgmtId:
 37528005876872, via: 18, Ver: v1, Flags: 100011,
 [{"CreateStoragePoolCommand":{"add":true,"pool":{"id":218,**"**
 uuid":"5924a2df-d658-3119-8aba-f90307683206","host":"10.
 0.0.41","path":"cloudstack","userInfo":":","port":6789,"**
 type":"RBD"},"localPath":"/mnt//3cf4f0e8-781d-39d8-b81c-

 9896da212335","wait":0}}]
 }
 2013-04-16 16:27:14,323 DEBUG [agent.transport.Request]
 (AgentManager-Handler-2:null) Seq 18-1625162275: Processing:  { Ans: ,
 MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10,
 [{"Answer":{"result":true,"details":"success","wait":0}}] }

 2013-04-16 16:27:14,323 DEBUG [agent.transport.Request]
 (catalina-exec-9:null) Seq 18-1625162275: Received:  { Ans: , MgmtId:
 37528005876872, via: 18, Ver: v1, Flags: 10, { Answer } }
 2013-04-16 16:27:14,323 DEBUG [agent.manager.AgentManagerImpl]

 (catalina-exec-9:null) Details from executing class
 com.cloud.agent.api.CreateStoragePoolCommand: success
 2013-04-16 16:27:14,323 DEBUG [cloud.storage.StorageManagerImpl]

 (catalina-exec-9:null) In createPool Adding the pool to each of the
 hosts
 2013-04-16 16:27:14,323 DEBUG [cloud.storage.StorageManagerImpl]

 (catalina-exec-9:null) Adding pool ceph to  host 18
 2013-04-16 16:27:14,326 DEBUG [agent.transport.Request]
 (catalina-exec-9:null) Seq 18-1625162276: Sending  { Cmd , MgmtId:
 37528005876872, via: 18, Ver: v1, Flags: 100011,
 [{"ModifyStoragePoolCommand":{"add":true,"pool":{"id":218,**"**
 uuid":"5924a2df-d658-3119-8aba-f90307683206","host":"10.
 0.0.41","path":"cloudstack","userInf

Re: Connection to http://repo.maven.apache.org refused

[Rohit Yadav]

4.1 branch uses maven and there is not need to use the deps profile which
is gone now.
Looks like your command has -P deps, remove it.

Next, looks like either there is some connectivity issue, either you're not
connected to Internet, your DNS is unable to resolve the domain or the
maven repo server is down.

Can you share with us your build command?
Cheers.

On Wed, Apr 17, 2013 at 1:58 PM, Denic wrote:

> Escuxe me Rohit recently I have problems building CS4.1 branch,
> when I pull on 04.16. I got this error:
> WARNING] The requested profile "deps" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-remote-resources-plugin:1.3:process
> (default) on project cloud-client-ui: Error resolving project artifact:
> Could not transfer artifact org.libvirt:libvirt:pom:0.4.9 from/to central (
> http://repo.maven.apache.org/maven2): Connection to
> http://repo.maven.apache.org refused for project
> org.libvirt:libvirt:jar:0.4.9: Connection timed out -> [Help 1].
>
> Today(04.17.) I pull and try again to build and ended at even earlier
> point:
> [INFO] Apache CloudStack Usage Server  FAILURE
> [1:03.454s]
> SKIPED.
> .
> .
> [ERROR] Failed to execute goal on project cloud-usage: Could not resolve
> dependencies for project
> org.apache.cloudstack:cloud-usage:jar:4.1.0-SNAPSHOT: Failed to collect
> dependencies for [org.apache.cloudstack:cloud-server:jar:4.1.0-SNAPSHOT
> (compile), mysql:mysql-connector-java:jar:5.1.21 (runtime),
> commons-daemon:commons-daemon:jar:1.0.10 (compile), junit:junit:jar:4.10
> (test), org.springframework:spring-core:jar:3.1.2.RELEASE (compile),
> org.springframework:spring-context:jar:3.1.2.RELEASE (compile),
> org.springframework:spring-web:jar:3.1.2.RELEASE (compile),
> org.mockito:mockito-all:jar:1.9.5 (test),
> org.springframework:spring-test:jar:3.1.2.RELEASE (test),
> org.aspectj:aspectjrt:jar:1.7.1 (compile),
> org.aspectj:aspectjweaver:jar:1.7.1 (compile),
> javax.inject:javax.inject:jar:1 (compile)]: Failed to read artifact
> descriptor for commons-daemon:commons-daemon:jar:1.0.10: Could not transfer
> artifact commons-daemon:commons-daemon:pom:1.0.10 from/to central (
> http://repo.maven.apache.org/maven2): Connection to
> http://repo.maven.apache.org refused: Connection timed out -> [Help 1]
>
> What could be wrong?
> Thank you, regards.
>
>

Review Request: CLOUDSTACK-1851 [AWS Style Health Checks] Health Check monitor not getting created on Netscaler device in Basic zone setup.

[Rajesh Battala]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10572/
---

Review request for cloudstack, Murali Reddy, Vijay Venkatachalam, and Ram 
Ganesh.


Description
---

Fixed the issue
1.While creating the LB rule, healthcheck policies were not sent, so they are 
not getting created. Fixed the issue by including them in TO constructor.
2. Fetching the status of healthchecks created in basic zone.


This addresses bug CLOUDSTACK-1851.


Diffs
-

  
plugins/network-elements/netscaler/src/com/cloud/network/element/NetscalerElement.java
 2bbdb04 

Diff: https://reviews.apache.org/r/10572/diff/


Testing
---

Created basiczone setup with Netscaler.

1. Verified creation/deletion of healthchecks on LB rules
2. Verified creation of healthchecks with different param values.
3. Verified the Healthcheck manager is updating the status of the services in 
the lb vm map table.
4. Verified deletion of healthchecks, resetting the status of services to null
5. Deletion of healthcheck will do clean up of healthcheck entires in 
cloudstack db and in Netscaler resource.


Thanks,

Rajesh Battala

Re: [VOTE] Apache CloudStack 4.0.2

[Sebastien Goasguen]

On Apr 16, 2013, at 4:45 PM, Joe Brockmeier  wrote:

> On Tue, Apr 16, 2013, at 03:40 PM, Wei ZHOU wrote:
>> Thanks, David.
>> It is not in the list of changes.
> 
> Sorry about that. I pulled the changes from Jira and it had no "fix
> versions" tagged, so it didn't show up in the list of things that were
> committed to 4.0.2. I've edited the Jira ticket to show 4.0.2 and 4.1.0.
> 

It does not seem to pass the rat test from the testing procedure:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+4.0+test+procedure

mvn --projects='org.apache.cloudstack:cloudstack' 
org.apache.rat:apache-rat-plugin:0.8:check




> Best,
> 
> jzb
> -- 
> Joe Brockmeier
> j...@zonker.net
> Twitter: @jzb
> http://www.dissociatedpress.net/

Re: devcloud hanging

[Rohit Yadav]

On Wed, Apr 17, 2013 at 4:25 PM, Daan Hoogland wrote:

>  LS,
>
> I tried both the devcloud and devcloud2 images. both seem to hang when
> started with the default (xen) kernel.
> I am running macosx 10.6.8 and virtualbox 4.2.12
> I enabled pae
>

Don't enable PAE, importing devcloud2 from the ova should set all the
necessary settings for you.
Make sure you've 2G RAM given to it and installed the extension pack for
your version:
http://download.virtualbox.org/virtualbox/4.2.12/Oracle_VM_VirtualBox_Extension_Pack-4.2.12-84980.vbox-extpack

10.6 is pretty old now, probably the processor is too. There may be
compatibility issues. May be nested virtualization has issues. Won't be
able to help you much as I don't have a 10.6 machine to test against, can
someone in the community confirm running DevCloud2/VirtualBox on 10.6/osx?

Cheers.


>
> In both cases it hangs right after loading initial ramdisk.
>
> Is there any clue I am missing?
>
> thanks
> --
>
> 
>

Re: database creator

[Rohit Yadav]

On Tue, Apr 16, 2013 at 7:33 PM, Abhinandan Prateek  wrote:

>
> I have some queries regarding Database Creator:
>
> Can this feature be tested on 4.1 ?
>

No, it's only in master. But starting 4.2, all ACS versions will have that
until they will have dbcreator.

For 4.1, we don't have rolling upgrade during fresh db setup using
cloudstack-database-setup. In 4.1, when mgmt server would start, it would
do the upgrade (or one of the clustered mgmt servers) like before. For 4.2,
it would upgrade at the time of fresh deployment.


>
> Could someone also provide more details on the following:
>
>  
>
> 1. Outline the exact steps that are involved in rolling upgrade procedure?
>

Wiki! Get the src and try it yourself.

 
>
> 2. Can you confirm if rolling upgrades are specific to only upgrade
> procedure involving multiple management servers in a cluster?
>

No, as mentioned. For 4.1, like before. Starting 4.2/master, the tools
should be called explicitly to upgrade db or deploy a fresh db. More on 3.;



> 
>
> 3. Would rolling upgrades mean that there will be zero downtime for
> customers when upgrading? Are we also dealing with NOT having to restart
> all system Vms ? Currently restarting system Vms is part of our upgrade
> procedure.
>


So not really, while  on paper and on wiki would give you zero downtime.
The idea is:

For fresh installation, it's a no brainer. I will refer to "tool" as the
utility (cloudstack-database-setup or databasecreator). For existing
deployments in case of a mgmt server cluster:

- Admin shuts down one server, upgrades cloudstack and gets
cloudstack-setup-database or databasecreator.
- Admin uses the tool to upgrade CloudStack db to a state that is backward
compatible to the old db version.
- Next Admin starts CS on that server and stop-upgrade-starts CS on each
servers.
- When all are up, admin calls the cleanup logic to cleanup.

Note: We got the databasecreator, but its not smooth.

I'm not in a state to work on CloudStack fulltime now, someone pl. help us
to:
- fix packaging and java classpath in cloudstack-setup-database and also
fix args processing and pass them to dbcreator via the python script
- test the whole thing, the explicit calling of cleanup and upgrade are not
different now. Right now with dbcreator you can either do fresh deployments
or upgrades only. Clean+Upgrade is united.
- test and fix any bugs, imo for a really large deployment using older
versions of CS, the transition won't be smooth. But for ACS 4.0+
deployments, we can theoretically expect zero downtime.

Cheers.

RE: Cloudstack 4.1

[Hugo Trippaers]

Hey Colm,


You can find that information here: 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+4.1+Release


We are not completely on the schedule at the moment, so I don't know the 
current date we expect the RC1 for 4.1, but it's around the corner. You track 
the progress on our jira (check blockers for 4.1)

Cheers,

Hugo

> -Original Message-
> From: Colm Kerr [mailto:colm.k...@optus.com.au]
> Sent: Wednesday, April 17, 2013 1:22 AM
> To: dev@cloudstack.apache.org
> Subject: Cloudstack 4.1
> 
> Hello
> 
> What is the scheduled release date for 4.1?
> 
> Regards
> 
> Colm Kerr
> Infrastructure Solution Designer | Infrastructure Design Services|
> Information Technology Group| Optus
> T: 02 8082 5131 | m: 0421051180 | | E:
> colm.k...@optus.com.au

[ACS41][Patch Request]

[Mice Xia]

commit 4d0a460bad05bfc89a9f2d93724221c7c517626e
Author: Mice Xia 
Date:   Wed Apr 17 21:24:33 2013 +0800

fix CLOUDSTACK 1991 CreateTagsCmd.java, DeleteTagsCmd.java, and
ListTagsCmd.java all contain invalid version

---

https://reviews.apache.org/r/10536/
Summary:
CLOUDSTACK-1894 User is not able to deploy VMs in a project[permission
denied to access the guest network)


Regards
Mice

Re: [VOTE] Apache CloudStack 4.0.2

[Chip Childers]

On Wed, Apr 17, 2013 at 09:20:16AM -0400, Sebastien Goasguen wrote:
> 
> On Apr 16, 2013, at 4:45 PM, Joe Brockmeier  wrote:
> 
> > On Tue, Apr 16, 2013, at 03:40 PM, Wei ZHOU wrote:
> >> Thanks, David.
> >> It is not in the list of changes.
> > 
> > Sorry about that. I pulled the changes from Jira and it had no "fix
> > versions" tagged, so it didn't show up in the list of things that were
> > committed to 4.0.2. I've edited the Jira ticket to show 4.0.2 and 4.1.0.
> > 
> 
> It does not seem to pass the rat test from the testing procedure:
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+4.0+test+procedure
> 
> mvn --projects='org.apache.cloudstack:cloudstack' 
> org.apache.rat:apache-rat-plugin:0.8:check

Specifically:

  docs/qig/zh-TW/Book_Info.po
  docs/qig/zh-TW/config.po
  docs/qig/zh-TW/Overview.po
  docs/qig/zh-TW/Environment.po
  docs/qig/zh-TW/kvm.po
  docs/qig/zh-TW/Revision_History.po
  docs/qig/zh-TW/Preface.po
  docs/qig/zh-TW/Management.po
  docs/qig/it-IT/Book_Info.po
  docs/qig/it-IT/config.po
  docs/qig/it-IT/Overview.po
  docs/qig/it-IT/Environment.po
  docs/qig/it-IT/kvm.po
  docs/qig/it-IT/Revision_History.po
  docs/qig/it-IT/Preface.po
  docs/qig/it-IT/Management.po
  docs/qig/ja-JP/Book_Info.po
  docs/qig/ja-JP/config.po
  docs/qig/ja-JP/Overview.po
  docs/qig/ja-JP/Environment.po
  docs/qig/ja-JP/kvm.po
  docs/qig/ja-JP/Revision_History.po
  docs/qig/ja-JP/Preface.po
  docs/qig/ja-JP/Management.po

I'm -1 on this RC for 4.0.2.  We need to fix those .po files.

Re: [VOTE] Apache CloudStack 4.0.2

[Sebastien Goasguen]

On Apr 17, 2013, at 9:39 AM, Chip Childers  wrote:

> On Wed, Apr 17, 2013 at 09:20:16AM -0400, Sebastien Goasguen wrote:
>> 
>> On Apr 16, 2013, at 4:45 PM, Joe Brockmeier  wrote:
>> 
>>> On Tue, Apr 16, 2013, at 03:40 PM, Wei ZHOU wrote:
 Thanks, David.
 It is not in the list of changes.
>>> 
>>> Sorry about that. I pulled the changes from Jira and it had no "fix
>>> versions" tagged, so it didn't show up in the list of things that were
>>> committed to 4.0.2. I've edited the Jira ticket to show 4.0.2 and 4.1.0.
>>> 
>> 
>> It does not seem to pass the rat test from the testing procedure:
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+4.0+test+procedure
>> 
>> mvn --projects='org.apache.cloudstack:cloudstack' 
>> org.apache.rat:apache-rat-plugin:0.8:check
> 
> Specifically:
> 
>  docs/qig/zh-TW/Book_Info.po
>  docs/qig/zh-TW/config.po
>  docs/qig/zh-TW/Overview.po
>  docs/qig/zh-TW/Environment.po
>  docs/qig/zh-TW/kvm.po
>  docs/qig/zh-TW/Revision_History.po
>  docs/qig/zh-TW/Preface.po
>  docs/qig/zh-TW/Management.po
>  docs/qig/it-IT/Book_Info.po
>  docs/qig/it-IT/config.po
>  docs/qig/it-IT/Overview.po
>  docs/qig/it-IT/Environment.po
>  docs/qig/it-IT/kvm.po
>  docs/qig/it-IT/Revision_History.po
>  docs/qig/it-IT/Preface.po
>  docs/qig/it-IT/Management.po
>  docs/qig/ja-JP/Book_Info.po
>  docs/qig/ja-JP/config.po
>  docs/qig/ja-JP/Overview.po
>  docs/qig/ja-JP/Environment.po
>  docs/qig/ja-JP/kvm.po
>  docs/qig/ja-JP/Revision_History.po
>  docs/qig/ja-JP/Preface.po
>  docs/qig/ja-JP/Management.po
> 
> I'm -1 on this RC for 4.0.2.  We need to fix those .po files.

argh….I am on it

Re: VM with multiple nics connected to vpc n/w and isolated n/w - what is the usecase?

[Marcus Sorensen]

Its nice to have for migration, combined with the add/remove nic feature.
That was actually the #1 reason I heard about people wanting the add/remove
nic at the CS conference, to migrate between networks. Aside from that, I
can't think of a reason not to allow it. I can draw up a few arbitrary
scenarios where someone may want to connect a VM to two networks.
On Apr 17, 2013 5:37 AM, "Venkata SwamyBabu Budumuru" <
venkataswamybabu.budum...@citrix.com> wrote:

> Currently I see that we allow VM to have multiple nics one in VPC n/w
> another in isolate network. Is there any use case for this?
>
> Thanks,
> SWAMY
>

Re: Review Request: Remove 2k limitation for user data on a deployVMCmd issued as an HTTP POST request

[prasanna]

On 17 April 2013 17:10, Prasanna Santhanam  wrote:
> On Wed, Apr 17, 2013 at 11:52:08AM +0530, Prasanna Santhanam wrote:
>> On Wed, Apr 17, 2013 at 11:10:01AM +0530, Rohit Yadav wrote:
>> >
>> >
>> > If it does not cost much, let's introduce a new dependency for requesting
>> > stuff (get or post etc.) using "requests" [1] for both marvin and
>> > cloudmonkey. Vijay, you can write your own requester, as it's not much
>> > effort required to implement your own requester once you how signature is
>> > calculated.
>> >
>> > IMO, cloudstackConnection could be rewritten using latest ways and better
>> > libraries as it's not much code and is totally do-able with much less
>> > effort. A lot of flows for auth or non-auth are inter-dependent, the
>> > json->obj and obj->json parts and requesting logic is not straight forward
>> > (each method does *only* one thing). We need to make it generic by
>> > providing both raw and processed outputs, for example the result expects to
>> > return an obj and not json (maybe I need json and not an obj), one reason
>> > why I chose to write my own for cloudmonkey after I tried to reuse it.
>> > Lastly, host marvin on pypi so it's easier for any developer to get it off
>> > the shelf and start hacking some cool clients.
>> >
>> > Cheers.
>> >
>> > [1] http://docs.python-requests.org/en/latest/
>> >
>> >
>>
>> Yeah - we should simplify cloudstackConnection and make it easily
>> exportable for both cloudmonkey,marvin and any other tools that might
>> require to make connections to CS mgmt. requests certainly looks
>> elegant. I'm trying to experiment with it to see if I can cook up
>> something for marvin.
>>
>> At one point I moved from httplib to urllib2 to overcome an annoying
>> BadStatusLine issue from httplib. I still find it hard to throttle
>> multiple tests through a single connection and urllib3 seems to handle
>> that. requests appears to be based on urllib3. So it would make sense
>> to move to it.
>>
>> The json decode,encode is not done within cloudstackConnection. That
>> part is annoying and I explored json and simplejson and there doesn't
>> seem to be an easy way to accomplish marvin's case. Esp. with nested
>> json objects I find it easier to use a recursive json decoder as in
>> jsonHelper. I've switched to simplejson and find that it performs
>> better for large jsons like our listXxx calls. jsonHelper right now
>> makes plain python objects which can be improved to make it a response
>> object as returned by the API. So a createPhysicalNetworkResponse
>> looks like the physicalNetworkResponse and not a plain python dict.
>>
>
> I refactored the cloudstackconnection and pushed a wip branch
> requestsformarvin. Just need to iron out the POST data passing for
> cmds and the key signing. I think we can add the login mechanism based
> on session-based auth that the UI does with requests as well. That way
> we have a single module for all forms of auth done by CS.
>

Fixed in master and tested using the bvt. I added some basic support
for being able to handle POST but it's not yet clear to me which of
the APIs will handle POST. May be if API discovery exposes the
mechanism GET/POST for an API we can handle the POST data elegantly
for marvin and cloudmonkey. What say?

I'm trying to bring in further changes to marvin and add DSL support
after which I'll look into putting it up on pypi.


commit 167781ec0184f1332c0b45ca599f460d7d7b5c92
Author: Prasanna Santhanam 
Date:   Wed Apr 17 17:06:15 2013 +0530

refactor marvin to use requests instead of urllib2

Use python-requests [1] for Marvin. Requests enables graceful handling
of http connections. Marvin's cloudstackConnection has been refactored,
cleaned up to act as a single module for all kinds of cloudstack API
requesting.

TODO:
1. session based login mechanism of the UI should work from
cloudstackConnection
2. cloudmonkey can also reuse /import marvin.cloudstackConnection
3. More graceful handling of POST requests

[1] http://docs.python-requests.org/en/latest/

Signed-off-by: Prasanna Santhanam 

Re: [VOTE] Apache CloudStack 4.0.2

[Sebastien Goasguen]

On Apr 17, 2013, at 9:41 AM, Sebastien Goasguen  wrote:

> 
> On Apr 17, 2013, at 9:39 AM, Chip Childers  wrote:
> 
>> On Wed, Apr 17, 2013 at 09:20:16AM -0400, Sebastien Goasguen wrote:
>>> 
>>> On Apr 16, 2013, at 4:45 PM, Joe Brockmeier  wrote:
>>> 
 On Tue, Apr 16, 2013, at 03:40 PM, Wei ZHOU wrote:
> Thanks, David.
> It is not in the list of changes.
 
 Sorry about that. I pulled the changes from Jira and it had no "fix
 versions" tagged, so it didn't show up in the list of things that were
 committed to 4.0.2. I've edited the Jira ticket to show 4.0.2 and 4.1.0.
 
>>> 
>>> It does not seem to pass the rat test from the testing procedure:
>>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+4.0+test+procedure
>>> 
>>> mvn --projects='org.apache.cloudstack:cloudstack' 
>>> org.apache.rat:apache-rat-plugin:0.8:check
>> 
>> Specifically:
>> 
>> docs/qig/zh-TW/Book_Info.po
>> docs/qig/zh-TW/config.po
>> docs/qig/zh-TW/Overview.po
>> docs/qig/zh-TW/Environment.po
>> docs/qig/zh-TW/kvm.po
>> docs/qig/zh-TW/Revision_History.po
>> docs/qig/zh-TW/Preface.po
>> docs/qig/zh-TW/Management.po
>> docs/qig/it-IT/Book_Info.po
>> docs/qig/it-IT/config.po
>> docs/qig/it-IT/Overview.po
>> docs/qig/it-IT/Environment.po
>> docs/qig/it-IT/kvm.po
>> docs/qig/it-IT/Revision_History.po
>> docs/qig/it-IT/Preface.po
>> docs/qig/it-IT/Management.po
>> docs/qig/ja-JP/Book_Info.po
>> docs/qig/ja-JP/config.po
>> docs/qig/ja-JP/Overview.po
>> docs/qig/ja-JP/Environment.po
>> docs/qig/ja-JP/kvm.po
>> docs/qig/ja-JP/Revision_History.po
>> docs/qig/ja-JP/Preface.po
>> docs/qig/ja-JP/Management.po
>> 
>> I'm -1 on this RC for 4.0.2.  We need to fix those .po files.
> 
> argh….I am on it
> 
Ok solved in 95f87bd96e0db0d061e37245166059d5eb7a073b

But unfortunately I want to raise 
https://issues.apache.org/jira/browse/CLOUDSTACK-528 which is a blocker for 
4.0.2 and yet still open.

Nicolas emailed several times about it already .

> 

Re: [VOTE] Apache CloudStack 4.0.2

[nicolas.lamirault]

Hello,
I'm -1 on the 4.0.2 release due to the issue 
https://issues.apache.org/jira/browse/CLOUDSTACK-528

our upgrade from version 2.2.13 to 4.0.x is blocked due this issue
Regards.

Le 16/04/2013 19:52, Joe Brockmeier a écrit :

Hi All,

I've created a 4.0.2 release, with the following artifacts up for a
vote:

Git Branch and Commit SH:
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.0
Commit: aa5081e1746c33eba6b3257602996e2aaa01ba0b

List of changes:
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blob_plain;f=CHANGES;hb=4.0

Source release (checksums and signatures are available at the same
location):
http://people.apache.org/~jzb/cloudstack/dist/releases/4.0.2/

PGP release keys (signed using A0207CD4):
http://www.apache.org/dist/incubator/cloudstack/KEYS

Vote will be open for 72 hours.

For sanity in tallying the vote, can PMC members please be sure to
indicate "(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Best,

jzb




--
Nicolas Lamirault

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
France Telecom - Orange decline toute responsabilite si ce message a ete 
altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, France Telecom - Orange is not liable for messages 
that have been modified, changed or falsified.
Thank you.

Re: [VOTE] Apache CloudStack 4.0.2

[Joe Brockmeier]

On Wed, Apr 17, 2013, at 08:50 AM, Sebastien Goasguen wrote:
> Ok solved in 95f87bd96e0db0d061e37245166059d5eb7a073b
> 
> But unfortunately I want to raise
> https://issues.apache.org/jira/browse/CLOUDSTACK-528 which is a blocker
> for 4.0.2 and yet still open.
> 
> Nicolas emailed several times about it already .

I'm aware of the issue, but as of yet no one has stepped up to fix it
and we've got a slew of other issues that are in the release. 

Will stop the vote due to the RAT issues, and if anyone would like to
step up on 528 now would be a very good time to do so.

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

Re: [ACS41][Patch Request]

[Chip Childers]

On Wed, Apr 17, 2013 at 09:36:20PM +0800, Mice Xia wrote:
> commit 4d0a460bad05bfc89a9f2d93724221c7c517626e
> Author: Mice Xia 
> Date:   Wed Apr 17 21:24:33 2013 +0800
> 
> fix CLOUDSTACK 1991 CreateTagsCmd.java, DeleteTagsCmd.java, and
> ListTagsCmd.java all contain invalid version
> 
> ---
> 
> https://reviews.apache.org/r/10536/
> Summary:
> CLOUDSTACK-1894 User is not able to deploy VMs in a project[permission
> denied to access the guest network)
> 
> 
> Regards
> Mice

Done!

commit 9d70859a9bf8bc0c42a7df159e3e80dfc38dfbf4
Author: Mice Xia 
Date:   Wed Apr 17 21:24:33 2013 +0800

fix CLOUDSTACK 1991 CreateTagsCmd.java, DeleteTagsCmd.java, and 
ListTagsCmd.java all contain invalid version

Re: Review Request: component tests:populate mode in the "services" dictionary from the network type in the list zones API response

[Prasanna Santhanam]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10571/#review19316
---

Ship it!


5ee3cc41fecb08b0dba16341fef12684a50ecc98

- Prasanna Santhanam


On April 17, 2013, 12:45 p.m., SrikanteswaraRao Talluri wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10571/
> ---
> 
> (Updated April 17, 2013, 12:45 p.m.)
> 
> 
> Review request for cloudstack and Prasanna Santhanam.
> 
> 
> Description
> ---
> 
> This review request for tests in this folder test/integration/components
> 
> Instead of hard coding the networking type of the zone in "services" 
> dictionary , populate it from the zone.networktype 
> 
> 
> This addresses bug CLOUDSTACK-2032.
> 
> 
> Diffs
> -
> 
>   test/integration/component/test_accounts.py cdb3e58 
>   test/integration/component/test_allocation_states.py 103cb10 
>   test/integration/component/test_blocker_bugs.py 33e4a73 
>   test/integration/component/test_egress_rules.py 6b9cd4f 
>   test/integration/component/test_eip_elb.py 89fdd25 
>   test/integration/component/test_network_offering.py 0de03aa 
>   test/integration/component/test_project_configs.py 854b5a4 
>   test/integration/component/test_project_limits.py afae180 
>   test/integration/component/test_project_resources.py 24091d2 
>   test/integration/component/test_project_usage.py 9f0488d 
>   test/integration/component/test_projects.py 3e45cae 
>   test/integration/component/test_resource_limits.py c20770a 
>   test/integration/component/test_routers.py 02a08de 
>   test/integration/component/test_security_groups.py 39f6d6f 
>   test/integration/component/test_snapshots.py 825b8c6 
>   test/integration/component/test_templates.py 65d9fe0 
>   test/integration/component/test_usage.py 82d13e5 
>   test/integration/component/test_vm_passwdenabled.py fb88170 
>   test/integration/component/test_volumes.py bedf6ef 
> 
> Diff: https://reviews.apache.org/r/10571/diff/
> 
> 
> Testing
> ---
> 
> tested
> 
> 
> Thanks,
> 
> SrikanteswaraRao Talluri
> 
>

Re: [VOTE] Apache CloudStack 4.0.2

[Fraysse Guillaume]

Hello,

Same as Nicolas, as we work together and it prohibits us from
upgrading our production platform : I also vote -1 on the 4.0.2
release due to the issue
https://issues.apache.org/jira/browse/CLOUDSTACK-528


Kind regards,
Guillaume

On Wed, Apr 17, 2013 at 4:06 PM,   wrote:
> Hello,
> I'm -1 on the 4.0.2 release due to the issue
> https://issues.apache.org/jira/browse/CLOUDSTACK-528
> our upgrade from version 2.2.13 to 4.0.x is blocked due this issue
> Regards.
>
>
> Le 16/04/2013 19:52, Joe Brockmeier a écrit :
>>
>> Hi All,
>>
>>
>> I've created a 4.0.2 release, with the following artifacts up for a
>> vote:
>>
>> Git Branch and Commit SH:
>>
>> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.0
>> Commit: aa5081e1746c33eba6b3257602996e2aaa01ba0b
>>
>> List of changes:
>>
>> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blob_plain;f=CHANGES;hb=4.0
>>
>> Source release (checksums and signatures are available at the same
>> location):
>> http://people.apache.org/~jzb/cloudstack/dist/releases/4.0.2/
>>
>> PGP release keys (signed using A0207CD4):
>> http://www.apache.org/dist/incubator/cloudstack/KEYS
>>
>> Vote will be open for 72 hours.
>>
>> For sanity in tallying the vote, can PMC members please be sure to
>> indicate "(binding)" with their vote?
>>
>> [ ] +1  approve
>> [ ] +0  no opinion
>> [ ] -1  disapprove (and reason why)
>>
>> Best,
>>
>> jzb
>>
>
>
> --
> Nicolas Lamirault
>
> _
>
> Ce message et ses pieces jointes peuvent contenir des informations
> confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu
> ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages
> electroniques etant susceptibles d'alteration,
> France Telecom - Orange decline toute responsabilite si ce message a ete
> altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or privileged
> information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and
> delete this message and its attachments.
> As emails may be altered, France Telecom - Orange is not liable for messages
> that have been modified, changed or falsified.
> Thank you.
>

Re: [VOTE] Apache CloudStack 4.0.2

[Marcus Sorensen]

Do we have rules set out around this? It seems that we wouldn't stop a
time-based bug fix release from going out just because it doesn't fix every
bug we know of, only if it introduces a bug.
On Apr 17, 2013 8:09 AM, "Joe Brockmeier"  wrote:

>
>
> On Wed, Apr 17, 2013, at 08:50 AM, Sebastien Goasguen wrote:
> > Ok solved in 95f87bd96e0db0d061e37245166059d5eb7a073b
> >
> > But unfortunately I want to raise
> > https://issues.apache.org/jira/browse/CLOUDSTACK-528 which is a blocker
> > for 4.0.2 and yet still open.
> >
> > Nicolas emailed several times about it already .
>
> I'm aware of the issue, but as of yet no one has stepped up to fix it
> and we've got a slew of other issues that are in the release.
>
> Will stop the vote due to the RAT issues, and if anyone would like to
> step up on 528 now would be a very good time to do so.
>
> Best,
>
> jzb
> --
> Joe Brockmeier
> j...@zonker.net
> Twitter: @jzb
> http://www.dissociatedpress.net/
>

Re: [VOTE] Apache CloudStack 4.0.2

[Noah Slater]

Yes, we have rules. :)

A release will pass if it receives 3 binding +1 votes, and more +1 votes
than -1 votes in total.


On 17 April 2013 15:11, Marcus Sorensen  wrote:

> Do we have rules set out around this? It seems that we wouldn't stop a
> time-based bug fix release from going out just because it doesn't fix every
> bug we know of, only if it introduces a bug.
> On Apr 17, 2013 8:09 AM, "Joe Brockmeier"  wrote:
>
> >
> >
> > On Wed, Apr 17, 2013, at 08:50 AM, Sebastien Goasguen wrote:
> > > Ok solved in 95f87bd96e0db0d061e37245166059d5eb7a073b
> > >
> > > But unfortunately I want to raise
> > > https://issues.apache.org/jira/browse/CLOUDSTACK-528 which is a
> blocker
> > > for 4.0.2 and yet still open.
> > >
> > > Nicolas emailed several times about it already .
> >
> > I'm aware of the issue, but as of yet no one has stepped up to fix it
> > and we've got a slew of other issues that are in the release.
> >
> > Will stop the vote due to the RAT issues, and if anyone would like to
> > step up on 528 now would be a very good time to do so.
> >
> > Best,
> >
> > jzb
> > --
> > Joe Brockmeier
> > j...@zonker.net
> > Twitter: @jzb
> > http://www.dissociatedpress.net/
> >
>



-- 
NS

Re: [VOTE] Apache CloudStack 4.0.2

[Chip Childers]

On Wed, Apr 17, 2013 at 08:11:38AM -0600, Marcus Sorensen wrote:
> Do we have rules set out around this? It seems that we wouldn't stop a
> time-based bug fix release from going out just because it doesn't fix every
> bug we know of, only if it introduces a bug.

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Apache+CloudStack+Project+Bylaws#ApacheCloudStackProjectBylaws-3.DecisionMaking

Section 3.4.3. - Lazy Majority of PMC

Re: [VOTE] Apache CloudStack 4.0.2

[Joe Brockmeier]

On Wed, Apr 17, 2013, at 09:11 AM, Marcus Sorensen wrote:
> Do we have rules set out around this? It seems that we wouldn't stop a
> time-based bug fix release from going out just because it doesn't fix
> every bug we know of, only if it introduces a bug.

We don't have any hard and fast rules. It's really up to the release
manager to call it and the community to vote on it. 

As a general practice, I'd like to not release anything with a blocker
bug - but if we're sitting in wait on a maintenance release for weeks
and no one is coming forward with a fix, I don't know it's reasonable to
continue being in a hold pattern for that one issue. 

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

Re: [VOTE] Apache CloudStack 4.0.2

[Joe Brockmeier]

On Wed, Apr 17, 2013, at 09:16 AM, Joe Brockmeier wrote:
> On Wed, Apr 17, 2013, at 09:11 AM, Marcus Sorensen wrote:
> > Do we have rules set out around this? It seems that we wouldn't stop a
> > time-based bug fix release from going out just because it doesn't fix
> > every bug we know of, only if it introduces a bug.
> 
> We don't have any hard and fast rules. It's really up to the release
> manager to call it and the community to vote on it. 

Sorry, clearly we have rules about voting - I meant we don't have any
"the release must not have more than X bugs of Y type" rules. :-)

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

[CANCELLED] Re: [VOTE] Apache CloudStack 4.0.2

[Joe Brockmeier]

On Wed, Apr 17, 2013, at 08:20 AM, Sebastien Goasguen wrote:
> It does not seem to pass the rat test from the testing procedure:
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+4.0+test+procedure

Based on this - I'm canceling the vote. Thanks to Sebastien for catching
this. 

I'll restart the vote tomorrow afternoon after we've gotten this and
I've fixed the release notes. If anyone wants to take a look at 528 in
the meantime, that'd be lovely. I will also start a separate thread on
that. (And if you're working on that and a fix is imminent, please speak
up!) Thanks all.

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

[ACS402] CLOUDSTACK-528 needs love! (Failed to create secondary storage)

[Joe Brockmeier]

Howdy all,

As noted in the previous thread, we've stopped the vote on 4.0.2 due to
another issue. I'm going to re-roll the release and start the vote again
tomorrow. 

In the meantime, CLOUDSTACK-528 is a problem for at least one user
trying to upgrade to 4.0.x. Can we get someone to take a look at this
and see if there's a fix we can put in before tomorrow? Thanks!

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

Re: [VOTE] Apache CloudStack 4.0.2

[Chip Childers]

On Wed, Apr 17, 2013 at 04:10:50PM +0200, Fraysse Guillaume wrote:
> Hello,
> 
> Same as Nicolas, as we work together and it prohibits us from
> upgrading our production platform : I also vote -1 on the 4.0.2
> release due to the issue
> https://issues.apache.org/jira/browse/CLOUDSTACK-528
> 
> 
> Kind regards,
> Guillaume

Would either of you folks be willing to test with the 4.1 branch?  We
want to get 4.0.2 out the door quickly so that we can move on to getting
4.1.0 out. If this effects 4.1 as well, then I'll change the Jira record
to reflect that and block the 4.1 RC until it's resolved.

-chip

> 
> On Wed, Apr 17, 2013 at 4:06 PM,   wrote:
> > Hello,
> > I'm -1 on the 4.0.2 release due to the issue
> > https://issues.apache.org/jira/browse/CLOUDSTACK-528
> > our upgrade from version 2.2.13 to 4.0.x is blocked due this issue
> > Regards.
> >
> >
> > Le 16/04/2013 19:52, Joe Brockmeier a écrit :
> >>
> >> Hi All,
> >>
> >>
> >> I've created a 4.0.2 release, with the following artifacts up for a
> >> vote:
> >>
> >> Git Branch and Commit SH:
> >>
> >> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.0
> >> Commit: aa5081e1746c33eba6b3257602996e2aaa01ba0b
> >>
> >> List of changes:
> >>
> >> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blob_plain;f=CHANGES;hb=4.0
> >>
> >> Source release (checksums and signatures are available at the same
> >> location):
> >> http://people.apache.org/~jzb/cloudstack/dist/releases/4.0.2/
> >>
> >> PGP release keys (signed using A0207CD4):
> >> http://www.apache.org/dist/incubator/cloudstack/KEYS
> >>
> >> Vote will be open for 72 hours.
> >>
> >> For sanity in tallying the vote, can PMC members please be sure to
> >> indicate "(binding)" with their vote?
> >>
> >> [ ] +1  approve
> >> [ ] +0  no opinion
> >> [ ] -1  disapprove (and reason why)
> >>
> >> Best,
> >>
> >> jzb
> >>
> >
> >
> > --
> > Nicolas Lamirault
> >
> > _
> >
> > Ce message et ses pieces jointes peuvent contenir des informations
> > confidentielles ou privilegiees et ne doivent donc
> > pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu
> > ce message par erreur, veuillez le signaler
> > a l'expediteur et le detruire ainsi que les pieces jointes. Les messages
> > electroniques etant susceptibles d'alteration,
> > France Telecom - Orange decline toute responsabilite si ce message a ete
> > altere, deforme ou falsifie. Merci.
> >
> > This message and its attachments may contain confidential or privileged
> > information that may be protected by law;
> > they should not be distributed, used or copied without authorisation.
> > If you have received this email in error, please notify the sender and
> > delete this message and its attachments.
> > As emails may be altered, France Telecom - Orange is not liable for messages
> > that have been modified, changed or falsified.
> > Thank you.
> >
> 

Cancelling IRC meeting today

[Joe Brockmeier]

Hey all,

Unless there's a strenuous objection, I'd like to cancel today's IRC
meeting. We have a fair amount of work to do to get 4.1.0 out the door,
and some cleanup on 4.0.2. It's probably more productive to work through
the meeting time today.

I'll send a status update on 4.0.2 in a few minutes and on 4.1.0 docs.
Chip, could you send an overall status report on 4.1.0? Any other
feedback on 4.1.0 would be great as well. 

Thoughts, comments, flames? 

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

Re: [VOTE] Apache CloudStack 4.0.2

[Marcus Sorensen]

OK, so the answer is no, we just decide as we go...
On Apr 17, 2013 8:15 AM, "Chip Childers"  wrote:

> On Wed, Apr 17, 2013 at 08:11:38AM -0600, Marcus Sorensen wrote:
> > Do we have rules set out around this? It seems that we wouldn't stop a
> > time-based bug fix release from going out just because it doesn't fix
> every
> > bug we know of, only if it introduces a bug.
>
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Apache+CloudStack+Project+Bylaws#ApacheCloudStackProjectBylaws-3.DecisionMaking
>
> Section 3.4.3. - Lazy Majority of PMC
>
>

CS 4.0.0 - vpc deployment - why tier network limited to 200mb/s ?

[benoit lair]

Hello guys,


I'm testing an preproduction environment with cs4.0.0 onto centos 5.3.

I'm testing a vpc environment.

I'm asking why does the tier networks are limited to 200mb/s (network
offering DefaultIsolatedNetworkOfferingForVpcNetworksNoLB) ?
So in xencenter, if i look at the network tab of my vpc vr vm, i got a qos
of 25600 kbytes/sec.

Is there a risk to create a different network offering with a 1000 mb/s qos
limit ? no limit ?

What if i want to recreate a multi tier environnment with a no limit of qos
with a 500 mb/s troughput, a 1000mb/s troughput ?

What do you think about vpc vr capabilities ? any deployment
recommendations ?


Thanks for any advice.

Regards, Benoit Lair.

[DOCS][ACS41] Status Update

[Joe Brockmeier]

Hey all,

Just a quick update on the docs status.

- Still working on release notes, in the final stretch now. I hope to
have something ready to go out with the RC today or mid-day tomorrow.

- We still have about 10 issues that can be fixed between now and a
release candidate. CLOUDSTACK-1999 and CLOUDSTACK-2000 are unassigned
and should be easy fixes if someone would like to pick those up.
CLOUDSTACK-827 is also unassigned (document new advanced searching
capabilities) and it would be great if we can get that one knocked out
as well. 

- Ignore CLOUDSTACK-1584 - it's just to ensure we (I) remember to edit
the download page when release time comes. 

If you have any questions about how to contribute to docs and want to
help, please feel free to speak up on the list or ping us on
#cloudstack-dev. 

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

Re: [VOTE] Apache CloudStack 4.0.2

[Noah Slater]

It's a little more nuanced than that. ;) It's very possible that we would
ship a new release that actually introduces known bugs. It is much less
likely that we would ship a release that introduces known critical bugs. In
the end, it is up to the community to decide. And that is a process of a
release manager making the cut, and calling the vote. And then we use our
by-laws and voting rules to decide what we do! :)


On 17 April 2013 15:49, Marcus Sorensen  wrote:

> OK, so the answer is no, we just decide as we go...
> On Apr 17, 2013 8:15 AM, "Chip Childers" 
> wrote:
>
> > On Wed, Apr 17, 2013 at 08:11:38AM -0600, Marcus Sorensen wrote:
> > > Do we have rules set out around this? It seems that we wouldn't stop a
> > > time-based bug fix release from going out just because it doesn't fix
> > every
> > > bug we know of, only if it introduces a bug.
> >
> >
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Apache+CloudStack+Project+Bylaws#ApacheCloudStackProjectBylaws-3.DecisionMaking
> >
> > Section 3.4.3. - Lazy Majority of PMC
> >
> >
>



-- 
NS

[ACS402] Status Update

[Joe Brockmeier]

Current status on 4.0.2:

- Have stopped the first VOTE and will restart tomorrow.

- In addition to CLOUDSTACK-528, we have a few other bugs that could
still be attended to if anyone has the time. These are not blockers, but
if you have the interest in taking a look, please do!

* CLOUDSTACK-643: KVM Snapshots deleted on UI/API do not physically
delete from secondary storage.
* CLOUDSTACK-947: listServiceOfferings doesn't sort by softKey for
non-root users.
* CLOUDSTACK-1638: Network plugins won't be notified VM migration.

Thanks!

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

Re: [ACS41][Patch Request]

[Mice Xia]

There's another one in reviewboard:

https://reviews.apache.org/r/10536/
Summary:
CLOUDSTACK-1894 User is not able to deploy VMs in a project[permission
denied to access the guest network)



2013/4/17 Chip Childers 

> On Wed, Apr 17, 2013 at 09:36:20PM +0800, Mice Xia wrote:
> > commit 4d0a460bad05bfc89a9f2d93724221c7c517626e
> > Author: Mice Xia 
> > Date:   Wed Apr 17 21:24:33 2013 +0800
> >
> > fix CLOUDSTACK 1991 CreateTagsCmd.java, DeleteTagsCmd.java, and
> > ListTagsCmd.java all contain invalid version
> >
> > ---
> >
> > https://reviews.apache.org/r/10536/
> > Summary:
> > CLOUDSTACK-1894 User is not able to deploy VMs in a project[permission
> > denied to access the guest network)
> >
> >
> > Regards
> > Mice
>
> Done!
>
> commit 9d70859a9bf8bc0c42a7df159e3e80dfc38dfbf4
> Author: Mice Xia 
> Date:   Wed Apr 17 21:24:33 2013 +0800
>
> fix CLOUDSTACK 1991 CreateTagsCmd.java, DeleteTagsCmd.java, and
> ListTagsCmd.java all contain invalid version
>

Re: [DOCS][ACS41] Status Update

[Sebastien Goasguen]

On Apr 17, 2013, at 10:53 AM, Joe Brockmeier  wrote:

> Hey all,
> 
> Just a quick update on the docs status.
> 
> - Still working on release notes, in the final stretch now. I hope to
> have something ready to go out with the RC today or mid-day tomorrow.
> 
> - We still have about 10 issues that can be fixed between now and a
> release candidate. CLOUDSTACK-1999 and CLOUDSTACK-2000 are unassigned
> and should be easy fixes if someone would like to pick those up.

Done, closed 1999, did not close 2000 yet waiting for confirmation from bug 
reporter

> CLOUDSTACK-827 is also unassigned (document new advanced searching
> capabilities) and it would be great if we can get that one knocked out
> as well. 
> 
> - Ignore CLOUDSTACK-1584 - it's just to ensure we (I) remember to edit
> the download page when release time comes. 
> 
> If you have any questions about how to contribute to docs and want to
> help, please feel free to speak up on the list or ping us on
> #cloudstack-dev. 
> 
> Best,
> 
> jzb
> -- 
> Joe Brockmeier
> j...@zonker.net
> Twitter: @jzb
> http://www.dissociatedpress.net/

Re: physical network is in incorrect state:Disabled

[Alena Prokharchyk]

Hi Sanjay,

You have to enable the physical network explicitly after its creation if
you configure CS using APIs. Here is the example of the command:

http://localhost:8096/?command=updatePhysicalNetwork&id=&state=Enable
d

The cloudStack UI automatically does this call for you as the last step of
the zone creation.

-Alena.

On 4/17/13 3:40 AM, "Sanjay Tripathi"  wrote:

>Hi,
>
>While setting up the environment with the latest master code, the
>"createNetwork" API fails with this error message: "failed to create a
>guest network for basic zone Error: Specified physical network id is in
>incorrect state:Disabled". I checked the DB and found that in
>physical_network table the data entry is in disabled state.
>
>Is anyone else facing the same issue, or is there any use case why
>physical network is in disabled state?
>
>--Sanjay
>

Virtual Routers Failover

[Jeronimo Garcia]

Hi List.

I've experienced some erratic behavior when when setting a host in
maintenance mode:

I had about 6 Virtual routers running and 2 system vms in a given host ,
 after putting this host in maintenance mode  the system vms failed
over successfully.

The problem came in when the VirtualRouters failed over , they did not
start up at all, even after waiting 1 hour for HA to kick in .

When i went on and start the virtual routers manually it would fail with
this error:

*2013-04-17 08:54:39,566 DEBUG [allocator.impl.FirstFitAllocator]
(catalina-exec-2:null) Host name: kickseed, hostId: 1 is in avoid set,
skipping this and trying other available hosts*
*2013-04-17 08:54:39,566 DEBUG [allocator.impl.FirstFitAllocator]
(catalina-exec-2:null) Host Allocator returning 0 suitable hosts*
*
*
The work around i found is :


   - Destroying the virtual router for network X
   - Restart network X

Is this the expected behaviour for virtual router fail over ?
I'm using cloudstack 4.0.1 on Ubuntu .

Thanks!

Re: CS 4.0.0 - vpc deployment - why tier network limited to 200mb/s ?

[Wei ZHOU]

hi,
the default value of network.throttling.rate and
vm.network.throttling.rate is 200mbps, you can change it in global
setting. Restart management server and network.

best,
wei

2013/4/17, benoit lair :
> Hello guys,
>
>
> I'm testing an preproduction environment with cs4.0.0 onto centos 5.3.
>
> I'm testing a vpc environment.
>
> I'm asking why does the tier networks are limited to 200mb/s (network
> offering DefaultIsolatedNetworkOfferingForVpcNetworksNoLB) ?
> So in xencenter, if i look at the network tab of my vpc vr vm, i got a qos
> of 25600 kbytes/sec.
>
> Is there a risk to create a different network offering with a 1000 mb/s qos
> limit ? no limit ?
>
> What if i want to recreate a multi tier environnment with a no limit of qos
> with a 500 mb/s troughput, a 1000mb/s troughput ?
>
> What do you think about vpc vr capabilities ? any deployment
> recommendations ?
>
>
> Thanks for any advice.
>
> Regards, Benoit Lair.
>

Re: CS 4.0.1 | KVM | CentOS 6.3

[Maurice Lawler]

No the management IP hasn't changed. My question is why when restarting Cloud 
Management the issue is cleared up. Then almost an hour later, it starts in 
again; how do I correct this issue?


On Apr 17, 2013, at 12:23 AM, Chiradeep Vittal  
wrote:

> Did the management server ip change? It somehow thinks there's 2
> management servers.
> 
> On 4/16/13 7:00 PM, "Maurice Lawler"  wrote:
> 
>> Greetings,
>> 
>> I am having this FLOOD my log. I will have you know, this is ONE server
>> ONE HOST. KVM | CentOS 6.3 | Cloudstack 4.0.1
>> 
>> I have found restarting cloud management solves the issue for awhile,
>> then it starts again.
>> 
>> Please advise.
>> 
>> - Maurice
>> 
>>  Eror Log 
>> 
>> 2013-04-16 20:58:38,993 DEBUG
>> [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1
>> is ready to launch console proxy
>> 2013-04-16 20:58:39,137 DEBUG [cloud.cluster.ClusterManagerImpl]
>> (Cluster-Heartbeat-1:null) Detected management node left, id:1,
>> nodeIP:MYIPADDRESSHERE
>> 2013-04-16 20:58:39,137 INFO  [cloud.cluster.ClusterManagerImpl]
>> (Cluster-Heartbeat-1:null) Trying to connect to MYIPADDRESSHERE
>> 2013-04-16 20:58:39,138 INFO  [cloud.cluster.ClusterManagerImpl]
>> (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by
>> timestamp but is pingable
>> 2013-04-16 20:58:39,264 DEBUG
>> [network.router.VirtualNetworkApplianceManagerImpl]
>> (RouterStatusMonitor-1:null) Found 0 routers.
>> 2013-04-16 20:58:40,637 DEBUG [cloud.cluster.ClusterManagerImpl]
>> (Cluster-Heartbeat-1:null) Detected management node left, id:1,
>> nodeIP:MYIPADDRESSHERE
>> 2013-04-16 20:58:40,637 INFO  [cloud.cluster.ClusterManagerImpl]
>> (Cluster-Heartbeat-1:null) Trying to connect to MYIPADDRESSHERE
>> 2013-04-16 20:58:40,637 INFO  [cloud.cluster.ClusterManagerImpl]
>> (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by
>> timestamp but is pingable
>> 2013-04-16 20:58:42,062 DEBUG [agent.manager.AgentManagerImpl]
>> (AgentManager-Handler-13:null) Ping from 3
>> 2013-04-16 20:58:42,063 DEBUG [agent.manager.AgentManagerImpl]
>> (AgentManager-Handler-14:null) Ping from 4
>> 2013-04-16 20:58:42,138 DEBUG [cloud.cluster.ClusterManagerImpl]
>> (Cluster-Heartbeat-1:null) Detected management node left, id:1,
>> nodeIP:MYIPADDRESSHERE
>> 2013-04-16 20:58:42,138 INFO  [cloud.cluster.ClusterManagerImpl]
>> (Cluster-Heartbeat-1:null) Trying to connect to MYIPADDRESSHERE
>> 2013-04-16 20:58:42,138 INFO  [cloud.cluster.ClusterManagerImpl]
>> (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by
>> timestamp but is pingable
>> 
>> ===
> 

Re: database creator

[Min Chen]

In my opinion, rolling upgrade may not be an accurate term here for this
task. In my previous experience, rolling upgrade is defined as a upgrade
process that allows users to keep their existing distributed system
running while they upgrade each system gradually. I don't think that this
is the case we are trying to achieve here, and I would suggest stopping
using that term to avoid confusion.

Thanks
-min

On 4/17/13 6:25 AM, "Rohit Yadav"  wrote:

>On Tue, Apr 16, 2013 at 7:33 PM, Abhinandan Prateek
>> wrote:
>
>>
>> I have some queries regarding Database Creator:
>>
>> Can this feature be tested on 4.1 ?
>>
>
>No, it's only in master. But starting 4.2, all ACS versions will have that
>until they will have dbcreator.
>
>For 4.1, we don't have rolling upgrade during fresh db setup using
>cloudstack-database-setup. In 4.1, when mgmt server would start, it would
>do the upgrade (or one of the clustered mgmt servers) like before. For
>4.2,
>it would upgrade at the time of fresh deployment.
>
>
>>
>> Could someone also provide more details on the following:
>>
>>  
>>
>> 1. Outline the exact steps that are involved in rolling upgrade
>>procedure?
>>
>
>Wiki! Get the src and try it yourself.
>
> 
>>
>> 2. Can you confirm if rolling upgrades are specific to only upgrade
>> procedure involving multiple management servers in a cluster?
>>
>
>No, as mentioned. For 4.1, like before. Starting 4.2/master, the tools
>should be called explicitly to upgrade db or deploy a fresh db. More on
>3.;
>
>
>
>> 
>>
>> 3. Would rolling upgrades mean that there will be zero downtime for
>> customers when upgrading? Are we also dealing with NOT having to restart
>> all system Vms ? Currently restarting system Vms is part of our upgrade
>> procedure.
>>
>
>
>So not really, while  on paper and on wiki would give you zero downtime.
>The idea is:
>
>For fresh installation, it's a no brainer. I will refer to "tool" as the
>utility (cloudstack-database-setup or databasecreator). For existing
>deployments in case of a mgmt server cluster:
>
>- Admin shuts down one server, upgrades cloudstack and gets
>cloudstack-setup-database or databasecreator.
>- Admin uses the tool to upgrade CloudStack db to a state that is backward
>compatible to the old db version.
>- Next Admin starts CS on that server and stop-upgrade-starts CS on each
>servers.
>- When all are up, admin calls the cleanup logic to cleanup.
>
>Note: We got the databasecreator, but its not smooth.
>
>I'm not in a state to work on CloudStack fulltime now, someone pl. help us
>to:
>- fix packaging and java classpath in cloudstack-setup-database and also
>fix args processing and pass them to dbcreator via the python script
>- test the whole thing, the explicit calling of cleanup and upgrade are
>not
>different now. Right now with dbcreator you can either do fresh
>deployments
>or upgrades only. Clean+Upgrade is united.
>- test and fix any bugs, imo for a really large deployment using older
>versions of CS, the transition won't be smooth. But for ACS 4.0+
>deployments, we can theoretically expect zero downtime.
>
>Cheers.

Re: CS 4.0.0 - vpc deployment - why tier network limited to 200mb/s ?

[Alena Prokharchyk]

You can change it on the network offering level (networkRate parameter).
Create a new network offering with the desired network rate, and upgrade
your existing network to the new offering. The advantage of this approach
over the global config parameter change is - the global config change will
affect all the networks in the system while when you do it per offering,
you can limit it only to certain networks.


-Alena.

On 4/17/13 9:42 AM, "Wei ZHOU"  wrote:

>hi,
>the default value of network.throttling.rate and
>vm.network.throttling.rate is 200mbps, you can change it in global
>setting. Restart management server and network.
>
>best,
>wei
>
>2013/4/17, benoit lair :
>> Hello guys,
>>
>>
>> I'm testing an preproduction environment with cs4.0.0 onto centos 5.3.
>>
>> I'm testing a vpc environment.
>>
>> I'm asking why does the tier networks are limited to 200mb/s (network
>> offering DefaultIsolatedNetworkOfferingForVpcNetworksNoLB) ?
>> So in xencenter, if i look at the network tab of my vpc vr vm, i got a
>>qos
>> of 25600 kbytes/sec.
>>
>> Is there a risk to create a different network offering with a 1000 mb/s
>>qos
>> limit ? no limit ?
>>
>> What if i want to recreate a multi tier environnment with a no limit of
>>qos
>> with a 500 mb/s troughput, a 1000mb/s troughput ?
>>
>> What do you think about vpc vr capabilities ? any deployment
>> recommendations ?
>>
>>
>> Thanks for any advice.
>>
>> Regards, Benoit Lair.
>>
>

Re: deployDataCenter.py doesn't work for me on master

[Soheil Eizadi]

I copied the vhd-util from
http://download.cloud.com.s3.amazonaws.com/tools/vhd-util to
scripts/vm/hypervisor/xenserver/vhd-util in the tree, but it did not
resolve my issue. (The problem is not with the functionality of the
vhd-util but a path problem. I get that the vhd-util should be updated and
I have done that as well in my environment.)

As I noted below the problem is that it is not getting copied to right
place and also I find different versions of the higher level script i.e.
copy_vhd_from_secondarystorage.sh in my tree which is strange. There is
different vhd-util paths in them.
-Soheil


On 4/15/13 4:07 PM, "Anthony Xu"  wrote:

>>>The XenServer (6.0.2) I am using already came bundled with vhd-util, I
>>>did not have to download it. I have not read the detail of
>
>Hi Soheil,
>
>We added one function in vhd-util, which allows vhd-util specifiy parent
>when do coalesce, basically you can coalesce a VHD file to other VHD
>file. 
>CS uses this vhd-util function in API creating template/volume from
>snapshot.  These APIs might not work with bundled vhd-util in XenServer.
>
>
>Anthony
>
>
>
>-Original Message-
>From: Soheil Eizadi [mailto:seiz...@infoblox.com]
>Sent: Saturday, April 13, 2013 11:05 PM
>To: dev@cloudstack.apache.org
>Subject: Re: deployDataCenter.py doesn't work for me on master
>
>Downloaded the vhd-util to my environment and had the same problem. I
>Debugged this further by running the copy_vhd_from_secondarystorage.sh on
>the XenServer. It looks like the copy_vhd_from_secondarystorage.sh is
>looking for vhd-util in /opt/xensource/bin/ rather than /usr/bin/
>
>I looked at this further and looks like what is built in the
>client/target directory is not consistent with what is in the
>./scripts/vm in my tree.
>There are two versions of copy_vhd_from_secondarystorage.sh.
>
>I removed the client/target directory and rebuilt, but had the same files
>appear again. I am not sure how they are getting pulled in to the
>client/target directory. Any ideas why my build is broken and how to
>proceed to fix this?
>
>For now I patched this on my XenServer and was able to get ssvm and
>cproxyvm running and brought up my CloudStack zone completely.
>-Soheil
>
>
>Administrators-MacBook-Pro-7:cloudstack seizadi$ find . -name
>copy_vhd_from_secondarystorage.sh
>./client/target/cloud-client-ui-4.2.0-SNAPSHOT/WEB-INF/classes/scripts/vm/
>h
>ypervisor/xenserver/copy_vhd_from_secondarystorage.sh
>./client/target/cloud-client-ui-4.2.0-SNAPSHOT/WEB-INF/classes/scripts/vm/
>h
>ypervisor/xenserver/xcposs/copy_vhd_from_secondarystorage.sh
>./client/target/generated-webapp/WEB-INF/classes/scripts/vm/hypervisor/xen
>s
>erver/copy_vhd_from_secondarystorage.sh
>./client/target/generated-webapp/WEB-INF/classes/scripts/vm/hypervisor/xen
>s
>erver/xcposs/copy_vhd_from_secondarystorage.sh
>./scripts/vm/hypervisor/xenserver/copy_vhd_from_secondarystorage.sh
>./scripts/vm/hypervisor/xenserver/xcposs/copy_vhd_from_secondarystorage.sh
>
>
>Administrators-MacBook-Pro-7:cloudstack seizadi$ find . -name
>copy_vhd_from_secondarystorage.sh -exec diff
>./client/target/generated-webapp/WEB-INF/classes/scripts/vm/hypervisor/xen
>s
>erver/copy_vhd_from_secondarystorage.sh {} \;
>92c92
>< VHDUTIL="/opt/xensource/bin/vhd-util"
>---
>> VHDUTIL="/usr/bin/vhd-util"
>113c113
>< if [ $type != "nfs" -a $type != "ext" ]; then
>---
>> if [ $type != "nfs" -a $type != "ext" -a $type != "file" ]; then
>143c143
><   desvhd=/var/run/sr-mount/$sruuid/$uuid.vhd
>---
>>   desvhd=/run/sr-mount/$sruuid/$uuid.vhd
>160a161,166
>> elif [ $type == "file" ]; then
>>   pbd=`xe sr-param-list uuid=$sruuid |grep PBDs | awk '{print $3}'`
>>   path=`xe pbd-param-list uuid=$pbd |grep device-config |awk '{print
>>$4}'`
>>   desvhd=$path/$uuid.vhd
>>   copyvhd $desvhd $vhdfile 0 $type
>> 
>92c92
>< VHDUTIL="/opt/xensource/bin/vhd-util"
>---
>> VHDUTIL="/usr/bin/vhd-util"
>113c113
>< if [ $type != "nfs" -a $type != "ext" ]; then
>---
>> if [ $type != "nfs" -a $type != "ext" -a $type != "file" ]; then
>143c143
><   desvhd=/var/run/sr-mount/$sruuid/$uuid.vhd
>---
>>   desvhd=/run/sr-mount/$sruuid/$uuid.vhd
>160a161,166
>> elif [ $type == "file" ]; then
>>   pbd=`xe sr-param-list uuid=$sruuid |grep PBDs | awk '{print $3}'`
>>   path=`xe pbd-param-list uuid=$pbd |grep device-config |awk '{print
>>$4}'`
>>   desvhd=$path/$uuid.vhd
>>   copyvhd $desvhd $vhdfile 0 $type
>> 
>Š.
>
>
>[root@xenserver-devcloud /]# copy_vhd_from_secondarystorage.sh
>172.16.197.134:/opt/storage/secondary/template/tmpl/1/1/
>7e934fee-96b5-b297-2c25-b20a14139fd9 DEVTEST
>/opt/xensource/bin/copy_vhd_from_secondarystorage.sh: line 133:
>/opt/xensource/bin/vhd-util: No such file or directory
>Error: Failed to parse field 'virtual-size': expecting an integer
>(possibly with suffix) 9#can not create vdi in sr
>7e934fee-96b5-b297-2c25-b20a14139fd9
>
>[root@xenserver-devcloud /]# cp /usr/sbin/vhd-util
>/opt/xensource/bin/vhd-util [root@xenserver-devcloud /]#
>copy_vhd_from_seconda

RE: [ACS42][QA]Issues with latest Master Build (Xenserver)

[Sangeetha Hariharan]

Thanks Prasanna. It was indeed the problem with my service offerings -  I had 
memory requirement set to 124.00 MB not below 64 MB.
When I increased it to 200 MB , I don't see the problem anymore.
I have always used a service offering with 124.00 MB before on Xenserver 6.0.2 
and did not encounter this issue before.

-Thanks
Sangeetha

-Original Message-
From: prasanna [mailto:srivatsav.prasa...@gmail.com] On Behalf Of Prasanna 
Santhanam
Sent: Tuesday, April 16, 2013 11:58 PM
To: dev@cloudstack.apache.org
Subject: Re: [ACS42][QA]Issues with latest Master Build (Xenserver)

On Tue, Apr 16, 2013 at 04:33:40PM -0700, Sangeetha Hariharan wrote:
> I am not able to start user Vms successfully using the build from master. I 
> am testing with Xenserver 6.0.2 hosts.
> User Vm starts successfully but it gets to stopped state after few seconds.
> 
> deployVM reports success . But later on  cluster sync sees this Vm in 
> stopped state and sends a StopCommand for this VM.

It's not clustersync from the logs really. Something is going wrong on your 
xenserver. I've seen this happen when the VM deployed has mem limits outside 
the static-max and static-min defined by xenserver. So anything below 64MB 
memory starts and then stops. Not sure if that's the case with your deployed VM.


--
Prasanna., 

Re: CS 4.0.1 | KVM | CentOS 6.3

[Chiradeep Vittal]

You probably have another MS connecting to the same database?

On 4/17/13 9:49 AM, "Maurice Lawler"  wrote:

>No the management IP hasn't changed. My question is why when restarting
>Cloud Management the issue is cleared up. Then almost an hour later, it
>starts in again; how do I correct this issue?
>
>
>On Apr 17, 2013, at 12:23 AM, Chiradeep Vittal
> wrote:
>
>> Did the management server ip change? It somehow thinks there's 2
>> management servers.
>> 
>> On 4/16/13 7:00 PM, "Maurice Lawler"  wrote:
>> 
>>> Greetings,
>>> 
>>> I am having this FLOOD my log. I will have you know, this is ONE server
>>> ONE HOST. KVM | CentOS 6.3 | Cloudstack 4.0.1
>>> 
>>> I have found restarting cloud management solves the issue for awhile,
>>> then it starts again.
>>> 
>>> Please advise.
>>> 
>>> - Maurice
>>> 
>>>  Eror Log 
>>> 
>>> 2013-04-16 20:58:38,993 DEBUG
>>> [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null)
>>>Zone 1
>>> is ready to launch console proxy
>>> 2013-04-16 20:58:39,137 DEBUG [cloud.cluster.ClusterManagerImpl]
>>> (Cluster-Heartbeat-1:null) Detected management node left, id:1,
>>> nodeIP:MYIPADDRESSHERE
>>> 2013-04-16 20:58:39,137 INFO  [cloud.cluster.ClusterManagerImpl]
>>> (Cluster-Heartbeat-1:null) Trying to connect to MYIPADDRESSHERE
>>> 2013-04-16 20:58:39,138 INFO  [cloud.cluster.ClusterManagerImpl]
>>> (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by
>>> timestamp but is pingable
>>> 2013-04-16 20:58:39,264 DEBUG
>>> [network.router.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:null) Found 0 routers.
>>> 2013-04-16 20:58:40,637 DEBUG [cloud.cluster.ClusterManagerImpl]
>>> (Cluster-Heartbeat-1:null) Detected management node left, id:1,
>>> nodeIP:MYIPADDRESSHERE
>>> 2013-04-16 20:58:40,637 INFO  [cloud.cluster.ClusterManagerImpl]
>>> (Cluster-Heartbeat-1:null) Trying to connect to MYIPADDRESSHERE
>>> 2013-04-16 20:58:40,637 INFO  [cloud.cluster.ClusterManagerImpl]
>>> (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by
>>> timestamp but is pingable
>>> 2013-04-16 20:58:42,062 DEBUG [agent.manager.AgentManagerImpl]
>>> (AgentManager-Handler-13:null) Ping from 3
>>> 2013-04-16 20:58:42,063 DEBUG [agent.manager.AgentManagerImpl]
>>> (AgentManager-Handler-14:null) Ping from 4
>>> 2013-04-16 20:58:42,138 DEBUG [cloud.cluster.ClusterManagerImpl]
>>> (Cluster-Heartbeat-1:null) Detected management node left, id:1,
>>> nodeIP:MYIPADDRESSHERE
>>> 2013-04-16 20:58:42,138 INFO  [cloud.cluster.ClusterManagerImpl]
>>> (Cluster-Heartbeat-1:null) Trying to connect to MYIPADDRESSHERE
>>> 2013-04-16 20:58:42,138 INFO  [cloud.cluster.ClusterManagerImpl]
>>> (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by
>>> timestamp but is pingable
>>> 
>>> ===
>> 
>

RE: [QA][ACS42] Test Plan for Enhanced Baremetal support for Cisco UCS

[Likitha Shetty]

Hi Parth,

The test plan look good to me.

Thanks,
Likitha

>-Original Message-
>From: Parth Jagirdar [mailto:parth.jagir...@citrix.com]
>Sent: Tuesday, April 16, 2013 3:00 PM
>To: dev@cloudstack.apache.org (dev@cloudstack.apache.org)
>Subject: [QA][ACS42] Test Plan for Enhanced Baremetal support for Cisco UCS
>
>Test Plan @
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Enhanced+Baremetal
>+support+for+Cisco+UCS
>
>Requirements @
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Enhanced+Baremetal
>+support+on+Cisco+UCS
>
>FS @
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Cisco+UCS+Integratio
>n+functional+spec
>
>
>Ignore the Change Account Test Plan in above link.. that one got uploaded by
>mistake.
>
>
>...Parth

Re: database creator

[Chip Childers]

On Wed, Apr 17, 2013 at 09:49:53AM -0700, Min Chen wrote:
> In my opinion, rolling upgrade may not be an accurate term here for this
> task. In my previous experience, rolling upgrade is defined as a upgrade
> process that allows users to keep their existing distributed system
> running while they upgrade each system gradually. I don't think that this
> is the case we are trying to achieve here, and I would suggest stopping
> using that term to avoid confusion.

+1

Re: Review Request: CLOUDSTACK-1894 User is not able to deploy VMs in a project[permission denied to access the guest network)

[Chip Childers]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10536/
---

(Updated April 17, 2013, 5:21 p.m.)


Review request for cloudstack and Chip Childers.


Description
---

this is merged from cbcb83b086f4a87aa0703e18a03938b808ed044f in master


This addresses bug CLOUDSTACK-1894.


Diffs
-

  server/src/com/cloud/network/NetworkModelImpl.java d39214a 

Diff: https://reviews.apache.org/r/10536/diff/


Testing
---


Thanks,

mice xia

Re: inheritable componentContexts

[Kelven Yang]

On 4/16/13 11:55 PM, "Prasanna Santhanam"  wrote:

>On Tue, Apr 16, 2013 at 09:43:47AM -0700, Kelven Yang wrote:
>> 
>> 
>> On 4/16/13 1:15 AM, "Prasanna Santhanam"  wrote:
>> 
>> >This is probably a question for the Spring community but I'll ask here
>> >anyway. Every so often when the componentContext.xml.in changes I find
>> >that I have to fix up simulatorComponentContext.xml.in similarly to
>> >make the beans load appropriately and for the bvt tests to work.
>> >
>> >Is there a way similar to the components-premium.xml we had before to
>> >'inherit' Spring contexts so it's easier to maintain the xmls?
>> >
>> >-- 
>> >Prasanna.,
>> 
>> Unfortunately, Spring does not provide an out-of-box solution to inherit
>> between XML configuration files currently, however it provides the
>>feature
>> to merge several independent context files together.
>> 
>> What you may do is to have your simulator components in a separated
>> context XML file and have Spring merge it along with other common
>>context
>> files (like we did for applicationContext.xml + componentContext.xml).
>> 
>
>Thanks Kelven, I explored the merging of contexts and it might be
>unsuitable for my case since I have to override some beans of the
>applicationContext that are required for the simulator. Specifically
>the SecondaryStorageDiscoverer needs to be overridden by the
>SimulatorSecondaryStorageDiscoverer.

It is possible to build our own context file merging strategies that
supports overriding, this should simplify the cases where you want most of
configuration to be in default. You may file an improvement ticket. I
personally will look into it at a later time after I have finished my
other tasks.

-Kelven

>
>-- 
>Prasanna.,

[MERGE] Mixed zone management

[Brian Federle]

Hello,

I would like to merge down the 'mixed zone management' support: 
https://issues.apache.org/jira/browse/CLOUDSTACK-738

This adds a new drop-down to the top of the UI to filter out zones by type - 
either 'Basic' 'Advanced' or by both basic + advanced (the default). This 
allows a better workflow for users/admins to only view features pertaining to 
the zone type they are primarily managing. - i.e., if the drop-down is set to 
'Basic' then features unavailable to basic zones will be hidden in the UI, such 
as VPC.

Note that this change also converts the project switcher on the header to a 
drop-down, for visual consistency.

Branch is ui-mixed-zone-management

-Brian

[MERGE] Mixed zone management

[Brian Federle]

[Re-sending, accidentally sent to the old incubator list before due to e-mail 
client autocorrect :)]

Hello,

I would like to merge down the 'mixed zone management' support: 
https://issues.apache.org/jira/browse/CLOUDSTACK-738

This adds a new drop-down to the top of the UI to filter out zones by type - 
either 'Basic' 'Advanced' or by both basic + advanced (the default). This 
allows a better workflow for users/admins to only view features pertaining to 
the zone type they are primarily managing. - i.e., if the drop-down is set to 
'Basic' then features unavailable to basic zones will be hidden in the UI, such 
as VPC.

Note that this change also converts the project switcher on the header to a 
drop-down, for visual consistency.

Branch is ui-mixed-zone-management

-Brian

Re: Review Request: CLOUDSTACK-1894 User is not able to deploy VMs in a project[permission denied to access the guest network)

[ASF Subversion and Git Services]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10536/#review19329
---


Commit abbe8ce71fdd96220bc0c7abfb08f7ea00fcb1d0 in branch refs/heads/4.1 from 
Chip Childers 
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=abbe8ce ]

Fix CLOUDSTACK-1894 User is not able to deploy VMs in a project[permission 
denied to access the guest network)

Signed-off-by: Mice Xia 


- ASF Subversion and Git Services


On April 17, 2013, 5:21 p.m., mice xia wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10536/
> ---
> 
> (Updated April 17, 2013, 5:21 p.m.)
> 
> 
> Review request for cloudstack and Chip Childers.
> 
> 
> Description
> ---
> 
> this is merged from cbcb83b086f4a87aa0703e18a03938b808ed044f in master
> 
> 
> This addresses bug CLOUDSTACK-1894.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/network/NetworkModelImpl.java d39214a 
> 
> Diff: https://reviews.apache.org/r/10536/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> mice xia
> 
>

Re: Review Request: CLOUDSTACK-1894 User is not able to deploy VMs in a project[permission denied to access the guest network)

[Chip Childers]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10536/#review19330
---

Ship it!


Ship It!

- Chip Childers


On April 17, 2013, 5:21 p.m., mice xia wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10536/
> ---
> 
> (Updated April 17, 2013, 5:21 p.m.)
> 
> 
> Review request for cloudstack and Chip Childers.
> 
> 
> Description
> ---
> 
> this is merged from cbcb83b086f4a87aa0703e18a03938b808ed044f in master
> 
> 
> This addresses bug CLOUDSTACK-1894.
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/network/NetworkModelImpl.java d39214a 
> 
> Diff: https://reviews.apache.org/r/10536/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> mice xia
> 
>

Re: [ACS41][Patch Request]

[Chip Childers]

On Tue, Apr 16, 2013 at 10:27:17PM -0600, Marcus Sorensen wrote:
> Thanks, here's one more related to it...
> 
> commit 2057221f4f1fd5afde422b367fc416d4e44275cb
> Author: Marcus Sorensen 
> Date:   Tue Apr 16 22:18:38 2013 -0600
> 
>  CLOUDSTACK-2051 - The previous patch ensures that holes in deleting
> storage
> pools the proper way won't cause problems for KVM HA Monitor, this
> patch closes
> holes. Call the KVMStoragePool deleteStoragePool that properly removes
> it from
> the KVMHA hashmap, instead of the pools direct delete() call.
> 
> Signed-off-by: Marcus Sorensen  1366172318
> -0600

Done

Re: [ACS41][Patch Request]

[Chip Childers]

On Wed, Apr 17, 2013 at 11:55:16PM +0800, Mice Xia wrote:
> There's another one in reviewboard:
> 
> https://reviews.apache.org/r/10536/
> Summary:
> CLOUDSTACK-1894 User is not able to deploy VMs in a project[permission
> denied to access the guest network)

Done

Re: [MERGE] Mixed zone management

[Chip Childers]

On Wed, Apr 17, 2013 at 10:25:56AM -0700, Brian Federle wrote:
> [Re-sending, accidentally sent to the old incubator list before due to e-mail 
> client autocorrect :)]
> 
> Hello,
> 
> I would like to merge down the 'mixed zone management' support: 
> https://issues.apache.org/jira/browse/CLOUDSTACK-738
> 
> This adds a new drop-down to the top of the UI to filter out zones by type - 
> either 'Basic' 'Advanced' or by both basic + advanced (the default). This 
> allows a better workflow for users/admins to only view features pertaining to 
> the zone type they are primarily managing. - i.e., if the drop-down is set to 
> 'Basic' then features unavailable to basic zones will be hidden in the UI, 
> such as VPC.
> 
> Note that this change also converts the project switcher on the header to a 
> drop-down, for visual consistency.
> 
> Branch is ui-mixed-zone-management
> 
> -Brian
>

Hey Brian,

Can you do us a favor and look at some of the more recent merge
requests?  Folks have been doing a great job referencing all of the
checks we're asking each other for in the merge expectation page [1].

Just talking through what's done and not would be enough.

-chip

[1]
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Branch+Merge+Expectations

[ACS41] Status Update

[Chip Childers]

Hi all,

Here's where we stand on ACS 4.1:

One new blocker opened by Marcus today (which he assigned to himself):

CLOUDSTACK-2067
KVM virtual machines can fail to start but CS thinks they are running

We also need to complete the release notes / upgrade instructions.

AFAIK, that's it.  So once we see 2067 get resolved, and we have the
release notes / upgrade instructions ironed out, we'll kick off a vote
for 4.1.0.

-chip

RE: [MERGE] Mixed zone management

[Brian Federle]

Sorry, I'm confused as to what is missing in my merge request. From the wiki:

"Send an email with a "[MERGE]" tag in the subject line to the dev list.  It's 
useful to point to the design doc on the wiki, the jira record for the work, 
and any of the critical discussions that talk about the changes.  The reason 
for an email like this is to help the community understand what the changes 
will be.  Because of this goal, pointing to the commit-sh in master that tells 
everyone what point in the master tree they should use to compare the branch 
with.  Seeing a clean diff is critical to reviewing the proposed merge.

Once you send that email, wait for feedback for at least 72 hours!

If there is any constructive feedback or there are any concerns raised, address 
them before pushing to master.  Ideally, other community members will want to 
reach consensus on any issues without formally vetoing a merge, so respect 
concerns and work to get consensus from the community.

If there are no issues, proceed with your merge."

I specified the branch name and jira ticket. What else do I need, or do I need 
to format the merge in a specific way? I do need a diff file?

-Brian

-Original Message-
From: Chip Childers [mailto:chip.child...@sungard.com] 
Sent: Wednesday, April 17, 2013 10:32 AM
To: dev@cloudstack.apache.org
Subject: Re: [MERGE] Mixed zone management

On Wed, Apr 17, 2013 at 10:25:56AM -0700, Brian Federle wrote:
> [Re-sending, accidentally sent to the old incubator list before due to 
> e-mail client autocorrect :)]
> 
> Hello,
> 
> I would like to merge down the 'mixed zone management' support: 
> https://issues.apache.org/jira/browse/CLOUDSTACK-738
> 
> This adds a new drop-down to the top of the UI to filter out zones by type - 
> either 'Basic' 'Advanced' or by both basic + advanced (the default). This 
> allows a better workflow for users/admins to only view features pertaining to 
> the zone type they are primarily managing. - i.e., if the drop-down is set to 
> 'Basic' then features unavailable to basic zones will be hidden in the UI, 
> such as VPC.
> 
> Note that this change also converts the project switcher on the header to a 
> drop-down, for visual consistency.
> 
> Branch is ui-mixed-zone-management
> 
> -Brian
>

Hey Brian,

Can you do us a favor and look at some of the more recent merge requests?  
Folks have been doing a great job referencing all of the checks we're asking 
each other for in the merge expectation page [1].

Just talking through what's done and not would be enough.

-chip

[1]
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Branch+Merge+Expectations

Re: Review Request: Remove 2k limitation for user data on a deployVMCmd issued as an HTTP POST request

[Chiradeep Vittal]

Would be great if it passes pep8 also.(just my nitpicky self)

On 4/17/13 6:49 AM, "prasanna"  wrote:

>On 17 April 2013 17:10, Prasanna Santhanam  wrote:
>> On Wed, Apr 17, 2013 at 11:52:08AM +0530, Prasanna Santhanam wrote:
>>> On Wed, Apr 17, 2013 at 11:10:01AM +0530, Rohit Yadav wrote:
>>> >
>>> >
>>> > If it does not cost much, let's introduce a new dependency for
>>>requesting
>>> > stuff (get or post etc.) using "requests" [1] for both marvin and
>>> > cloudmonkey. Vijay, you can write your own requester, as it's not
>>>much
>>> > effort required to implement your own requester once you how
>>>signature is
>>> > calculated.
>>> >
>>> > IMO, cloudstackConnection could be rewritten using latest ways and
>>>better
>>> > libraries as it's not much code and is totally do-able with much less
>>> > effort. A lot of flows for auth or non-auth are inter-dependent, the
>>> > json->obj and obj->json parts and requesting logic is not straight
>>>forward
>>> > (each method does *only* one thing). We need to make it generic by
>>> > providing both raw and processed outputs, for example the result
>>>expects to
>>> > return an obj and not json (maybe I need json and not an obj), one
>>>reason
>>> > why I chose to write my own for cloudmonkey after I tried to reuse
>>>it.
>>> > Lastly, host marvin on pypi so it's easier for any developer to get
>>>it off
>>> > the shelf and start hacking some cool clients.
>>> >
>>> > Cheers.
>>> >
>>> > [1] http://docs.python-requests.org/en/latest/
>>> >
>>> >
>>>
>>> Yeah - we should simplify cloudstackConnection and make it easily
>>> exportable for both cloudmonkey,marvin and any other tools that might
>>> require to make connections to CS mgmt. requests certainly looks
>>> elegant. I'm trying to experiment with it to see if I can cook up
>>> something for marvin.
>>>
>>> At one point I moved from httplib to urllib2 to overcome an annoying
>>> BadStatusLine issue from httplib. I still find it hard to throttle
>>> multiple tests through a single connection and urllib3 seems to handle
>>> that. requests appears to be based on urllib3. So it would make sense
>>> to move to it.
>>>
>>> The json decode,encode is not done within cloudstackConnection. That
>>> part is annoying and I explored json and simplejson and there doesn't
>>> seem to be an easy way to accomplish marvin's case. Esp. with nested
>>> json objects I find it easier to use a recursive json decoder as in
>>> jsonHelper. I've switched to simplejson and find that it performs
>>> better for large jsons like our listXxx calls. jsonHelper right now
>>> makes plain python objects which can be improved to make it a response
>>> object as returned by the API. So a createPhysicalNetworkResponse
>>> looks like the physicalNetworkResponse and not a plain python dict.
>>>
>>
>> I refactored the cloudstackconnection and pushed a wip branch
>> requestsformarvin. Just need to iron out the POST data passing for
>> cmds and the key signing. I think we can add the login mechanism based
>> on session-based auth that the UI does with requests as well. That way
>> we have a single module for all forms of auth done by CS.
>>
>
>Fixed in master and tested using the bvt. I added some basic support
>for being able to handle POST but it's not yet clear to me which of
>the APIs will handle POST. May be if API discovery exposes the
>mechanism GET/POST for an API we can handle the POST data elegantly
>for marvin and cloudmonkey. What say?
>
>I'm trying to bring in further changes to marvin and add DSL support
>after which I'll look into putting it up on pypi.
>
>
>commit 167781ec0184f1332c0b45ca599f460d7d7b5c92
>Author: Prasanna Santhanam 
>Date:   Wed Apr 17 17:06:15 2013 +0530
>
>refactor marvin to use requests instead of urllib2
>
>Use python-requests [1] for Marvin. Requests enables graceful handling
>of http connections. Marvin's cloudstackConnection has been
>refactored,
>cleaned up to act as a single module for all kinds of cloudstack API
>requesting.
>
>TODO:
>1. session based login mechanism of the UI should work from
>cloudstackConnection
>2. cloudmonkey can also reuse /import marvin.cloudstackConnection
>3. More graceful handling of POST requests
>
>[1] http://docs.python-requests.org/en/latest/
>
>Signed-off-by: Prasanna Santhanam 

Re: database creator

[Rohit Yadav]

On Wed, Apr 17, 2013 at 10:19 PM, Min Chen  wrote:

> In my opinion, rolling upgrade may not be an accurate term here for this
> task. In my previous experience, rolling upgrade is defined as a upgrade
> process that allows users to keep their existing distributed system
> running while they upgrade each system gradually. I don't think that this
> is the case we are trying to achieve here, and I would suggest stopping
> using that term to avoid confusion.
>

+1 it's just some upgrade done not by mgmt server but the tool explicitly.

Cheers.


>
> Thanks
> -min
>
> On 4/17/13 6:25 AM, "Rohit Yadav"  wrote:
>
> >On Tue, Apr 16, 2013 at 7:33 PM, Abhinandan Prateek
> > >> wrote:
> >
> >>
> >> I have some queries regarding Database Creator:
> >>
> >> Can this feature be tested on 4.1 ?
> >>
> >
> >No, it's only in master. But starting 4.2, all ACS versions will have that
> >until they will have dbcreator.
> >
> >For 4.1, we don't have rolling upgrade during fresh db setup using
> >cloudstack-database-setup. In 4.1, when mgmt server would start, it would
> >do the upgrade (or one of the clustered mgmt servers) like before. For
> >4.2,
> >it would upgrade at the time of fresh deployment.
> >
> >
> >>
> >> Could someone also provide more details on the following:
> >>
> >>  
> >>
> >> 1. Outline the exact steps that are involved in rolling upgrade
> >>procedure?
> >>
> >
> >Wiki! Get the src and try it yourself.
> >
> > 
> >>
> >> 2. Can you confirm if rolling upgrades are specific to only upgrade
> >> procedure involving multiple management servers in a cluster?
> >>
> >
> >No, as mentioned. For 4.1, like before. Starting 4.2/master, the tools
> >should be called explicitly to upgrade db or deploy a fresh db. More on
> >3.;
> >
> >
> >
> >> 
> >>
> >> 3. Would rolling upgrades mean that there will be zero downtime for
> >> customers when upgrading? Are we also dealing with NOT having to restart
> >> all system Vms ? Currently restarting system Vms is part of our upgrade
> >> procedure.
> >>
> >
> >
> >So not really, while  on paper and on wiki would give you zero downtime.
> >The idea is:
> >
> >For fresh installation, it's a no brainer. I will refer to "tool" as the
> >utility (cloudstack-database-setup or databasecreator). For existing
> >deployments in case of a mgmt server cluster:
> >
> >- Admin shuts down one server, upgrades cloudstack and gets
> >cloudstack-setup-database or databasecreator.
> >- Admin uses the tool to upgrade CloudStack db to a state that is backward
> >compatible to the old db version.
> >- Next Admin starts CS on that server and stop-upgrade-starts CS on each
> >servers.
> >- When all are up, admin calls the cleanup logic to cleanup.
> >
> >Note: We got the databasecreator, but its not smooth.
> >
> >I'm not in a state to work on CloudStack fulltime now, someone pl. help us
> >to:
> >- fix packaging and java classpath in cloudstack-setup-database and also
> >fix args processing and pass them to dbcreator via the python script
> >- test the whole thing, the explicit calling of cleanup and upgrade are
> >not
> >different now. Right now with dbcreator you can either do fresh
> >deployments
> >or upgrades only. Clean+Upgrade is united.
> >- test and fix any bugs, imo for a really large deployment using older
> >versions of CS, the transition won't be smooth. But for ACS 4.0+
> >deployments, we can theoretically expect zero downtime.
> >
> >Cheers.
>
>

Re: devcloud hanging

[Chiradeep Vittal]

It used to work for me (back in Jan). Now I'm on 10.8.
Some old macbook's have the 32-bit version of OSX and I think they cannot run  
DevCloud/DevCloud2

From: Rohit Yadav mailto:bhais...@apache.org>>
Reply-To: "dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Date: Wednesday, April 17, 2013 6:20 AM
To: "dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Subject: Re: devcloud hanging



On Wed, Apr 17, 2013 at 4:25 PM, Daan Hoogland 
mailto:daan.hoogl...@gmail.com>> wrote:
LS,

I tried both the devcloud and devcloud2 images. both seem to hang when started 
with the default (xen) kernel.
I am running macosx 10.6.8 and virtualbox 4.2.12
I enabled pae

Don't enable PAE, importing devcloud2 from the ova should set all the necessary 
settings for you.
Make sure you've 2G RAM given to it and installed the extension pack for your 
version: 
http://download.virtualbox.org/virtualbox/4.2.12/Oracle_VM_VirtualBox_Extension_Pack-4.2.12-84980.vbox-extpack

10.6 is pretty old now, probably the processor is too. There may be 
compatibility issues. May be nested virtualization has issues. Won't be able to 
help you much as I don't have a 10.6 machine to test against, can someone in 
the community confirm running DevCloud2/VirtualBox on 10.6/osx?

Cheers.


In both cases it hangs right after loading initial ramdisk.

Is there any clue I am missing?

thanks
--
[cid:part1.01020805.08000205@gmail.com]

Re: [ACS41] Status Update

[Marcus Sorensen]

I'm testing the fix for that now.

Also, this fix revealed an upstream bug in the management server. There is
a path in advanceStart that can allow it to complete and return a null
object without having successfully started the VM. The caller of this
method (the orch service) doesn't care about the output, it relies on this
method throwing an exception if the VM fails to start. The result is that
calling startVirtualMachine can return a good result, but the VM never
started.

In short I'll be filing a second bug soon. I'm testing a fix for this one
as well.

Unfortunately, master doesn't compile for me at the moment, so it's sort of
difficult to test it against that and check them in to make cherry-pick
requests.


On Wed, Apr 17, 2013 at 11:37 AM, Chip Childers
wrote:

> Hi all,
>
> Here's where we stand on ACS 4.1:
>
> One new blocker opened by Marcus today (which he assigned to himself):
>
> CLOUDSTACK-2067
> KVM virtual machines can fail to start but CS thinks they are running
>
> We also need to complete the release notes / upgrade instructions.
>
> AFAIK, that's it.  So once we see 2067 get resolved, and we have the
> release notes / upgrade instructions ironed out, we'll kick off a vote
> for 4.1.0.
>
> -chip
>

Re: CS 4.0.1 | KVM | CentOS 6.3

[Maurice Lawler]

No. I have ONE server running. 

One MS - One Install of CS - One of everything. All on the same IP address. 


On Apr 17, 2013, at 12:05 PM, Chiradeep Vittal  
wrote:

> You probably have another MS connecting to the same database?
> 
> On 4/17/13 9:49 AM, "Maurice Lawler"  wrote:
> 
>> No the management IP hasn't changed. My question is why when restarting
>> Cloud Management the issue is cleared up. Then almost an hour later, it
>> starts in again; how do I correct this issue?
>> 
>> 
>> On Apr 17, 2013, at 12:23 AM, Chiradeep Vittal
>>  wrote:
>> 
>>> Did the management server ip change? It somehow thinks there's 2
>>> management servers.
>>> 
>>> On 4/16/13 7:00 PM, "Maurice Lawler"  wrote:
>>> 
 Greetings,
 
 I am having this FLOOD my log. I will have you know, this is ONE server
 ONE HOST. KVM | CentOS 6.3 | Cloudstack 4.0.1
 
 I have found restarting cloud management solves the issue for awhile,
 then it starts again.
 
 Please advise.
 
 - Maurice
 
  Eror Log 
 
 2013-04-16 20:58:38,993 DEBUG
 [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null)
 Zone 1
 is ready to launch console proxy
 2013-04-16 20:58:39,137 DEBUG [cloud.cluster.ClusterManagerImpl]
 (Cluster-Heartbeat-1:null) Detected management node left, id:1,
 nodeIP:MYIPADDRESSHERE
 2013-04-16 20:58:39,137 INFO  [cloud.cluster.ClusterManagerImpl]
 (Cluster-Heartbeat-1:null) Trying to connect to MYIPADDRESSHERE
 2013-04-16 20:58:39,138 INFO  [cloud.cluster.ClusterManagerImpl]
 (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by
 timestamp but is pingable
 2013-04-16 20:58:39,264 DEBUG
 [network.router.VirtualNetworkApplianceManagerImpl]
 (RouterStatusMonitor-1:null) Found 0 routers.
 2013-04-16 20:58:40,637 DEBUG [cloud.cluster.ClusterManagerImpl]
 (Cluster-Heartbeat-1:null) Detected management node left, id:1,
 nodeIP:MYIPADDRESSHERE
 2013-04-16 20:58:40,637 INFO  [cloud.cluster.ClusterManagerImpl]
 (Cluster-Heartbeat-1:null) Trying to connect to MYIPADDRESSHERE
 2013-04-16 20:58:40,637 INFO  [cloud.cluster.ClusterManagerImpl]
 (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by
 timestamp but is pingable
 2013-04-16 20:58:42,062 DEBUG [agent.manager.AgentManagerImpl]
 (AgentManager-Handler-13:null) Ping from 3
 2013-04-16 20:58:42,063 DEBUG [agent.manager.AgentManagerImpl]
 (AgentManager-Handler-14:null) Ping from 4
 2013-04-16 20:58:42,138 DEBUG [cloud.cluster.ClusterManagerImpl]
 (Cluster-Heartbeat-1:null) Detected management node left, id:1,
 nodeIP:MYIPADDRESSHERE
 2013-04-16 20:58:42,138 INFO  [cloud.cluster.ClusterManagerImpl]
 (Cluster-Heartbeat-1:null) Trying to connect to MYIPADDRESSHERE
 2013-04-16 20:58:42,138 INFO  [cloud.cluster.ClusterManagerImpl]
 (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by
 timestamp but is pingable
 
 ===
>>> 
>> 
> 

Re: CS 4.0.0 - vpc deployment - why tier network limited to 200mb/s ?

[Wei ZHOU]

yes, you can limit network rate of certain type of networks according to
Alena's approach.
Maybe we also need to limit the network rate of "VMs" in certain networks?


2013/4/17 Alena Prokharchyk 

> You can change it on the network offering level (networkRate parameter).
> Create a new network offering with the desired network rate, and upgrade
> your existing network to the new offering. The advantage of this approach
> over the global config parameter change is - the global config change will
> affect all the networks in the system while when you do it per offering,
> you can limit it only to certain networks.
>
>
> -Alena.
>
> On 4/17/13 9:42 AM, "Wei ZHOU"  wrote:
>
> >hi,
> >the default value of network.throttling.rate and
> >vm.network.throttling.rate is 200mbps, you can change it in global
> >setting. Restart management server and network.
> >
> >best,
> >wei
> >
> >2013/4/17, benoit lair :
> >> Hello guys,
> >>
> >>
> >> I'm testing an preproduction environment with cs4.0.0 onto centos 5.3.
> >>
> >> I'm testing a vpc environment.
> >>
> >> I'm asking why does the tier networks are limited to 200mb/s (network
> >> offering DefaultIsolatedNetworkOfferingForVpcNetworksNoLB) ?
> >> So in xencenter, if i look at the network tab of my vpc vr vm, i got a
> >>qos
> >> of 25600 kbytes/sec.
> >>
> >> Is there a risk to create a different network offering with a 1000 mb/s
> >>qos
> >> limit ? no limit ?
> >>
> >> What if i want to recreate a multi tier environnment with a no limit of
> >>qos
> >> with a 500 mb/s troughput, a 1000mb/s troughput ?
> >>
> >> What do you think about vpc vr capabilities ? any deployment
> >> recommendations ?
> >>
> >>
> >> Thanks for any advice.
> >>
> >> Regards, Benoit Lair.
> >>
> >
>
>
>

Re: [QA][ACS42] Test Plan for Change Account Membership CS-1390

[Parth Jagirdar]

Addition,


Verification for successful Move should include following (Applicable to
all move test cases)::

1) Ensure VM is functional (Start, Stop and Access)
2) Ensure old owner doesn't have access to it anymore.
 
ŠParth
 

On 4/15/13 10:17 PM, "Parth Jagirdar"  wrote:

>All,
>
>Test Plan @ 
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Change+account+memb
>ership+Test+Plan
>
>CS Bug @ https://issues.apache.org/jira/browse/CLOUDSTACK-1390
>
>Requirements @ 
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Change+account+memb
>ership
>
>FS & UseCases @ 
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Change+Account+Memb
>ership+-+VM
>
>
>ŠParth
>

RE: [MERGE] Mixed zone management

[Brian Federle]

Nevermind, I figured it out I think, I'll submit a review board request for 
this.

-Brian

-Original Message-
From: Brian Federle 
Sent: Wednesday, April 17, 2013 10:40 AM
To: 'dev@cloudstack.apache.org'
Cc: Sonny Chhen; Jessica Wang; Pranav Saxena; Animesh Chaturvedi
Subject: RE: [MERGE] Mixed zone management

Sorry, I'm confused as to what is missing in my merge request. From the wiki:

"Send an email with a "[MERGE]" tag in the subject line to the dev list.  It's 
useful to point to the design doc on the wiki, the jira record for the work, 
and any of the critical discussions that talk about the changes.  The reason 
for an email like this is to help the community understand what the changes 
will be.  Because of this goal, pointing to the commit-sh in master that tells 
everyone what point in the master tree they should use to compare the branch 
with.  Seeing a clean diff is critical to reviewing the proposed merge.

Once you send that email, wait for feedback for at least 72 hours!

If there is any constructive feedback or there are any concerns raised, address 
them before pushing to master.  Ideally, other community members will want to 
reach consensus on any issues without formally vetoing a merge, so respect 
concerns and work to get consensus from the community.

If there are no issues, proceed with your merge."

I specified the branch name and jira ticket. What else do I need, or do I need 
to format the merge in a specific way? I do need a diff file?

-Brian

-Original Message-
From: Chip Childers [mailto:chip.child...@sungard.com]
Sent: Wednesday, April 17, 2013 10:32 AM
To: dev@cloudstack.apache.org
Subject: Re: [MERGE] Mixed zone management

On Wed, Apr 17, 2013 at 10:25:56AM -0700, Brian Federle wrote:
> [Re-sending, accidentally sent to the old incubator list before due to 
> e-mail client autocorrect :)]
> 
> Hello,
> 
> I would like to merge down the 'mixed zone management' support: 
> https://issues.apache.org/jira/browse/CLOUDSTACK-738
> 
> This adds a new drop-down to the top of the UI to filter out zones by type - 
> either 'Basic' 'Advanced' or by both basic + advanced (the default). This 
> allows a better workflow for users/admins to only view features pertaining to 
> the zone type they are primarily managing. - i.e., if the drop-down is set to 
> 'Basic' then features unavailable to basic zones will be hidden in the UI, 
> such as VPC.
> 
> Note that this change also converts the project switcher on the header to a 
> drop-down, for visual consistency.
> 
> Branch is ui-mixed-zone-management
> 
> -Brian
>

Hey Brian,

Can you do us a favor and look at some of the more recent merge requests?  
Folks have been doing a great job referencing all of the checks we're asking 
each other for in the merge expectation page [1].

Just talking through what's done and not would be enough.

-chip

[1]
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Branch+Merge+Expectations

Re: [MERGE] Mixed zone management

[Chip Childers]

On Wed, Apr 17, 2013 at 11:11:37AM -0700, Brian Federle wrote:
> Nevermind, I figured it out I think, I'll submit a review board request for 
> this.

No no, please don't bother doing that!

Give me a few more mins to look through things (in a meeting right now).

> 
> -Brian
> 
> -Original Message-
> From: Brian Federle 
> Sent: Wednesday, April 17, 2013 10:40 AM
> To: 'dev@cloudstack.apache.org'
> Cc: Sonny Chhen; Jessica Wang; Pranav Saxena; Animesh Chaturvedi
> Subject: RE: [MERGE] Mixed zone management
> 
> Sorry, I'm confused as to what is missing in my merge request. From the wiki:
> 
> "Send an email with a "[MERGE]" tag in the subject line to the dev list.  
> It's useful to point to the design doc on the wiki, the jira record for the 
> work, and any of the critical discussions that talk about the changes.  The 
> reason for an email like this is to help the community understand what the 
> changes will be.  Because of this goal, pointing to the commit-sh in master 
> that tells everyone what point in the master tree they should use to compare 
> the branch with.  Seeing a clean diff is critical to reviewing the proposed 
> merge.
> 
> Once you send that email, wait for feedback for at least 72 hours!
> 
> If there is any constructive feedback or there are any concerns raised, 
> address them before pushing to master.  Ideally, other community members will 
> want to reach consensus on any issues without formally vetoing a merge, so 
> respect concerns and work to get consensus from the community.
> 
> If there are no issues, proceed with your merge."
> 
> I specified the branch name and jira ticket. What else do I need, or do I 
> need to format the merge in a specific way? I do need a diff file?
> 
> -Brian
> 
> -Original Message-
> From: Chip Childers [mailto:chip.child...@sungard.com]
> Sent: Wednesday, April 17, 2013 10:32 AM
> To: dev@cloudstack.apache.org
> Subject: Re: [MERGE] Mixed zone management
> 
> On Wed, Apr 17, 2013 at 10:25:56AM -0700, Brian Federle wrote:
> > [Re-sending, accidentally sent to the old incubator list before due to 
> > e-mail client autocorrect :)]
> > 
> > Hello,
> > 
> > I would like to merge down the 'mixed zone management' support: 
> > https://issues.apache.org/jira/browse/CLOUDSTACK-738
> > 
> > This adds a new drop-down to the top of the UI to filter out zones by type 
> > - either 'Basic' 'Advanced' or by both basic + advanced (the default). This 
> > allows a better workflow for users/admins to only view features pertaining 
> > to the zone type they are primarily managing. - i.e., if the drop-down is 
> > set to 'Basic' then features unavailable to basic zones will be hidden in 
> > the UI, such as VPC.
> > 
> > Note that this change also converts the project switcher on the header to a 
> > drop-down, for visual consistency.
> > 
> > Branch is ui-mixed-zone-management
> > 
> > -Brian
> >
> 
> Hey Brian,
> 
> Can you do us a favor and look at some of the more recent merge requests?  
> Folks have been doing a great job referencing all of the checks we're asking 
> each other for in the merge expectation page [1].
> 
> Just talking through what's done and not would be enough.
> 
> -chip
> 
> [1]
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Branch+Merge+Expectations
> 

Re: CS 4.0.0 - vpc deployment - why tier network limited to 200mb/s ?

[Alena Prokharchyk]

I've located the detailed article on how to setup the network throttling
in cloudStack:

http://support.citrix.com/article/CTX132019


The approaches base on the Network type (Guest,Public,Control) and vmType
(VR/UserVm/SSVM)

We might need to add it to Apache Wiki.

-Alena.

On 4/17/13 11:09 AM, "Wei ZHOU"  wrote:

>yes, you can limit network rate of certain type of networks according to
>Alena's approach.
>Maybe we also need to limit the network rate of "VMs" in certain networks?
>
>
>2013/4/17 Alena Prokharchyk 
>
>> You can change it on the network offering level (networkRate parameter).
>> Create a new network offering with the desired network rate, and upgrade
>> your existing network to the new offering. The advantage of this
>>approach
>> over the global config parameter change is - the global config change
>>will
>> affect all the networks in the system while when you do it per offering,
>> you can limit it only to certain networks.
>>
>>
>> -Alena.
>>
>> On 4/17/13 9:42 AM, "Wei ZHOU"  wrote:
>>
>> >hi,
>> >the default value of network.throttling.rate and
>> >vm.network.throttling.rate is 200mbps, you can change it in global
>> >setting. Restart management server and network.
>> >
>> >best,
>> >wei
>> >
>> >2013/4/17, benoit lair :
>> >> Hello guys,
>> >>
>> >>
>> >> I'm testing an preproduction environment with cs4.0.0 onto centos
>>5.3.
>> >>
>> >> I'm testing a vpc environment.
>> >>
>> >> I'm asking why does the tier networks are limited to 200mb/s (network
>> >> offering DefaultIsolatedNetworkOfferingForVpcNetworksNoLB) ?
>> >> So in xencenter, if i look at the network tab of my vpc vr vm, i got
>>a
>> >>qos
>> >> of 25600 kbytes/sec.
>> >>
>> >> Is there a risk to create a different network offering with a 1000
>>mb/s
>> >>qos
>> >> limit ? no limit ?
>> >>
>> >> What if i want to recreate a multi tier environnment with a no limit
>>of
>> >>qos
>> >> with a 500 mb/s troughput, a 1000mb/s troughput ?
>> >>
>> >> What do you think about vpc vr capabilities ? any deployment
>> >> recommendations ?
>> >>
>> >>
>> >> Thanks for any advice.
>> >>
>> >> Regards, Benoit Lair.
>> >>
>> >
>>
>>
>>
>

RE: [QA][ACS42] Test Plan for Change Account Membership CS-1390

[Sangeetha Hariharan]

Parth,

As part of verification after the change in ownership is done , can you include 
the following checks:

1. New owner is able to start the Vm successfully.
2. Original owner is not able to list this Vm.
3. Vm is not part of the original isolated network anymore and cannot be 
accessed from other Vms in this network.
3. Vm is  part of a new isolated network that belongs to the new owner and that 
it can be accessed from other Vms in this network.

  
-Thanks
Sangeetha

-Original Message-
From: Parth Jagirdar [mailto:parth.jagir...@citrix.com] 
Sent: Monday, April 15, 2013 10:18 PM
To: dev@cloudstack.apache.org
Cc: Likitha Shetty
Subject: [QA][ACS42] Test Plan for Change Account Membership CS-1390

All,

Test Plan @ 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Change+account+membership+Test+Plan

CS Bug @ https://issues.apache.org/jira/browse/CLOUDSTACK-1390

Requirements @ 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Change+account+membership

FS & UseCases @ 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Change+Account+Membership+-+VM


...Parth

Re: devcloud hanging

[Rohit Yadav]

On Wed, Apr 17, 2013 at 11:15 PM, Chiradeep Vittal <
chiradeep.vit...@citrix.com> wrote:

> It used to work for me (back in Jan). Now I'm on 10.8.
> Some old macbook's have the 32-bit version of OSX and I think they cannot
> run  DevCloud/DevCloud2
>

DevCloud old and newer both are x86 based and can run on VirtualBox x86. If
someone's old macbooks cannot run 'em then they can contribute by fixing
DevCloud/VBox or replace their laptop :)

Cheers.


>
> From: Rohit Yadav mailto:bhais...@apache.org>>
> Reply-To: "dev@cloudstack.apache.org" <
> dev@cloudstack.apache.org>
> Date: Wednesday, April 17, 2013 6:20 AM
> To: "dev@cloudstack.apache.org" <
> dev@cloudstack.apache.org>
> Subject: Re: devcloud hanging
>
>
>
> On Wed, Apr 17, 2013 at 4:25 PM, Daan Hoogland  > wrote:
> LS,
>
> I tried both the devcloud and devcloud2 images. both seem to hang when
> started with the default (xen) kernel.
> I am running macosx 10.6.8 and virtualbox 4.2.12
> I enabled pae
>
> Don't enable PAE, importing devcloud2 from the ova should set all the
> necessary settings for you.
> Make sure you've 2G RAM given to it and installed the extension pack for
> your version:
> http://download.virtualbox.org/virtualbox/4.2.12/Oracle_VM_VirtualBox_Extension_Pack-4.2.12-84980.vbox-extpack
>
> 10.6 is pretty old now, probably the processor is too. There may be
> compatibility issues. May be nested virtualization has issues. Won't be
> able to help you much as I don't have a 10.6 machine to test against, can
> someone in the community confirm running DevCloud2/VirtualBox on 10.6/osx?
>
> Cheers.
>
>
> In both cases it hangs right after loading initial ramdisk.
>
> Is there any clue I am missing?
>
> thanks
> --
> [cid:part1.01020805.08000205@gmail.com]
>
>

Re: [MERGE] Mixed zone management

[Chip Childers]

Here's the content of a great MERGE email that Likitha sent.  No need
for the reviewboard entry, since you're a committer!  Just an update
that tells us what to diff against to see the branch vs. master.

> Hi all,
>
> I would like to merge the feature Dedicate Public IP ranges to master.
>
> Jira ticket - https://issues.apache.org/jira/browse/CLOUDSTACK-704
> Proposal discussion - 
> http://mail-archives.apache.org/mod_mbox/incubator-cloudstack-users/201303.mbox/%3C64FB1554ABC9B44FAA773FBD6CB889C2010D9C03119B%40BANPMAILBOX01.citrite.net%3E
> FS - 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/FS-+Dedicate+Public+IP+Addresses+per+tenant
> Branch - dedicate_public_ip_range_2
> Unit tests -  Unit tests for the new API's can be found at 
> cloudstack/server/test/com/cloud/configuration/ConfigurationManagerTest.java
> Integration tests - Python tests can be found be found at 
> test/integration/component/test_public_ip_range.py
> Rebased the branch with master - Commit id: 
> d5d167cb97b95f5622c0e34fe4546642484016f6
> RAT report - Attached
> Patch is available at - https://reviews.apache.org/r/10377/
>
> Thanks,
> Likitha

On Wed, Apr 17, 2013 at 2:11 PM, Brian Federle  wrote:
> Nevermind, I figured it out I think, I'll submit a review board request for 
> this.
>
> -Brian
>
> -Original Message-
> From: Brian Federle
> Sent: Wednesday, April 17, 2013 10:40 AM
> To: 'dev@cloudstack.apache.org'
> Cc: Sonny Chhen; Jessica Wang; Pranav Saxena; Animesh Chaturvedi
> Subject: RE: [MERGE] Mixed zone management
>
> Sorry, I'm confused as to what is missing in my merge request. From the wiki:
>
> "Send an email with a "[MERGE]" tag in the subject line to the dev list.  
> It's useful to point to the design doc on the wiki, the jira record for the 
> work, and any of the critical discussions that talk about the changes.  The 
> reason for an email like this is to help the community understand what the 
> changes will be.  Because of this goal, pointing to the commit-sh in master 
> that tells everyone what point in the master tree they should use to compare 
> the branch with.  Seeing a clean diff is critical to reviewing the proposed 
> merge.
>
> Once you send that email, wait for feedback for at least 72 hours!
>
> If there is any constructive feedback or there are any concerns raised, 
> address them before pushing to master.  Ideally, other community members will 
> want to reach consensus on any issues without formally vetoing a merge, so 
> respect concerns and work to get consensus from the community.
>
> If there are no issues, proceed with your merge."
>
> I specified the branch name and jira ticket. What else do I need, or do I 
> need to format the merge in a specific way? I do need a diff file?
>
> -Brian
>
> -Original Message-
> From: Chip Childers [mailto:chip.child...@sungard.com]
> Sent: Wednesday, April 17, 2013 10:32 AM
> To: dev@cloudstack.apache.org
> Subject: Re: [MERGE] Mixed zone management
>
> On Wed, Apr 17, 2013 at 10:25:56AM -0700, Brian Federle wrote:
>> [Re-sending, accidentally sent to the old incubator list before due to
>> e-mail client autocorrect :)]
>>
>> Hello,
>>
>> I would like to merge down the 'mixed zone management' support:
>> https://issues.apache.org/jira/browse/CLOUDSTACK-738
>>
>> This adds a new drop-down to the top of the UI to filter out zones by type - 
>> either 'Basic' 'Advanced' or by both basic + advanced (the default). This 
>> allows a better workflow for users/admins to only view features pertaining 
>> to the zone type they are primarily managing. - i.e., if the drop-down is 
>> set to 'Basic' then features unavailable to basic zones will be hidden in 
>> the UI, such as VPC.
>>
>> Note that this change also converts the project switcher on the header to a 
>> drop-down, for visual consistency.
>>
>> Branch is ui-mixed-zone-management
>>
>> -Brian
>>
>
> Hey Brian,
>
> Can you do us a favor and look at some of the more recent merge requests?  
> Folks have been doing a great job referencing all of the checks we're asking 
> each other for in the merge expectation page [1].
>
> Just talking through what's done and not would be enough.
>
> -chip
>
> [1]
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Branch+Merge+Expectations
>

RE: [PROPOSAL] [CLOUDSTACK-2056] DeploymentPlanner choice via ServiceOffering

[Prachi Damle]

Hi Nitin,

Thanks for the feedback. I have added comments inline.

-Prachi

-Original Message-
From: Nitin Mehta [mailto:nitin.me...@citrix.com] 
Sent: Wednesday, April 17, 2013 1:42 AM
To: dev@cloudstack.apache.org
Subject: Re: [PROPOSAL] [CLOUDSTACK-2056] DeploymentPlanner choice via 
ServiceOffering

Thanks for sharing this with the community Prachi. I read the wiki and had a 
few questions.

Is there a requirement doc for this ? I wanted to understand the use cases for 
this.
>>This is more of refactoring proposal in order to give more flexibility to the 
>>admin  around deployment decisions.
>>The typical use-case will be when Admin wants to facilitate dispersion of VMs 
>>only for some accounts that need it while for any other accounts that do not 
>>care where their VMs land,  keep the deployment random/firstfit. 
>>Since currently planning choice is governed by the global config 
>>vm.allocation.algorithms, Admin cannot make use of the varied deployment 
>>heuristics per account needs. 
>>In the above case, if admin sets this config to 'userdispersion' then the 
>>UserDispersingPlanner gets selected for the entire CS deployment, across all 
>>accounts.

>>Exposing the choice in ServiceOffering, also lets Admin take care of applying 
>>any custom pricing for say user-dispersion or user-concentrated Vs 
>>random/firstfit 

Since all the attributes are visible in service offering to the end user what 
is it we are trying to do here ? Give the flexibility to the end user ? Ideally 
it should give more flexibility to the admin right ?
>> Right, Flexibility to the admin. This is not for end-user usage.

You talked about the vm.allocation.algorithms but talking about the planners so 
I am little confused what is that we are trying to do here.
>> This is the config that selects the planner currently. If we refactor the 
>> planner choice to ServiceOffering, we do not need this variable for choosing 
>> a planner
>>We might have to keep this config around in order to provide the choice for 
>>host/pool allocation.

I see that Hari also proposed changing vm allocation config to zone level.
Is that required any more with this change ?
>>I think so, at least not needed to choose a planner since we bring the 
>>planner choice to ServiceOffering level rather than Zone.
>>Can you please point me to that Proposal? Thanks!

I didn't understand "in a CS deployment multiple planners will have to 
co-exist." bit can you please elaborate with an example here ?
>> After exposing the planners in Svc Offering, some offerings might choose 
>> 'FirstFitPlanner', while some other might choose 'UserDispersingPlanner'.
>>Thus all planners can get used in the same CS deployment - since the choice 
>>will no longer be global. All such planners will apply heuristics to the same 
>>set of resources - hence they might conflict. 

Thanks,
-Nitin

On 17/04/13 5:10 AM, "Prachi Damle"  wrote:

>I would like to propose a new feature - DeploymentPlanner choice via 
>ServiceOffering
>
>Jira ticket created: 
>https://issues.apache.org/jira/browse/CLOUDSTACK-2056
>
>This is to expose the choice of Deployment Planner via Service Offering 
>and let Admin use a mix of Planners in a CS deployment.
>
>The initial draft of the FS is here
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/DeploymentPlanne
>r+c
>hoice+via+ServiceOffering
>
>Please review and comment.
>
>Thanks,
>Prachi

Fwd: createAsync Question

[Mike Tutkowski]

Meant to send this out to the entire list, so others could hear what Edison
has to say, as well.

-- Forwarded message --
From: Mike Tutkowski 
Date: Wed, Apr 17, 2013 at 12:42 PM
Subject: Re: createAsync Question
To: Edison Su 


Ah, I remember our discussion about that more now.

Here is what my createAsync currently looks like (after I read your e-mail):

@Override

public void createAsync(DataObject data,
AsyncCompletionCallback callback) {

String iqn = null;

String errMsg = null;

 if (data.getType() == DataObjectType.VOLUME) {

try {

// just create a SolidFire volume and return IQN

iqn = createSolidFireVolume((VolumeInfo)data);

} catch (StorageUnavailableException e) {

s_logger.debug("Failed to create volume
(StorageUnavailableException)", e);

errMsg = e.toString();

   } catch (Exception e) {

   s_logger.debug("Failed to create volume (Exception)", e);

   errMsg = e.toString();

   }

}

else {

errMsg = "Invalid DataObjectType (" + data.getType() + ")
passed to createAsync";

}

 // path = iqn

// size is pulled from DataObject instance, if errMsg is null

CreateCmdResult result = new CreateCmdResult(iqn, errMsg != null ?
null : data.getSize());

 if (errMsg != null) {

result.setResult(errMsg);

}


callback.complete(result);

}


Do I have to update any DB table at this point now that my volume has been
created on the SAN?


Thanks!!


On Wed, Apr 17, 2013 at 12:09 AM, Edison Su  wrote:

>  Creatasync doesn't need to create a storage pool on the hypervisor host,
> as you don't know which hypervisor host want to access the volume yet.
> The volume will be accessed by hypervisor host in attachvolumecmd, you can
> add your code in citrixresource: execute(attachvolumecmd), to create a sr
> from an iscsi lun, and also create a vdi from the sr, then vbd, the attach
> it to vm.
>
> Sent from my Windows Phone
>  --
> From: Mike Tutkowski 
> Sent: 4/16/2013 1:59 PM
>
> To: Edison Su ; cloudstack-...@incubator.apache.org
> Subject: createAsync Question
>
>  Hi Edison,
>
>  I have another question regarding our discussion yesterday.
>
>  I'm trying to implement the createAsync method.
>
>  This is my impression for how I should start doing so:
>
>  Create a volume on our SAN.  I believe I can get the specs for this
> volume from the Disk Offering like this:
>
>  DiskOfferingVO offering = diskOfferingDao
> .findById(volume.getDiskOfferingId());
>
>  The next part is a bit hazy.  As we discussed yesterday, let's just deal
> with XenServer for the moment.  :)
>
>  I'm thinking after I create my volume on the SAN, I should create an
> instance of CreateStoragePoolCommand and send it to the hypervisor this way:
>
>  Answer answer = storageMgr.sendToPool(pool, null, cmd);
>
>  The type of the storage pool I would place in the
> CreateStoragePoolCommand instance is StoragePoolType.IscsiLUN.
>
>  This would create a storage repository for me on the hypervisor.
>
>  I would then need to create an instance of CreateCommand and send it to
> the hypervisor the same way to create a volume on the storage repository I
> just created:
>
>  Answer answer = storageMgr.sendToPool(pool, null, cmd);
>
>  This volume on the storage repository would consume the entire SR.
>
>  Am I making decent sense here?
>
>  Thanks!
>
>  --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the 
> cloud
> *™*
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*