Re: Review Request 14248: CLOUDSTACK: 4537 - test_vpc_vm_life_cycle.py - Fixed vpc and shared network test cases

[Gaurav Aradhye]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14248/
---

(Updated Oct. 3, 2013, 12:58 p.m.)


Review request for cloudstack, Harikrishna Patnala, Rayees Namathponnan, 
venkata swamy babu  budumuru, and Prasanna Santhanam.


Changes
---

Including Swamy and Harikrishna as reviewers.


Repository: cloudstack-git


Description
---

Fixed Test case test_vpc_vm_life_cycle.py: TestVMLifeCycleSharedNwVPC failed 
with Insufficient address capacity error

Changes:
1) Shared network requires start ip and end ip shile creating it, if you want 
to deploy vm in it. Else it throws Insufficient address capacity error
2) Removed addition of multiple vms in load balancing rule (VMs belonging to 
multiple networks). Because this is not allowed.
3) For test case test_05_destroy_instance_in_network, added wait for cleanup of 
vm. So that after it proceeds to check the network rules.
4) Removed white spaces and unnecessary comments.


Diffs
-

  test/integration/component/test_vpc_vm_life_cycle.py 9844c1f 

Diff: https://reviews.apache.org/r/14248/diff/


Testing
---

Tested locally


Thanks,

Gaurav Aradhye

Review Request 14459: CLOUDSTACK-2243: Add automation tests for VMs base image update faclity

[Ashutosh Kelkar]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14459/
---

Review request for cloudstack and Harikrishna Patnala.


Bugs: CLOUDSTACK-2243


Repository: cloudstack-git


Description
---

Added new test class to test Base Image Updation Facility.


Diffs
-

  test/integration/component/test_base_image_updation.py PRE-CREATION 
  tools/marvin/marvin/integration/lib/base.py 99882fd 

Diff: https://reviews.apache.org/r/14459/diff/


Testing
---


Thanks,

Ashutosh Kelkar

Re: Unable to create instance after upgrading to CloudStack 4.2.0

[Indra Pramana]

Hi Sanjay,

Good day to you, and thank you for your e-mail.

I am going to perform the upgrade on our production servers in the next 1-2
hours. Will let you know the outcome. This is our fourth attempt to upgrade
so I hope there's no other issue crop up.

Can I confirm that this API command will populate all the resources_count
table for all the accounts and domains?

http://localhost:8096/?command=updateResourceCount&account=admin&domainId=1

Looking forward to your reply, thank you.

Cheers.



On Thu, Oct 3, 2013 at 2:07 PM, Sanjay Tripathi
wrote:

> Indra,
>
> The steps are correct.
> Please follow the steps and let me know if you need any help.
>
> This issue got fixed in 4.2-forward branch with this commit:
> 38bbfdc89a50bbb9464700d202d1cfa7b7955953
>
> --Sanjay
>
> > -Original Message-
> > From: Indra Pramana [mailto:in...@sg.or.id]
> > Sent: Thursday, October 03, 2013 10:33 AM
> > To: Alena Prokharchyk
> > Cc: dev@cloudstack.apache.org
> > Subject: Re: Unable to create instance after upgrading to CloudStack
> 4.2.0
> >
> > Hi Alena,
> >
> > Good day to you, and thank you for your confirmation!
> >
> > Can I confirm that this is what I need to do:
> >
> > (1) Before upgrade, run the script to insert the records into
> resource_count
> > table for existing accounts/domains.
> > (2) Perform the upgrade (from 4.1.1 to 4.2.0);
> > (3) After the upgrade, run the API script to populate the records.
> >
> > The above will fix the issues on the existing accounts/domains, and
> future
> > accounts/domains will not be affected and will run as per normal after
> the
> > upgrade.
> >
> > Can I confirm that my above understanding is correct?
> >
> > Looking forward to your reply, thank you.
> >
> > Cheers.
> >
> >
> >
> > On Thu, Oct 3, 2013 at 11:31 AM, Alena Prokharchyk <
> > alena.prokharc...@citrix.com> wrote:
> >
> > > Hi Indra,
> > >
> > > Please see inline.
> > >
> > > -alena.
> > >
> > > On 10/2/13 8:21 PM, "Indra Pramana"  wrote:
> > >
> > > >Hi Alena,
> > > >
> > > >
> > > >Good day to you, and thank you for your e-mail.
> > > >
> > > >
> > > >Does it mean that later after the upgrade, for every newly created
> > > >accounts/domains, I will need to apply the temporary fix all the time?
> > >
> > > No. You should do it just for the accounts/domains existing before the
> > > upgrade. For new accounts, the code should do it automatically as a
> > > part of account creation.
> > >
> > >
> > > > Will it cause any issues if I run the MySQL script again later, e.g.
> > > >will it cause duplicate entries for existing accounts/domains?
> > >
> > > There is a constraint in resource_type table on type/account_id and
> > > type/domain_id, so before running the script, you have to make sure
> > > that the entry doesn't exist already.
> > >
> > > >
> > > >
> > > >Looking forward to your reply, thank you.
> > > >
> > > >Cheers.
> > > >
> > > >
> > > >
> > > >
> > > >On Thu, Oct 3, 2013 at 2:01 AM, Alena Prokharchyk
> > > > wrote:
> > > >
> > > >Indra,
> > > >
> > > >
> > > >the issue would impact only existing accounts/domains. For all newly
> > > >created accounts/domains, you won't see it. By "temporary" Wei meant
> > > >that in the future the problem should be fixed in the CloudStack
> > > >upgrade code; so before the fix is in, this temporary  solution
> > > >should be applied by the customer manually.
> > > >
> > > >
> > > >Answering your other question  how to fix the count. For that, you
> > > >have to execute the API updateResourceCount. Here is the example:
> > > >
> > > >
> > > >
> > >
> > http://localhost:8096/?command=updateResourceCount&account=admin&d
> > omai
> > > nId=
> > > >1
> > > >
> > > >
> > > >-Alena.
> > > >
> > > >
> > > >From: Indra Pramana 
> > > >Reply-To: "dev@cloudstack.apache.org" 
> > > >Date: Wednesday, October 2, 2013 9:05 AM
> > > >To: "dev@cloudstack.apache.org" 
> > > >
> > > >Subject: Re: Unable to create instance after upgrading to CloudStack
> > > >4.2.0
> > > >
> > > >
> > > >
> > > >
> > > >Hi Wei Zhou,
> > > >
> > > >
> > > >Thank you for the temporary solution, I tried to execute the scripts
> > > >and I can see that the records are being inserted into the
> resource_count
> > table!
> > > >:)
> > > >
> > > >
> > > >mysql> select * from resource_count where account_id=2;
> > > >+--++---+---+---+
> > > >| id   | account_id | domain_id | type  | count |
> > > >+--++---+---+---+
> > > >|   17 |  2 |  NULL | user_vm   |33 |
> > > >|   18 |  2 |  NULL | public_ip | 4 |
> > > >|   19 |  2 |  NULL | volume|51 |
> > > >|   20 |  2 |  NULL | snapshot  | 0 |
> > > >|   21 |  2 |  NULL | template  |39 |
> > > >|   22 |  2 |  NULL | project   | 0 |
> > > >|   23 |  2 |  NULL | network   | 1 |
> > > >|   24 |   

Re: Hi

[Daan Hoogland]

H Steve,

I wish you luck with managing the Citrix - Community interaction and given
the continued huge importance of Citrix to Apache CloudStack I am taking
the liberty of calling you our friend.

Welcome,
Daan


On Thu, Oct 3, 2013 at 7:33 AM, Koushik Das  wrote:

> Hi Steve,
>
> Welcome to CloudStack. Looking forward to working with you.
>
>
> On 02-Oct-2013, at 6:10 PM, Chip Childers 
> wrote:
>
> > Welcome Steve!
> >
> >
> > On Wed, Oct 2, 2013 at 12:38 AM, Steve Wilson  >wrote:
> >
> >> Hi Everyone,
> >>
> >> I just wanted to take a second and introduce myself.  I recently joined
> >> Citrix as the VP of Cloud Engineering, and I'm responsible for the
> Citrix
> >> CloudPlatofrm (powered by Apache CloudStack).  I just joined the list
> and
> >> am looking forward to working with everyone in the community.  Feel
> free to
> >> drop me a note if you have suggestions for me on how Citrix can best
> work
> >> with the Apache CloudStack community.
> >>
> >> Thanks,
> >>
> >> -Steve
> >> twitter: @virtualsteve
> >> email: steve.wil...@citrix.com
> >>
>
>

Re: Configuration table changes and database update

[Hugo Trippaers]

Heya guys,

I'm still running into this problem. Our jenkins automagically installs and 
tests the latest packages based on master. With a clean database on clean 
machines.

The error reported is similar to the error encountered:

Caused by: com.cloud.utils.exception.CloudRuntimeException: DB Exception on: 
com.mysql.jdbc.JDBC4PreparedStatement@64726693: SELECT configuration.instance, 
configuration.component, configuration.name, configuration.value, 
configuration.default_value, configuration.description, configuration.category, 
configuration.is_dynamic, configuration.scope, configuration.updated FROM 
configuration WHERE configuration.name = 
_binary'storage.cache.replacement.lru.interval'  ORDER BY RAND() LIMIT 1
at 
com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:421)
at 
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at 
com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:356)
at 
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at 
com.cloud.utils.db.GenericDaoBase.findOneIncludingRemovedBy(GenericDaoBase.java:869)
at 
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at 
org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.findByName(ConfigurationDaoImpl.java:201)
at 
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at 
org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.getValue(ConfigurationDaoImpl.java:166)
at 
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at 
org.apache.cloudstack.storage.cache.manager.StorageCacheReplacementAlgorithmLRU.initialize(StorageCacheReplacementAlgorithmLRU.java:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at 
org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:346)
at 
org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:299)
at 
org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:132)
... 79 more
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown 
column 'configuration.default_value' in 'field list'
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1053)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4074)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4006)
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2468)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2629)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2719)
at 
com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2155)
at 
com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2318)
at 
org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
at 
org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
at 
com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:415)
... 116 more

The full log is here: 
http://nvpmadm1.nvp.strocamp.net:8080/job/cloudstack-qa-env-test/505/console

This still appears to be an issue. How can we make sure that the database is 
properly updated before this piece of code is hit? 

Cheers,

Hugo


On Sep 24, 2013, at 4:13 PM, Daan Hoogland  wrote:

> works in the latest version
> 
> On Tue, Sep 24, 2013 at 4:09 PM, Daan Hoogland  
> wrote:
>> I ran into 

Can't compile cloudstack 4.2 rpms from source

[benoit lair]

Hello guys,


I've already installed cs 4.2 from cloudstack rpm repos.

It seems all is okay.

Now i want to build my own rpm from source.

I work on a centos 6.3 linux for building the rpms.

I followed the docs in order to prepare my dev environment according to the
following page :

http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/sect-source-buildrpm.html

I adapted the filenames (here 4.0.0 with 4.2.0), but i got the following
errors when trying to generate the rpms.

-
[INFO]

[INFO] BUILD FAILURE
[INFO]

[INFO] Total time: 13:26.004s
[INFO] Finished at: Thu Oct 03 10:07:41 CEST 2013
[INFO] Final Memory: 37M/146M
[INFO]

[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile
(default-compile) on project cloud-plugin-hypervisor-xen: Compilation
failure: Compilation failure:
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[890,16]
cannot find symbol
[ERROR] symbol  : variable lockingMode
[ERROR] location: class com.xensource.xenapi.VIF.Record
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[890,36]
cannot find symbol
[ERROR] symbol  : variable VifLockingMode
[ERROR] location: class com.xensource.xenapi.Types
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[1099,12]
cannot find symbol
[ERROR] symbol  : variable lockingMode
[ERROR] location: class com.xensource.xenapi.VIF.Record
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[1099,32]
cannot find symbol
[ERROR] symbol  : variable VifLockingMode
[ERROR] location: class com.xensource.xenapi.Types
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[4869,20]
cannot find symbol
[ERROR] symbol  : variable lockingMode
[ERROR] location: class com.xensource.xenapi.VIF.Record
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[4869,40]
cannot find symbol
[ERROR] symbol  : variable VifLockingMode
[ERROR] location: class com.xensource.xenapi.Types
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer610Resource.java:[160,43]
cannot find symbol
[ERROR] symbol  : method
migrateReceive(com.xensource.xenapi.Connection,com.xensource.xenapi.Network,java.util.Map)
[ERROR] location: class com.xensource.xenapi.Host
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer610Resource.java:[175,30]
cannot find symbol
[ERROR] symbol  : method
assertCanMigrateAsync(com.xensource.xenapi.Connection,java.util.Map,boolean,java.util.Map,java.util.Map,java.util.Map)
[ERROR] location: class com.xensource.xenapi.VM
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer610Resource.java:[189,30]
cannot find symbol
[ERROR] symbol  : method
migrateSendAsync(com.xensource.xenapi.Connection,java.util.Map,boolean,java.util.Map,java.util.Map,java.util.Map)
[ERROR] location: class com.xensource.xenapi.VM
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer610Resource.java:[251,43]
cannot find symbol
[ERROR] symbol  : method
migrateReceive(com.xensource.xenapi.Connection,com.xensource.xenapi.Network,java.util.Map)
[ERROR] location: class com.xensource.xenapi.Host
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer610Resource.java:[310,30]
cannot find symbol
[ERROR] symbol  : method
assertCanMigrateAsync(com.xensource.xenapi.Connection,java.util.Map,boolean,java.util.Map,java.util.Map,java.util.Map)
[ERROR] location: class com.xensource.xenapi.VM
[ERROR]
/root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hyperv

Re: Can't compile cloudstack 4.2 rpms from source

[benoit lair]

A precision, the linux centos 6.3 i used is a ghost of the centos 6.3
environment i use for compiling apache cloudstack 4.0.0-incubating, which
works very well, but not with cs 4.2.0


2013/10/3 benoit lair 

> Hello guys,
>
>
> I've already installed cs 4.2 from cloudstack rpm repos.
>
> It seems all is okay.
>
> Now i want to build my own rpm from source.
>
> I work on a centos 6.3 linux for building the rpms.
>
> I followed the docs in order to prepare my dev environment according to
> the following page :
>
>
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/sect-source-buildrpm.html
>
> I adapted the filenames (here 4.0.0 with 4.2.0), but i got the following
> errors when trying to generate the rpms.
>
>
> -
> [INFO]
> 
> [INFO] BUILD FAILURE
> [INFO]
> 
> [INFO] Total time: 13:26.004s
> [INFO] Finished at: Thu Oct 03 10:07:41 CEST 2013
> [INFO] Final Memory: 37M/146M
> [INFO]
> 
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile
> (default-compile) on project cloud-plugin-hypervisor-xen: Compilation
> failure: Compilation failure:
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[890,16]
> cannot find symbol
> [ERROR] symbol  : variable lockingMode
> [ERROR] location: class com.xensource.xenapi.VIF.Record
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[890,36]
> cannot find symbol
> [ERROR] symbol  : variable VifLockingMode
> [ERROR] location: class com.xensource.xenapi.Types
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[1099,12]
> cannot find symbol
> [ERROR] symbol  : variable lockingMode
> [ERROR] location: class com.xensource.xenapi.VIF.Record
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[1099,32]
> cannot find symbol
> [ERROR] symbol  : variable VifLockingMode
> [ERROR] location: class com.xensource.xenapi.Types
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[4869,20]
> cannot find symbol
> [ERROR] symbol  : variable lockingMode
> [ERROR] location: class com.xensource.xenapi.VIF.Record
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java:[4869,40]
> cannot find symbol
> [ERROR] symbol  : variable VifLockingMode
> [ERROR] location: class com.xensource.xenapi.Types
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer610Resource.java:[160,43]
> cannot find symbol
> [ERROR] symbol  : method
> migrateReceive(com.xensource.xenapi.Connection,com.xensource.xenapi.Network,java.util.Map)
> [ERROR] location: class com.xensource.xenapi.Host
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer610Resource.java:[175,30]
> cannot find symbol
> [ERROR] symbol  : method
> assertCanMigrateAsync(com.xensource.xenapi.Connection,java.util.Map,boolean,java.util.Map com.xensource.xenapi.SR
> >,java.util.Map,java.util.Map)
> [ERROR] location: class com.xensource.xenapi.VM
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer610Resource.java:[189,30]
> cannot find symbol
> [ERROR] symbol  : method
> migrateSendAsync(com.xensource.xenapi.Connection,java.util.Map,boolean,java.util.Map com.xensource.xenapi.SR
> >,java.util.Map,java.util.Map)
> [ERROR] location: class com.xensource.xenapi.VM
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmbuild/BUILD/cloudstack-4.2.0/plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServer610Resource.java:[251,43]
> cannot find symbol
> [ERROR] symbol  : method
> migrateReceive(com.xensource.xenapi.Connection,com.xensource.xenapi.Network,java.util.Map)
> [ERROR] location: class com.xensource.xenapi.Host
> [ERROR]
> /root/repository/apache-cloudstack-4.2.0-src/dist/rpmb

RE: Unable to create instance after upgrading to CloudStack 4.2.0

[Sanjay Tripathi]

Indra,

After executing the scripts for all the existing accounts/domains, you will get 
the records being inserted into the resource_count table.

Next step is to update the resource counts, for that you can navigate to the 
root domain detailView page and use "Update Resource Count" action button; or 
you can use this API command:
http://localhost:8096/?command=updateResourceCount&domainId=1
(this API will update all the resources for all accounts/domains present in the 
resource_count table,  don't pass the "account=admin" parameter with this API, 
it will only update the resource count for admin account).

Let me know if you have any other queries.

--Sanjay

> -Original Message-
> From: Indra Pramana [mailto:in...@sg.or.id]
> Sent: Thursday, October 03, 2013 1:30 PM
> To: dev@cloudstack.apache.org
> Cc: Alena Prokharchyk
> Subject: Re: Unable to create instance after upgrading to CloudStack 4.2.0
> 
> Hi Sanjay,
> 
> Good day to you, and thank you for your e-mail.
> 
> I am going to perform the upgrade on our production servers in the next 1-2
> hours. Will let you know the outcome. This is our fourth attempt to upgrade
> so I hope there's no other issue crop up.
> 
> Can I confirm that this API command will populate all the resources_count
> table for all the accounts and domains?
> 
> http://localhost:8096/?command=updateResourceCount&account=admin&d
> omainId=1
> 
> Looking forward to your reply, thank you.
> 
> Cheers.
> 
> 
> 
> On Thu, Oct 3, 2013 at 2:07 PM, Sanjay Tripathi
> wrote:
> 
> > Indra,
> >
> > The steps are correct.
> > Please follow the steps and let me know if you need any help.
> >
> > This issue got fixed in 4.2-forward branch with this commit:
> > 38bbfdc89a50bbb9464700d202d1cfa7b7955953
> >
> > --Sanjay
> >
> > > -Original Message-
> > > From: Indra Pramana [mailto:in...@sg.or.id]
> > > Sent: Thursday, October 03, 2013 10:33 AM
> > > To: Alena Prokharchyk
> > > Cc: dev@cloudstack.apache.org
> > > Subject: Re: Unable to create instance after upgrading to CloudStack
> > 4.2.0
> > >
> > > Hi Alena,
> > >
> > > Good day to you, and thank you for your confirmation!
> > >
> > > Can I confirm that this is what I need to do:
> > >
> > > (1) Before upgrade, run the script to insert the records into
> > resource_count
> > > table for existing accounts/domains.
> > > (2) Perform the upgrade (from 4.1.1 to 4.2.0);
> > > (3) After the upgrade, run the API script to populate the records.
> > >
> > > The above will fix the issues on the existing accounts/domains, and
> > future
> > > accounts/domains will not be affected and will run as per normal
> > > after
> > the
> > > upgrade.
> > >
> > > Can I confirm that my above understanding is correct?
> > >
> > > Looking forward to your reply, thank you.
> > >
> > > Cheers.
> > >
> > >
> > >
> > > On Thu, Oct 3, 2013 at 11:31 AM, Alena Prokharchyk <
> > > alena.prokharc...@citrix.com> wrote:
> > >
> > > > Hi Indra,
> > > >
> > > > Please see inline.
> > > >
> > > > -alena.
> > > >
> > > > On 10/2/13 8:21 PM, "Indra Pramana"  wrote:
> > > >
> > > > >Hi Alena,
> > > > >
> > > > >
> > > > >Good day to you, and thank you for your e-mail.
> > > > >
> > > > >
> > > > >Does it mean that later after the upgrade, for every newly
> > > > >created accounts/domains, I will need to apply the temporary fix all
> the time?
> > > >
> > > > No. You should do it just for the accounts/domains existing before
> > > > the upgrade. For new accounts, the code should do it automatically
> > > > as a part of account creation.
> > > >
> > > >
> > > > > Will it cause any issues if I run the MySQL script again later, e.g.
> > > > >will it cause duplicate entries for existing accounts/domains?
> > > >
> > > > There is a constraint in resource_type table on type/account_id
> > > > and type/domain_id, so before running the script, you have to make
> > > > sure that the entry doesn't exist already.
> > > >
> > > > >
> > > > >
> > > > >Looking forward to your reply, thank you.
> > > > >
> > > > >Cheers.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >On Thu, Oct 3, 2013 at 2:01 AM, Alena Prokharchyk
> > > > > wrote:
> > > > >
> > > > >Indra,
> > > > >
> > > > >
> > > > >the issue would impact only existing accounts/domains. For all
> > > > >newly created accounts/domains, you won't see it. By "temporary"
> > > > >Wei meant that in the future the problem should be fixed in the
> > > > >CloudStack upgrade code; so before the fix is in, this temporary
> > > > >solution should be applied by the customer manually.
> > > > >
> > > > >
> > > > >Answering your other question  how to fix the count. For that,
> > > > >you have to execute the API updateResourceCount. Here is the
> example:
> > > > >
> > > > >
> > > > >
> > > >
> > >
> http://localhost:8096/?command=updateResourceCount&account=admin&d
> > > omai
> > > > nId=
> > > > >1
> > > > >
> > > > >
> > > > >-Alena.
> > > > >
> > > > >
> > > > >From: Indra Pramana 
> > > > >Reply-To: "dev@cloudstack.apache.org"
> 
> > 

Re: Wiki access

[Bharat Kumar]

Hi All,
any one please grant me the edit or add page permission to cwiki. my user 
name is bharat.kumar

Regards,
Bharat.
 

On Oct 3, 2013, at 9:28 AM, Syed Ahmed 
 wrote:

> Thanks David.
> 
> 
> On Wed 02 Oct 2013 07:23:28 PM EDT, David Nalley wrote:
>> You should be able to edit/add pages now.
>> 
>> --David
>> 
>> On Wed, Oct 2, 2013 at 5:14 PM, Syed Mushtaq  wrote:
>>> my confluence id is sahmed .
>>> 
>>> Thanks,
>>> -Syed
>>> 
>>> 
>>> On Wed, Oct 2, 2013 at 5:01 PM, Chip Childers 
>>> wrote:
>>> 
 Not all committers were easy to find, but those that I did should be all
 set.
 
 So committers / contributors = provide your confluence ID's if you can't
 add / edit pages.  PMC folks - help add them please.
 
 
 On Wed, Oct 2, 2013 at 4:48 PM, Chip Childers  wrote:
 
> There were major issues with Spam on the wiki, so infra changed the
> permissions.
> 
> I've just gone and added all PMC members to the space as space admins.
>  That means all PMC members can help deal with this issue (or at least
> those that I could find in the wiki user list).
> 
> I'm going to deal with committers next.  That permission level needs to
> exclude space admin.  I'm using alena1108 as the example for committer /
> contributor permissions.
> 
> So if you are not a committer, give your confluence ID in this thread and
> PMC folks can help get them added (make them look like alena's perms).
> 
> 
> 
> 
> On Wed, Oct 2, 2013 at 4:35 PM, Chiradeep Vittal <
> chiradeep.vit...@citrix.com> wrote:
> 
>> Apparently, edit access has been revoked for all. Who do we contact for
>> edit permissions?
>> 
>> TIA
>> 
> 
> 
 
> 
> 

Re: Review Request 14451: Some test for NetUtils

[Saksham Srivastava]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14451/#review26645
---



utils/src/com/cloud/utils/net/NetUtils.java


Can you mention against which branch the patch was created. Also create a 
bug/enhancement in Jira to track the issue.



utils/src/com/cloud/utils/net/NetUtils.java


Any particular reason for making dot as private static ? Making it local to 
ip2Long could also solve the purpose as I don't see it being used anywhere else.
If u still want to make it as private static it is better to keep the 
variable with all other static variables at the beginning of the class.




utils/test/com/cloud/utils/net/NetUtilsTest.java


Can you add few negative test cases like (15, "00:00:00:00:00:ff") in each 
of these methods.


- Saksham Srivastava


On Oct. 2, 2013, 9:19 p.m., Laszlo Hornyak wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14451/
> ---
> 
> (Updated Oct. 2, 2013, 9:19 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> - tests added for mac2Long, byte2Mac, long2Mac, ip2Long and long2Ip
> - isWindows static method removed - it was not used
> - minor changes in the implementations of the tested methods
> 
> 
> Diffs
> -
> 
>   utils/src/com/cloud/utils/net/NetUtils.java 1e72e22 
>   utils/test/com/cloud/utils/net/NetUtilsTest.java 3cfc98f 
> 
> Diff: https://reviews.apache.org/r/14451/diff/
> 
> 
> Testing
> ---
> 
> yes
> 
> 
> Thanks,
> 
> Laszlo Hornyak
> 
>

Re: Configuration table changes and database update

[Prasanna Santhanam]

This was my problem too for running tests o master :(

I posted CLOUDSTACK-4791 today for the issue.


On Thu, Oct 03, 2013 at 11:08:16AM +0200, Hugo Trippaers wrote:
> Heya guys,
> 
> I'm still running into this problem. Our jenkins automagically installs and 
> tests the latest packages based on master. With a clean database on clean 
> machines.
> 
> The error reported is similar to the error encountered:
> 
> Caused by: com.cloud.utils.exception.CloudRuntimeException: DB Exception on: 
> com.mysql.jdbc.JDBC4PreparedStatement@64726693: SELECT 
> configuration.instance, configuration.component, configuration.name, 
> configuration.value, configuration.default_value, configuration.description, 
> configuration.category, configuration.is_dynamic, configuration.scope, 
> configuration.updated FROM configuration WHERE configuration.name = 
> _binary'storage.cache.replacement.lru.interval'  ORDER BY RAND() LIMIT 1
>   at 
> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:421)
>   at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>   at 
> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:356)
>   at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>   at 
> com.cloud.utils.db.GenericDaoBase.findOneIncludingRemovedBy(GenericDaoBase.java:869)
>   at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>   at 
> org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.findByName(ConfigurationDaoImpl.java:201)
>   at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>   at 
> org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.getValue(ConfigurationDaoImpl.java:166)
>   at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>   at 
> org.apache.cloudstack.storage.cache.manager.StorageCacheReplacementAlgorithmLRU.initialize(StorageCacheReplacementAlgorithmLRU.java:63)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:616)
>   at 
> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:346)
>   at 
> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:299)
>   at 
> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:132)
>   ... 79 more
> Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown 
> column 'configuration.default_value' in 'field list'
>   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>   at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>   at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
>   at com.mysql.jdbc.Util.getInstance(Util.java:386)
>   at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1053)
>   at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4074)
>   at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4006)
>   at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2468)
>   at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2629)
>   at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2719)
>   at 
> com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2155)
>   at 
> com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2318)
>   at 
> org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
>   at 
> org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
>   at 
> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:415)
>   ... 116 more
> 
> The full log is here: 
> http://nvpmadm1.nvp.strocamp.net:8080/job/cloudstack-qa-env-test/505/console
> 
> This still appears to be an issue. How can we mak

Re: capacity of secondaey stor us eq 0. bug ir known ussue?

[benoit lair]

Hello,

I have the same issue with cs 4.2 installed from the cloudstack rpm
repositories (the stable ones), found no way to get an ssvm operationnal.

Thanks.


2013/9/28 Netmaster 

> Hallo,
> we have several installation of cloudstack 4.2
> In dashboard the capacity of secondary storage equal 0kb
> We have standart nfs.
> Api backed the same error, capacity of resource type 6 is 0
> The secondary stor vm (system vm) shows normall capacity of 10tb,
> as it have to be.
> Is it bug or known issue?
> Thanks

Re: Configuration table changes and database update

[Hugo Trippaers]

Just pushed a stop-gap fix to master. I'm running my qa tests now to check if 
it is ok now.

Cheers,

Hugo

Sent from my iPhone

> On 3 okt. 2013, at 12:18, Prasanna Santhanam  wrote:
> 
> This was my problem too for running tests o master :(
> 
> I posted CLOUDSTACK-4791 today for the issue.
> 
> 
>> On Thu, Oct 03, 2013 at 11:08:16AM +0200, Hugo Trippaers wrote:
>> Heya guys,
>> 
>> I'm still running into this problem. Our jenkins automagically installs and 
>> tests the latest packages based on master. With a clean database on clean 
>> machines.
>> 
>> The error reported is similar to the error encountered:
>> 
>> Caused by: com.cloud.utils.exception.CloudRuntimeException: DB Exception on: 
>> com.mysql.jdbc.JDBC4PreparedStatement@64726693: SELECT 
>> configuration.instance, configuration.component, configuration.name, 
>> configuration.value, configuration.default_value, configuration.description, 
>> configuration.category, configuration.is_dynamic, configuration.scope, 
>> configuration.updated FROM configuration WHERE configuration.name = 
>> _binary'storage.cache.replacement.lru.interval'  ORDER BY RAND() LIMIT 1
>>at 
>> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:421)
>>at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>at 
>> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:356)
>>at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>at 
>> com.cloud.utils.db.GenericDaoBase.findOneIncludingRemovedBy(GenericDaoBase.java:869)
>>at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>at 
>> org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.findByName(ConfigurationDaoImpl.java:201)
>>at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>at 
>> org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.getValue(ConfigurationDaoImpl.java:166)
>>at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>at 
>> org.apache.cloudstack.storage.cache.manager.StorageCacheReplacementAlgorithmLRU.initialize(StorageCacheReplacementAlgorithmLRU.java:63)
>>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>at 
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>at 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>at java.lang.reflect.Method.invoke(Method.java:616)
>>at 
>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:346)
>>at 
>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:299)
>>at 
>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:132)
>>... 79 more
>> Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: 
>> Unknown column 'configuration.default_value' in 'field list'
>>at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>>at 
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>>at 
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>>at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>>at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
>>at com.mysql.jdbc.Util.getInstance(Util.java:386)
>>at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1053)
>>at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4074)
>>at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4006)
>>at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2468)
>>at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2629)
>>at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2719)
>>at 
>> com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2155)
>>at 
>> com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2318)
>>at 
>> org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
>>at 
>> org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
>>at 
>> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:415)
>>... 116

CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[benoit lair]

Hello guys,

I'm trying cs 4.2.0 installed with the cloudstack rpm repositories onto a
centos 63 mgmt server.

I've created a zone, a pod, a cluster with a xenserver 6.2 host.

Created my networks, deployed the sysvm template (with the last version,
not the one into he docs)

I got an issue with the ssvm

My dashboard says me i have 275MB of storage available, that is the size of
the rootfs of the ssvm.
When i ran ssh against my ssvm (ssh -i /root/.ssh/id_rsa.cloud -p 3922
root@169.254.0.82)

i see the following with df -h :

root@s-1-VM:~# df -h
Filesystem  Size  Used Avail
Use% Mounted on
rootfs  276M  118M  145M
45% /
udev 10M 0   10M
0% /dev
tmpfs25M  152K   25M
1% /run
/dev/disk/by-uuid/3bbaf5c6-5317-468b-9742-0e68c65ad565  276M  118M  145M
45% /
tmpfs   5.0M 0  5.0M
0% /run/lock
tmpfs79M 0   79M
0% /run/shm
/dev/xvda1   30M   18M   11M
63% /boot
/dev/xvda6   53M  4.9M   45M
10% /home
/dev/xvda8  368M   11M  339M
3% /opt
/dev/xvda10  48M  4.9M   41M
11% /tmp
/dev/xvda7  610M  502M   77M
87% /usr
/dev/xvda9  415M  107M  287M
27% /var


That's not okay.

In fact, the ssvm mount his own / partition and provide it to the mgmt
server.
However, i configured an nfs server as secondary storage server with ip
182.20.0.57 with mount point /export/secondary.

Why do i not see my nfs server mounted onto the ssvm vm ?

So due to this bug i can't upload my vm templates and populate my templates
database.


Thanks a lot for your help.

Regards.

Benoit Lair.

Re: [DISCUSS] Leaky abstractions [was review requests 13238, 13896, 14320]

[Daan Hoogland]

Chiradeep,

I have been thinking about your concern and there is something bothering me
about it. The issue CLOUDSTACK-4328 of which
https://reviews.apache.org/r/14320/ is an implementation. This issue has
been brought up by the engineers at Schuberg Philis. These are cloud
operators and domain admins. So these are the people that need to be
bothered by this tuning and they are certainly haproxy and xen experts to
an extend. For them not being able to use connection caching was a bug. And
the proposed solution still seems reasonable to me. It is exposing the
abstract feature only to those instantiating a vpc, isn't it? This last
question probably touches on the reason you are addressing my submission
together with the ones from Nicolas  I see only people instantiating a vpc
having to be bothered by which netoffering to use (with respect to
httpClose functionality) If this is not the case how should I isolate this
concern from other , more mondain users?

btw I did not create an FS page as the issue was created as a jira ticket.
I am willing to do that in hind sight but want to have a path to follow
first.

regards,
Daan

On Tue, Oct 1, 2013 at 11:06 PM, Chiradeep Vittal <
chiradeep.vit...@citrix.com> wrote:
>
> We have a couple of people trying to expose the advanced capabilities of
the underlying physical resources to the end-user. In the case of Nicolas
FOATA, he is trying to expose some of the advanced functions of
XenServer/XCP, and in the case of Daan, he is trying to expose some feature
of HAProxy.
>
> Users are ideally abstracted from these details and shouldn't have to
wonder which offering to choose [because they are not Xen/HAProxy experts].
> After all one of the goals of CS is to hide these messy details and let
users focus on their apps.
>
> Is there a possibility of a generic way of leaking abstractions for
sufficiently advanced users?
>
> https://reviews.apache.org/r/13238/
> https://reviews.apache.org/r/14320/
> https://reviews.apache.org/r/13896/
>
> BTW, I really prefer that these changes are discussed by putting up an FS
on the wiki rather than submitting patch requests.
> If it touches more than a few files, it is probably worth discussing with
a [DISCUSS] tag line.
> Also, it requires tests.
>
>
>

unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Punith s]

hi everyone ,

i just build the cloudstack realese 4.2.0 on my devcloud2 to test my plugin
,

but i'm unable to create the tiny linux instance here after running the
 python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg

the template is not getting ready , any suggestions ??

the vmops.log file shows the following ,

2013-10-03 16:12:30,599 DEBUG [cloud.api.ApiServlet]
(1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 -- GET
 
command=listTemplates&templatefilter=selfexecutable&zoneid=a2ed9972-3f9a-4bcc-b888-d68114a42b7a&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796950532
2013-10-03 16:12:30,923 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-7:null) Seq 1-349175812: Response Received:
2013-10-03 16:12:30,926 DEBUG [agent.transport.Request]
(DirectAgent-7:null) Seq 1-349175812: Processing:  { Ans: , MgmtId:
268749071320359, via: 1, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}]
}
2013-10-03 16:12:31,140 DEBUG [storage.download.DownloadListener]
(Timer-5:null) timeout: transitioning to download error state,
currstate=NOT_DOWNLOADED, TEMPLATE: 5 at host 0
2013-10-03 16:12:31,141 DEBUG [storage.image.BaseImageStoreDriverImpl]
(Timer-5:null) Performing image store createTemplate async callback
2013-10-03 16:12:31,269 WARN  [storage.download.DownloadListener]
(Timer-5:null) Entering download error state: timeout waiting for response
from storage host, TEMPLATE: 5 at host 0
2013-10-03 16:12:34,311 DEBUG [cloud.api.ApiServlet]
(1995997711@qtp-1547603062-3:null) ===START===  0:0:0:0:0:0:0:1 -- GET
 
command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
2013-10-03 16:12:34,346 DEBUG [cloud.api.ApiServlet]
(1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 -- GET
 
command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305


thanks ,

regards,
punith s
cloudbyte.com

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Wei ZHOU]

Please follow the link to install new systemvm template:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack#HowtobuildCloudStack-InstalltheSystemVMTemplate

PS: The download url changed to http://download.cloud.com/templates/4.2/
systemvmtemplate-2013-07-12-master-xen.vhd.bz2.


2013/10/3 Punith s 

> hi everyone ,
>
> i just build the cloudstack realese 4.2.0 on my devcloud2 to test my plugin
> ,
>
> but i'm unable to create the tiny linux instance here after running the
>  python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg
>
> the template is not getting ready , any suggestions ??
>
> the vmops.log file shows the following ,
>
> 2013-10-03 16:12:30,599 DEBUG [cloud.api.ApiServlet]
> (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 -- GET
>
>  
> command=listTemplates&templatefilter=selfexecutable&zoneid=a2ed9972-3f9a-4bcc-b888-d68114a42b7a&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796950532
> 2013-10-03 16:12:30,923 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-7:null) Seq 1-349175812: Response Received:
> 2013-10-03 16:12:30,926 DEBUG [agent.transport.Request]
> (DirectAgent-7:null) Seq 1-349175812: Processing:  { Ans: , MgmtId:
> 268749071320359, via: 1, Ver: v1, Flags: 10,
>
> [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}]
> }
> 2013-10-03 16:12:31,140 DEBUG [storage.download.DownloadListener]
> (Timer-5:null) timeout: transitioning to download error state,
> currstate=NOT_DOWNLOADED, TEMPLATE: 5 at host 0
> 2013-10-03 16:12:31,141 DEBUG [storage.image.BaseImageStoreDriverImpl]
> (Timer-5:null) Performing image store createTemplate async callback
> 2013-10-03 16:12:31,269 WARN  [storage.download.DownloadListener]
> (Timer-5:null) Entering download error state: timeout waiting for response
> from storage host, TEMPLATE: 5 at host 0
> 2013-10-03 16:12:34,311 DEBUG [cloud.api.ApiServlet]
> (1995997711@qtp-1547603062-3:null) ===START===  0:0:0:0:0:0:0:1 -- GET
>
>  
> command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
> 2013-10-03 16:12:34,346 DEBUG [cloud.api.ApiServlet]
> (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 -- GET
>
>  
> command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
>
>
> thanks ,
>
> regards,
> punith s
> cloudbyte.com
>

Review Request 14467: fix for Invalid SMTP breaks HA

[Anshul Gangwar]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14467/
---

Review request for cloudstack and Devdeep Singh.


Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-4792


Repository: cloudstack-git


Description
---

added the connection and socket timeout parameters for SMTP and sending message 
in new thread so that HA doesn't get blocked beacause of hang in sending email 
alert


Diffs
-

  server/src/com/cloud/alert/AlertManagerImpl.java c437a8c 

Diff: https://reviews.apache.org/r/14467/diff/


Testing
---

tested manually on my local setup


Thanks,

Anshul Gangwar

Re: Hi

[Bharat Kumar]

Hi Steve,

Welcome to CloudStack. I look forward to working with you in the community.


On Oct 3, 2013, at 2:07 PM, Daan Hoogland 
 wrote:

> H Steve,
> 
> I wish you luck with managing the Citrix - Community interaction and given
> the continued huge importance of Citrix to Apache CloudStack I am taking
> the liberty of calling you our friend.
> 
> Welcome,
> Daan
> 
> 
> On Thu, Oct 3, 2013 at 7:33 AM, Koushik Das  wrote:
> 
>> Hi Steve,
>> 
>> Welcome to CloudStack. Looking forward to working with you.
>> 
>> 
>> On 02-Oct-2013, at 6:10 PM, Chip Childers 
>> wrote:
>> 
>>> Welcome Steve!
>>> 
>>> 
>>> On Wed, Oct 2, 2013 at 12:38 AM, Steve Wilson >> wrote:
>>> 
 Hi Everyone,
 
 I just wanted to take a second and introduce myself.  I recently joined
 Citrix as the VP of Cloud Engineering, and I'm responsible for the
>> Citrix
 CloudPlatofrm (powered by Apache CloudStack).  I just joined the list
>> and
 am looking forward to working with everyone in the community.  Feel
>> free to
 drop me a note if you have suggestions for me on how Citrix can best
>> work
 with the Apache CloudStack community.
 
 Thanks,
 
 -Steve
 twitter: @virtualsteve
 email: steve.wil...@citrix.com
 
>> 
>> 

Re: Hi

[Wei ZHOU]

Welcome Steve!


2013/10/2 Steve Wilson 

> Hi Everyone,
>
> I just wanted to take a second and introduce myself.  I recently joined
> Citrix as the VP of Cloud Engineering, and I'm responsible for the Citrix
> CloudPlatofrm (powered by Apache CloudStack).  I just joined the list and
> am looking forward to working with everyone in the community.  Feel free to
> drop me a note if you have suggestions for me on how Citrix can best work
> with the Apache CloudStack community.
>
> Thanks,
>
> -Steve
> twitter: @virtualsteve
> email: steve.wil...@citrix.com
>

Re: CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[Indra Pramana]

Hi,

I encountered the problem before, this is because for some reason, SSVM is
not able to mount to your NFS server. Try to SSH into the SSVM and then run
mount command to try whether you can mount manually. If cannot, then need
to investigate further.

HTH.

Thank you.


On Thu, Oct 3, 2013 at 6:48 PM, benoit lair  wrote:

> Hello guys,
>
> I'm trying cs 4.2.0 installed with the cloudstack rpm repositories onto a
> centos 63 mgmt server.
>
> I've created a zone, a pod, a cluster with a xenserver 6.2 host.
>
> Created my networks, deployed the sysvm template (with the last version,
> not the one into he docs)
>
> I got an issue with the ssvm
>
> My dashboard says me i have 275MB of storage available, that is the size of
> the rootfs of the ssvm.
> When i ran ssh against my ssvm (ssh -i /root/.ssh/id_rsa.cloud -p 3922
> root@169.254.0.82)
>
> i see the following with df -h :
>
> root@s-1-VM:~# df -h
> Filesystem  Size  Used Avail
> Use% Mounted on
> rootfs  276M  118M  145M
> 45% /
> udev 10M 0   10M
> 0% /dev
> tmpfs25M  152K   25M
> 1% /run
> /dev/disk/by-uuid/3bbaf5c6-5317-468b-9742-0e68c65ad565  276M  118M  145M
> 45% /
> tmpfs   5.0M 0  5.0M
> 0% /run/lock
> tmpfs79M 0   79M
> 0% /run/shm
> /dev/xvda1   30M   18M   11M
> 63% /boot
> /dev/xvda6   53M  4.9M   45M
> 10% /home
> /dev/xvda8  368M   11M  339M
> 3% /opt
> /dev/xvda10  48M  4.9M   41M
> 11% /tmp
> /dev/xvda7  610M  502M   77M
> 87% /usr
> /dev/xvda9  415M  107M  287M
> 27% /var
>
>
> That's not okay.
>
> In fact, the ssvm mount his own / partition and provide it to the mgmt
> server.
> However, i configured an nfs server as secondary storage server with ip
> 182.20.0.57 with mount point /export/secondary.
>
> Why do i not see my nfs server mounted onto the ssvm vm ?
>
> So due to this bug i can't upload my vm templates and populate my templates
> database.
>
>
> Thanks a lot for your help.
>
> Regards.
>
> Benoit Lair.
>

[Proposal] Improve VR upgrades

[Kishan Kavala]

During CS upgrade, VRs are required to be upgraded to use newer systemVm 
template . 
The current VR upgrade procedure has following limitations:
 - takes 'long' time and the time exponentially increases with the size of the 
cloud
- no way to sequence upgrade of different parts of the cloud, i.e., specific 
clusters or pods or even zones
- there is no way to determine when a particular customer's services (e.g. VR) 
will be upgraded with the upgrade interval

Goals for this feature are to address the above issues

1. Give admin control to sequence the upgrade of the cloud by:
   - Infrastructure hierarchy: by Cluster, Pod, and Zone etc.
   - Administrative hierarchy: by Tenant or Domain 
2. Minimize service interruption to users
3. Improve the speed of the upgrade time by making as many upgrade operations 
in parallel as possible

I've created JIRA ticket:
https://issues.apache.org/jira/browse/CLOUDSTACK-4793

thanks,
Kishan

Review Request 14468: CLOUDSTACK-702: Added test for verifying dns service on alias IP

[sanjeev n]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14468/
---

Review request for cloudstack, venkata swamy babu  budumuru, SrikanteswaraRao 
Talluri, and Prasanna Santhanam.


Repository: cloudstack-git


Description
---

1. Moved some code from test to setupClass method since it is required for all 
the tests
2. Added new test which will deploy vm in new cidr and verifies dns service on 
alias ip on VR.


Diffs
-

  test/integration/component/maint/test_multiple_ip_ranges.py 782957c 

Diff: https://reviews.apache.org/r/14468/diff/


Testing
---

Yes


Thanks,

sanjeev n

Re: Configuration table changes and database update

[Hugo Trippaers]

It's fixed with commit 3f583684c6ddcf7efb66adada63957f8ca06cfdc

Not really the nicest of fixes, but at least the QA can continue. For a 
structural fix we would need to run the database upgrade check before 
initialising any of the beans. That can't be done yet as the upgrade checker 
depends on a dao bean at the moment.

Cheers,

Hugo

On Oct 3, 2013, at 12:47 PM, Hugo Trippaers  wrote:

> Just pushed a stop-gap fix to master. I'm running my qa tests now to check if 
> it is ok now.
> 
> Cheers,
> 
> Hugo
> 
> Sent from my iPhone
> 
>> On 3 okt. 2013, at 12:18, Prasanna Santhanam  wrote:
>> 
>> This was my problem too for running tests o master :(
>> 
>> I posted CLOUDSTACK-4791 today for the issue.
>> 
>> 
>>> On Thu, Oct 03, 2013 at 11:08:16AM +0200, Hugo Trippaers wrote:
>>> Heya guys,
>>> 
>>> I'm still running into this problem. Our jenkins automagically installs and 
>>> tests the latest packages based on master. With a clean database on clean 
>>> machines.
>>> 
>>> The error reported is similar to the error encountered:
>>> 
>>> Caused by: com.cloud.utils.exception.CloudRuntimeException: DB Exception 
>>> on: com.mysql.jdbc.JDBC4PreparedStatement@64726693: SELECT 
>>> configuration.instance, configuration.component, configuration.name, 
>>> configuration.value, configuration.default_value, 
>>> configuration.description, configuration.category, 
>>> configuration.is_dynamic, configuration.scope, configuration.updated FROM 
>>> configuration WHERE configuration.name = 
>>> _binary'storage.cache.replacement.lru.interval'  ORDER BY RAND() LIMIT 1
>>>   at 
>>> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:421)
>>>   at 
>>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>>   at 
>>> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:356)
>>>   at 
>>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>>   at 
>>> com.cloud.utils.db.GenericDaoBase.findOneIncludingRemovedBy(GenericDaoBase.java:869)
>>>   at 
>>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>>   at 
>>> org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.findByName(ConfigurationDaoImpl.java:201)
>>>   at 
>>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>>   at 
>>> org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.getValue(ConfigurationDaoImpl.java:166)
>>>   at 
>>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>>   at 
>>> org.apache.cloudstack.storage.cache.manager.StorageCacheReplacementAlgorithmLRU.initialize(StorageCacheReplacementAlgorithmLRU.java:63)
>>>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>   at 
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>   at 
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>   at java.lang.reflect.Method.invoke(Method.java:616)
>>>   at 
>>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:346)
>>>   at 
>>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:299)
>>>   at 
>>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:132)
>>>   ... 79 more
>>> Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: 
>>> Unknown column 'configuration.default_value' in 'field list'
>>>   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>>>   at 
>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>>>   at 
>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>>>   at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>>>   at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
>>>   at com.mysql.jdbc.Util.getInstance(Util.java:386)
>>>   at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1053)
>>>   at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4074)
>>>   at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4006)
>>>   at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2468)
>>>   at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2629)
>>>   at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2719)
>>>   at 
>>> com.mysql.jdbc.PreparedStatement.executeInte

Re: CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[Wei ZHOU]

Could you check management.network.cidr and host in Global Setting?


2013/10/3 Indra Pramana 

> Hi,
>
> I encountered the problem before, this is because for some reason, SSVM is
> not able to mount to your NFS server. Try to SSH into the SSVM and then run
> mount command to try whether you can mount manually. If cannot, then need
> to investigate further.
>
> HTH.
>
> Thank you.
>
>
> On Thu, Oct 3, 2013 at 6:48 PM, benoit lair  wrote:
>
> > Hello guys,
> >
> > I'm trying cs 4.2.0 installed with the cloudstack rpm repositories onto a
> > centos 63 mgmt server.
> >
> > I've created a zone, a pod, a cluster with a xenserver 6.2 host.
> >
> > Created my networks, deployed the sysvm template (with the last version,
> > not the one into he docs)
> >
> > I got an issue with the ssvm
> >
> > My dashboard says me i have 275MB of storage available, that is the size
> of
> > the rootfs of the ssvm.
> > When i ran ssh against my ssvm (ssh -i /root/.ssh/id_rsa.cloud -p 3922
> > root@169.254.0.82)
> >
> > i see the following with df -h :
> >
> > root@s-1-VM:~# df -h
> > Filesystem  Size  Used Avail
> > Use% Mounted on
> > rootfs  276M  118M  145M
> > 45% /
> > udev 10M 0   10M
> > 0% /dev
> > tmpfs25M  152K   25M
> > 1% /run
> > /dev/disk/by-uuid/3bbaf5c6-5317-468b-9742-0e68c65ad565  276M  118M  145M
> > 45% /
> > tmpfs   5.0M 0  5.0M
> > 0% /run/lock
> > tmpfs79M 0   79M
> > 0% /run/shm
> > /dev/xvda1   30M   18M   11M
> > 63% /boot
> > /dev/xvda6   53M  4.9M   45M
> > 10% /home
> > /dev/xvda8  368M   11M  339M
> > 3% /opt
> > /dev/xvda10  48M  4.9M   41M
> > 11% /tmp
> > /dev/xvda7  610M  502M   77M
> > 87% /usr
> > /dev/xvda9  415M  107M  287M
> > 27% /var
> >
> >
> > That's not okay.
> >
> > In fact, the ssvm mount his own / partition and provide it to the mgmt
> > server.
> > However, i configured an nfs server as secondary storage server with ip
> > 182.20.0.57 with mount point /export/secondary.
> >
> > Why do i not see my nfs server mounted onto the ssvm vm ?
> >
> > So due to this bug i can't upload my vm templates and populate my
> templates
> > database.
> >
> >
> > Thanks a lot for your help.
> >
> > Regards.
> >
> > Benoit Lair.
> >
>

[URGENT] Unable to stop/start system VMs after upgrade to 4.2.0

[Indra Pramana]

Dear all,

I am now in the progress of upgrading my CloudStack from 4.1.1 to 4.2.0.
Running cloudstack-sysvmadm can restart the SSVM, but failed to restart the
CPVM and all the VRs.


[1] 3152
root@cs-mgmt-01:~/backup/20131003# tail -f sysvm.log
nohup: ignoring input
/usr/bin/cloudstack-sysvmadm: line 21: /etc/rc.d/init.d/functions: No such
file or directory

Stopping and starting 1 secondary storage vm(s)...
Done stopping and starting secondary storage vm(s)

Stopping and starting 1 console proxy vm(s)...
ERROR: Failed to stop console proxy vm with id 1980

Done stopping and starting console proxy vm(s) .

Stopping and starting 0 running routing vm(s)...


SSVM seems OK, I have run health check script and everything is in order.

VM state of CPVM is running, but state is disconnected. I can't stop or
destroy the CPVM.

All the VRs are running now but I am not too sure if they are already using
the new 4.2 template or still using the old template, since it seems the
sysvmadm script was unable to detect the virtual routers.

Anyone can help?

Thank you.

Re: [DISCUSS] Leaky abstractions [was review requests 13238, 13896, 14320]

[murali reddy]

On Thu, Oct 3, 2013 at 4:18 PM, Daan Hoogland wrote:

> Chiradeep,
>
> I have been thinking about your concern and there is something bothering me
> about it. The issue CLOUDSTACK-4328 of which
> https://reviews.apache.org/r/14320/ is an implementation. This issue has
> been brought up by the engineers at Schuberg Philis. These are cloud
> operators and domain admins. So these are the people that need to be
> bothered by this tuning and they are certainly haproxy and xen experts to
> an extend. For them not being able to use connection caching was a bug. And
> the proposed solution still seems reasonable to me. It is exposing the
> abstract feature only to those instantiating a vpc, isn't it? This last
> question probably touches on the reason you are addressing my submission
> together with the ones from Nicolas  I see only people instantiating a vpc
> having to be bothered by which netoffering to use (with respect to
> httpClose functionality) If this is not the case how should I isolate this
> concern from other , more mondain users?
>
> btw I did not create an FS page as the issue was created as a jira ticket.
> I am willing to do that in hind sight but want to have a path to follow
> first.
>
> regards,
> Daan
>
> On Tue, Oct 1, 2013 at 11:06 PM, Chiradeep Vittal <
> chiradeep.vit...@citrix.com> wrote:
> >
> > We have a couple of people trying to expose the advanced capabilities of
> the underlying physical resources to the end-user. In the case of Nicolas
> FOATA, he is trying to expose some of the advanced functions of
> XenServer/XCP, and in the case of Daan, he is trying to expose some feature
> of HAProxy.
> >
> > Users are ideally abstracted from these details and shouldn't have to
> wonder which offering to choose [because they are not Xen/HAProxy experts].
> > After all one of the goals of CS is to hide these messy details and let
> users focus on their apps.
> >
> > Is there a possibility of a generic way of leaking abstractions for
> sufficiently advanced users?
> >
>

Generally as a principle core API's abstract and expose functionality that
is commonly available across the hypervisors and network service providers
etc.. I believe we should continue to enforce it.

But we do have a pattern of API's configure* (configurevirtualrouter,
configurenetscaler etc) where a hypervisor/network element plug-in can let
admin to configure params specific to plug-in. Perhaps we can use this
API's fine tune a plugin for advanced configurations. For e.g both HaProxy
max connections, httpModeEnabled can be parameters that can be configured
with configureVirtualRouter api.

Daan,

does this approach works for you?

-Murali


> > https://reviews.apache.org/r/13238/
> > https://reviews.apache.org/r/14320/
> > https://reviews.apache.org/r/13896/
> >
> > BTW, I really prefer that these changes are discussed by putting up an FS
> on the wiki rather than submitting patch requests.
> > If it touches more than a few files, it is probably worth discussing with
> a [DISCUSS] tag line.
> > Also, it requires tests.
> >
> >
> >
>

Re: [URGENT] Unable to stop/start system VMs after upgrade to 4.2.0

[Indra Pramana]

Dear all,

I managed to fix the VRs issue by destroying the routers and restarting the
networks associated to the routers.

Only left is the CPVM, I am not able to stop/destroy it. Any advise?

Looking forward to your reply, thank you.

Cheers.



On Thu, Oct 3, 2013 at 8:16 PM, Indra Pramana  wrote:

> Dear all,
>
> I am now in the progress of upgrading my CloudStack from 4.1.1 to 4.2.0.
> Running cloudstack-sysvmadm can restart the SSVM, but failed to restart the
> CPVM and all the VRs.
>
> 
> [1] 3152
> root@cs-mgmt-01:~/backup/20131003# tail -f sysvm.log
> nohup: ignoring input
> /usr/bin/cloudstack-sysvmadm: line 21: /etc/rc.d/init.d/functions: No such
> file or directory
>
> Stopping and starting 1 secondary storage vm(s)...
> Done stopping and starting secondary storage vm(s)
>
> Stopping and starting 1 console proxy vm(s)...
> ERROR: Failed to stop console proxy vm with id 1980
>
> Done stopping and starting console proxy vm(s) .
>
> Stopping and starting 0 running routing vm(s)...
> 
>
> SSVM seems OK, I have run health check script and everything is in order.
>
> VM state of CPVM is running, but state is disconnected. I can't stop or
> destroy the CPVM.
>
> All the VRs are running now but I am not too sure if they are already
> using the new 4.2 template or still using the old template, since it seems
> the sysvmadm script was unable to detect the virtual routers.
>
> Anyone can help?
>
> Thank you.
>

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Punith s]

hi wei ,
thanks for the reply but

like i said i,m using devcloud2 as my host and building my basic
infrastructure by running the python script
python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg which compised
the package containing sysvm's and tiny linux templates .

all the system vm's are shown running the the MS , but the agent state is
shown null(-),

while creating the instance , i cannot add the default tiny linux template
since it is not in the ready state(not yet downloaded by the sec stor vm)
even though the systemvm's are running, is this due to agent state shown
null ??

regards,
punith s
cloudbyte




On Thu, Oct 3, 2013 at 5:00 PM, Wei ZHOU  wrote:

> Please follow the link to install new systemvm template:
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack#HowtobuildCloudStack-InstalltheSystemVMTemplate
>
> PS: The download url changed to http://download.cloud.com/templates/4.2/
> systemvmtemplate-2013-07-12-master-xen.vhd.bz2.
>
>
> 2013/10/3 Punith s 
>
> > hi everyone ,
> >
> > i just build the cloudstack realese 4.2.0 on my devcloud2 to test my
> plugin
> > ,
> >
> > but i'm unable to create the tiny linux instance here after running the
> >  python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg
> >
> > the template is not getting ready , any suggestions ??
> >
> > the vmops.log file shows the following ,
> >
> > 2013-10-03 16:12:30,599 DEBUG [cloud.api.ApiServlet]
> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 -- GET
> >
> >
>  
> command=listTemplates&templatefilter=selfexecutable&zoneid=a2ed9972-3f9a-4bcc-b888-d68114a42b7a&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796950532
> > 2013-10-03 16:12:30,923 DEBUG [agent.manager.DirectAgentAttache]
> > (DirectAgent-7:null) Seq 1-349175812: Response Received:
> > 2013-10-03 16:12:30,926 DEBUG [agent.transport.Request]
> > (DirectAgent-7:null) Seq 1-349175812: Processing:  { Ans: , MgmtId:
> > 268749071320359, via: 1, Ver: v1, Flags: 10,
> >
> >
> [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}]
> > }
> > 2013-10-03 16:12:31,140 DEBUG [storage.download.DownloadListener]
> > (Timer-5:null) timeout: transitioning to download error state,
> > currstate=NOT_DOWNLOADED, TEMPLATE: 5 at host 0
> > 2013-10-03 16:12:31,141 DEBUG [storage.image.BaseImageStoreDriverImpl]
> > (Timer-5:null) Performing image store createTemplate async callback
> > 2013-10-03 16:12:31,269 WARN  [storage.download.DownloadListener]
> > (Timer-5:null) Entering download error state: timeout waiting for
> response
> > from storage host, TEMPLATE: 5 at host 0
> > 2013-10-03 16:12:34,311 DEBUG [cloud.api.ApiServlet]
> > (1995997711@qtp-1547603062-3:null) ===START===  0:0:0:0:0:0:0:1 -- GET
> >
> >
>  
> command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
> > 2013-10-03 16:12:34,346 DEBUG [cloud.api.ApiServlet]
> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 -- GET
> >
> >
>  
> command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
> >
> >
> > thanks ,
> >
> > regards,
> > punith s
> > cloudbyte.com
> >
>

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Wei ZHOU]

Is the ip of your management-server 192.168.56.1?


2013/10/3 Punith s 

> hi wei ,
> thanks for the reply but
>
> like i said i,m using devcloud2 as my host and building my basic
> infrastructure by running the python script
> python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg which compised
> the package containing sysvm's and tiny linux templates .
>
> all the system vm's are shown running the the MS , but the agent state is
> shown null(-),
>
> while creating the instance , i cannot add the default tiny linux template
> since it is not in the ready state(not yet downloaded by the sec stor vm)
> even though the systemvm's are running, is this due to agent state shown
> null ??
>
> regards,
> punith s
> cloudbyte
>
>
>
>
> On Thu, Oct 3, 2013 at 5:00 PM, Wei ZHOU  wrote:
>
>> Please follow the link to install new systemvm template:
>>
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack#HowtobuildCloudStack-InstalltheSystemVMTemplate
>>
>> PS: The download url changed to http://download.cloud.com/templates/4.2/
>> systemvmtemplate-2013-07-12-master-xen.vhd.bz2
>> .
>>
>>
>> 2013/10/3 Punith s 
>>
>> > hi everyone ,
>> >
>> > i just build the cloudstack realese 4.2.0 on my devcloud2 to test my
>> plugin
>> > ,
>> >
>> > but i'm unable to create the tiny linux instance here after running the
>> >  python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg
>> >
>> > the template is not getting ready , any suggestions ??
>> >
>> > the vmops.log file shows the following ,
>> >
>> > 2013-10-03 16:12:30,599 DEBUG [cloud.api.ApiServlet]
>> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 -- GET
>> >
>> >
>>  
>> command=listTemplates&templatefilter=selfexecutable&zoneid=a2ed9972-3f9a-4bcc-b888-d68114a42b7a&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796950532
>> > 2013-10-03 16:12:30,923 DEBUG [agent.manager.DirectAgentAttache]
>> > (DirectAgent-7:null) Seq 1-349175812: Response Received:
>> > 2013-10-03 16:12:30,926 DEBUG [agent.transport.Request]
>> > (DirectAgent-7:null) Seq 1-349175812: Processing:  { Ans: , MgmtId:
>> > 268749071320359, via: 1, Ver: v1, Flags: 10,
>> >
>> >
>> [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}]
>> > }
>> > 2013-10-03 16:12:31,140 DEBUG [storage.download.DownloadListener]
>> > (Timer-5:null) timeout: transitioning to download error state,
>> > currstate=NOT_DOWNLOADED, TEMPLATE: 5 at host 0
>> > 2013-10-03 16:12:31,141 DEBUG [storage.image.BaseImageStoreDriverImpl]
>> > (Timer-5:null) Performing image store createTemplate async callback
>> > 2013-10-03 16:12:31,269 WARN  [storage.download.DownloadListener]
>> > (Timer-5:null) Entering download error state: timeout waiting for
>> response
>> > from storage host, TEMPLATE: 5 at host 0
>> > 2013-10-03 16:12:34,311 DEBUG [cloud.api.ApiServlet]
>> > (1995997711@qtp-1547603062-3:null) ===START===  0:0:0:0:0:0:0:1 -- GET
>> >
>> >
>>  
>> command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
>> > 2013-10-03 16:12:34,346 DEBUG [cloud.api.ApiServlet]
>> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 -- GET
>> >
>> >
>>  
>> command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
>> >
>> >
>> > thanks ,
>> >
>> > regards,
>> > punith s
>> > cloudbyte.com
>> >
>>
>
>

RE: [URGENT] Unable to stop/start system VMs after upgrade to 4.2.0

[David Ortiz]

If you manually change the vm status in the database would it let you destroy 
it then?

> Date: Thu, 3 Oct 2013 20:22:33 +0800
> Subject: Re: [URGENT] Unable to stop/start system VMs after upgrade to 4.2.0
> From: in...@sg.or.id
> To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
> 
> Dear all,
> 
> I managed to fix the VRs issue by destroying the routers and restarting the
> networks associated to the routers.
> 
> Only left is the CPVM, I am not able to stop/destroy it. Any advise?
> 
> Looking forward to your reply, thank you.
> 
> Cheers.
> 
> 
> 
> On Thu, Oct 3, 2013 at 8:16 PM, Indra Pramana  wrote:
> 
> > Dear all,
> >
> > I am now in the progress of upgrading my CloudStack from 4.1.1 to 4.2.0.
> > Running cloudstack-sysvmadm can restart the SSVM, but failed to restart the
> > CPVM and all the VRs.
> >
> > 
> > [1] 3152
> > root@cs-mgmt-01:~/backup/20131003# tail -f sysvm.log
> > nohup: ignoring input
> > /usr/bin/cloudstack-sysvmadm: line 21: /etc/rc.d/init.d/functions: No such
> > file or directory
> >
> > Stopping and starting 1 secondary storage vm(s)...
> > Done stopping and starting secondary storage vm(s)
> >
> > Stopping and starting 1 console proxy vm(s)...
> > ERROR: Failed to stop console proxy vm with id 1980
> >
> > Done stopping and starting console proxy vm(s) .
> >
> > Stopping and starting 0 running routing vm(s)...
> > 
> >
> > SSVM seems OK, I have run health check script and everything is in order.
> >
> > VM state of CPVM is running, but state is disconnected. I can't stop or
> > destroy the CPVM.
> >
> > All the VRs are running now but I am not too sure if they are already
> > using the new 4.2 template or still using the old template, since it seems
> > the sysvmadm script was unable to detect the virtual routers.
> >
> > Anyone can help?
> >
> > Thank you.
> >
  

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Punith s]

no i'm using devcloud2 as the HOST ONLY MODE(xen) but i'm building the MS
in my localhost which is a DHCP(10.11.1.135)
the devcloud's ip is 198.168.56.1.

i'm building with ref's to this link
https://cwiki.apache.org/confluence/display/CLOUDSTACK/DevCloud




On Thu, Oct 3, 2013 at 5:57 PM, Wei ZHOU  wrote:

> Is the ip of your management-server 192.168.56.1?
>
>
> 2013/10/3 Punith s 
>
> > hi wei ,
> > thanks for the reply but
> >
> > like i said i,m using devcloud2 as my host and building my basic
> > infrastructure by running the python script
> > python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg which
> compised
> > the package containing sysvm's and tiny linux templates .
> >
> > all the system vm's are shown running the the MS , but the agent state is
> > shown null(-),
> >
> > while creating the instance , i cannot add the default tiny linux
> template
> > since it is not in the ready state(not yet downloaded by the sec stor vm)
> > even though the systemvm's are running, is this due to agent state shown
> > null ??
> >
> > regards,
> > punith s
> > cloudbyte
> >
> >
> >
> >
> > On Thu, Oct 3, 2013 at 5:00 PM, Wei ZHOU  wrote:
> >
> >> Please follow the link to install new systemvm template:
> >>
> >>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack#HowtobuildCloudStack-InstalltheSystemVMTemplate
> >>
> >> PS: The download url changed to
> http://download.cloud.com/templates/4.2/
> >> systemvmtemplate-2013-07-12-master-xen.vhd.bz2<
> http://download.cloud.com/templates/4.2/systemvmtemplate-2013-07-12-master-xen.vhd.bz2
> >
> >> .
> >>
> >>
> >> 2013/10/3 Punith s 
> >>
> >> > hi everyone ,
> >> >
> >> > i just build the cloudstack realese 4.2.0 on my devcloud2 to test my
> >> plugin
> >> > ,
> >> >
> >> > but i'm unable to create the tiny linux instance here after running
> the
> >> >  python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg
> >> >
> >> > the template is not getting ready , any suggestions ??
> >> >
> >> > the vmops.log file shows the following ,
> >> >
> >> > 2013-10-03 16:12:30,599 DEBUG [cloud.api.ApiServlet]
> >> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 -- GET
> >> >
> >> >
> >>
>  
> command=listTemplates&templatefilter=selfexecutable&zoneid=a2ed9972-3f9a-4bcc-b888-d68114a42b7a&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796950532
> >> > 2013-10-03 16:12:30,923 DEBUG [agent.manager.DirectAgentAttache]
> >> > (DirectAgent-7:null) Seq 1-349175812: Response Received:
> >> > 2013-10-03 16:12:30,926 DEBUG [agent.transport.Request]
> >> > (DirectAgent-7:null) Seq 1-349175812: Processing:  { Ans: , MgmtId:
> >> > 268749071320359, via: 1, Ver: v1, Flags: 10,
> >> >
> >> >
> >>
> [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}]
> >> > }
> >> > 2013-10-03 16:12:31,140 DEBUG [storage.download.DownloadListener]
> >> > (Timer-5:null) timeout: transitioning to download error state,
> >> > currstate=NOT_DOWNLOADED, TEMPLATE: 5 at host 0
> >> > 2013-10-03 16:12:31,141 DEBUG [storage.image.BaseImageStoreDriverImpl]
> >> > (Timer-5:null) Performing image store createTemplate async callback
> >> > 2013-10-03 16:12:31,269 WARN  [storage.download.DownloadListener]
> >> > (Timer-5:null) Entering download error state: timeout waiting for
> >> response
> >> > from storage host, TEMPLATE: 5 at host 0
> >> > 2013-10-03 16:12:34,311 DEBUG [cloud.api.ApiServlet]
> >> > (1995997711@qtp-1547603062-3:null) ===START===  0:0:0:0:0:0:0:1 --
> GET
> >> >
> >> >
> >>
>  
> command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
> >> > 2013-10-03 16:12:34,346 DEBUG [cloud.api.ApiServlet]
> >> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 -- GET
> >> >
> >> >
> >>
>  
> command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
> >> >
> >> >
> >> > thanks ,
> >> >
> >> > regards,
> >> > punith s
> >> > cloudbyte.com
> >> >
> >>
> >
> >
>

Re: CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[benoit lair]

Hi Indra,

Thanks for your response.

Effectively, i can't contact my nfs server

Wei, my management.network.cidr is 172.20.0.0/22, so my nfs server is on
172.20.0.57 so in the cidr of mgmt

Is there an impact concerning the config of my zone ?

My pod has a start ip with 172.20.0.100 to 172.20.1.254, is there an issue
due to the fact my secondary storage nfs server has  the ip 172.20.0.57 ?

The reason for configuring the pod with an ip range outside the nfs server
is because the subnet is already used by another cs mgmt instance (i'm
proceeding of a migration of cs 4.0.0 towards a cs 4.2.0 without using the
official upgrade process).

So my nfs server is 172.20.0.57, is managed by cs 4.2.0, with and advanced
zone composed of a pod with an ip range outside the nfs server (it's a
xenserver 6.2 cluster inside).

Does it explain my problem ?

During the time i wrote this email, i saw that the routing table of my ssvm
vm is :

root@s-1-VM:~# route
Kernel IP routing table
Destination Gateway Genmask Flags Metric RefUse
Iface
default 10.14.0.1   0.0.0.0 UG0  00 eth2
google-public-d 172.20.0.1  255.255.255.255 UGH   0  00 eth1
10.14.0.0   *   255.254.0.0 U 0  00 eth2
10.32.0.0   *   255.240.0.0 U 0  00 eth3
link-local  *   255.255.0.0 U 0  00 eth0
172.20.0.0  *   255.255.252.0   U 0  00 eth1
172.20.0.57 10.32.0.1   255.255.255.255 UGH   0  00 eth3
relais3.altitud 172.20.0.1  255.255.255.255 UGH   0  00 eth1


So, i can see that my nfs server (172.20.0.57) is routed via the network gw
10.32.0.1 (it is my storage newtwork)

Why does it need to be routed via my storage network ?

Thanks for your advice.


Regards, Benoit Lair.


2013/10/3 Wei ZHOU 

> Could you check management.network.cidr and host in Global Setting?
>
>
> 2013/10/3 Indra Pramana 
>
> > Hi,
> >
> > I encountered the problem before, this is because for some reason, SSVM
> is
> > not able to mount to your NFS server. Try to SSH into the SSVM and then
> run
> > mount command to try whether you can mount manually. If cannot, then need
> > to investigate further.
> >
> > HTH.
> >
> > Thank you.
> >
> >
> > On Thu, Oct 3, 2013 at 6:48 PM, benoit lair 
> wrote:
> >
> > > Hello guys,
> > >
> > > I'm trying cs 4.2.0 installed with the cloudstack rpm repositories
> onto a
> > > centos 63 mgmt server.
> > >
> > > I've created a zone, a pod, a cluster with a xenserver 6.2 host.
> > >
> > > Created my networks, deployed the sysvm template (with the last
> version,
> > > not the one into he docs)
> > >
> > > I got an issue with the ssvm
> > >
> > > My dashboard says me i have 275MB of storage available, that is the
> size
> > of
> > > the rootfs of the ssvm.
> > > When i ran ssh against my ssvm (ssh -i /root/.ssh/id_rsa.cloud -p 3922
> > > root@169.254.0.82)
> > >
> > > i see the following with df -h :
> > >
> > > root@s-1-VM:~# df -h
> > > Filesystem  Size  Used
> Avail
> > > Use% Mounted on
> > > rootfs  276M  118M
>  145M
> > > 45% /
> > > udev 10M 0
> 10M
> > > 0% /dev
> > > tmpfs25M  152K
> 25M
> > > 1% /run
> > > /dev/disk/by-uuid/3bbaf5c6-5317-468b-9742-0e68c65ad565  276M  118M
>  145M
> > > 45% /
> > > tmpfs   5.0M 0
>  5.0M
> > > 0% /run/lock
> > > tmpfs79M 0
> 79M
> > > 0% /run/shm
> > > /dev/xvda1   30M   18M
> 11M
> > > 63% /boot
> > > /dev/xvda6   53M  4.9M
> 45M
> > > 10% /home
> > > /dev/xvda8  368M   11M
>  339M
> > > 3% /opt
> > > /dev/xvda10  48M  4.9M
> 41M
> > > 11% /tmp
> > > /dev/xvda7  610M  502M
> 77M
> > > 87% /usr
> > > /dev/xvda9  415M  107M
>  287M
> > > 27% /var
> > >
> > >
> > > That's not okay.
> > >
> > > In fact, the ssvm mount his own / partition and provide it to the mgmt
> > > server.
> > > However, i configured an nfs server as secondary storage server with ip
> > > 182.20.0.57 with mount point /export/secondary.
> > >
> > > Why do i not see my nfs server mounted onto the ssvm vm ?
> > >
> > > So due to this bug i can't upload my vm templates and populate my
> > templates
> > > database.
> > >
> > >
> > > Thanks a lot for your help.
> > >
> > > Regards.
> > >
> > > Benoit Lair.
> > >
> >
>

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Wei ZHOU]

The host (management server ip) in global setting is fixed as 192.168.56.1
in tools/devcloud/devcloud.sql
Maybe you need to change it.
I use another virtualbox instance with ip 192.168.56.2 as the management
server, then I change "host" in global setting to 192.168.56.2


2013/10/3 Punith s 

> no i'm using devcloud2 as the HOST ONLY MODE(xen) but i'm building the MS
> in my localhost which is a DHCP(10.11.1.135)
> the devcloud's ip is 198.168.56.1.
>
> i'm building with ref's to this link
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/DevCloud
>
>
>
>
> On Thu, Oct 3, 2013 at 5:57 PM, Wei ZHOU  wrote:
>
> > Is the ip of your management-server 192.168.56.1?
> >
> >
> > 2013/10/3 Punith s 
> >
> > > hi wei ,
> > > thanks for the reply but
> > >
> > > like i said i,m using devcloud2 as my host and building my basic
> > > infrastructure by running the python script
> > > python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg which
> > compised
> > > the package containing sysvm's and tiny linux templates .
> > >
> > > all the system vm's are shown running the the MS , but the agent state
> is
> > > shown null(-),
> > >
> > > while creating the instance , i cannot add the default tiny linux
> > template
> > > since it is not in the ready state(not yet downloaded by the sec stor
> vm)
> > > even though the systemvm's are running, is this due to agent state
> shown
> > > null ??
> > >
> > > regards,
> > > punith s
> > > cloudbyte
> > >
> > >
> > >
> > >
> > > On Thu, Oct 3, 2013 at 5:00 PM, Wei ZHOU 
> wrote:
> > >
> > >> Please follow the link to install new systemvm template:
> > >>
> > >>
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack#HowtobuildCloudStack-InstalltheSystemVMTemplate
> > >>
> > >> PS: The download url changed to
> > http://download.cloud.com/templates/4.2/
> > >> systemvmtemplate-2013-07-12-master-xen.vhd.bz2<
> >
> http://download.cloud.com/templates/4.2/systemvmtemplate-2013-07-12-master-xen.vhd.bz2
> > >
> > >> .
> > >>
> > >>
> > >> 2013/10/3 Punith s 
> > >>
> > >> > hi everyone ,
> > >> >
> > >> > i just build the cloudstack realese 4.2.0 on my devcloud2 to test my
> > >> plugin
> > >> > ,
> > >> >
> > >> > but i'm unable to create the tiny linux instance here after running
> > the
> > >> >  python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg
> > >> >
> > >> > the template is not getting ready , any suggestions ??
> > >> >
> > >> > the vmops.log file shows the following ,
> > >> >
> > >> > 2013-10-03 16:12:30,599 DEBUG [cloud.api.ApiServlet]
> > >> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 --
> GET
> > >> >
> > >> >
> > >>
> >
>  
> command=listTemplates&templatefilter=selfexecutable&zoneid=a2ed9972-3f9a-4bcc-b888-d68114a42b7a&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796950532
> > >> > 2013-10-03 16:12:30,923 DEBUG [agent.manager.DirectAgentAttache]
> > >> > (DirectAgent-7:null) Seq 1-349175812: Response Received:
> > >> > 2013-10-03 16:12:30,926 DEBUG [agent.transport.Request]
> > >> > (DirectAgent-7:null) Seq 1-349175812: Processing:  { Ans: , MgmtId:
> > >> > 268749071320359, via: 1, Ver: v1, Flags: 10,
> > >> >
> > >> >
> > >>
> >
> [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}]
> > >> > }
> > >> > 2013-10-03 16:12:31,140 DEBUG [storage.download.DownloadListener]
> > >> > (Timer-5:null) timeout: transitioning to download error state,
> > >> > currstate=NOT_DOWNLOADED, TEMPLATE: 5 at host 0
> > >> > 2013-10-03 16:12:31,141 DEBUG
> [storage.image.BaseImageStoreDriverImpl]
> > >> > (Timer-5:null) Performing image store createTemplate async callback
> > >> > 2013-10-03 16:12:31,269 WARN  [storage.download.DownloadListener]
> > >> > (Timer-5:null) Entering download error state: timeout waiting for
> > >> response
> > >> > from storage host, TEMPLATE: 5 at host 0
> > >> > 2013-10-03 16:12:34,311 DEBUG [cloud.api.ApiServlet]
> > >> > (1995997711@qtp-1547603062-3:null) ===START===  0:0:0:0:0:0:0:1 --
> > GET
> > >> >
> > >> >
> > >>
> >
>  
> command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
> > >> > 2013-10-03 16:12:34,346 DEBUG [cloud.api.ApiServlet]
> > >> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 --
> GET
> > >> >
> > >> >
> > >>
> >
>  
> command=listZones&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796954305
> > >> >
> > >> >
> > >> > thanks ,
> > >> >
> > >> > regards,
> > >> > punith s
> > >> > cloudbyte.com
> > >> >
> > >>
> > >
> > >
> >
>

Re: CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[Wei ZHOU]

I guess the root cause could be that your nfs server ip is not in storage
network.

Re: CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[benoit lair]

I thought i could have my secondary storage nfs server into the mgmt cidr ?
It were okay with a cs 4.0.0

So i need to move my secondary storage nfs server to the 10.32.0.0 cidr ?


2013/10/3 Wei ZHOU 

> I guess the root cause could be that your nfs server ip is not in storage
> network.
>

Re: CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[benoit lair]

Okay, i changed the ip of the secondary storage server into the ip range of
the pod, it doesn't work better.

I change now the network of the secondary storage server.


2013/10/3 benoit lair 

> I thought i could have my secondary storage nfs server into the mgmt cidr
> ? It were okay with a cs 4.0.0
>
> So i need to move my secondary storage nfs server to the 10.32.0.0 cidr ?
>
>
> 2013/10/3 Wei ZHOU 
>
>> I guess the root cause could be that your nfs server ip is not in storage
>> network.
>>
>
>

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Punith s]

i have been running in the mode, till now it was just fine until my system
crashed , so i got the new 4.2.0 release and started building on .
previously i had posted which devcloud mode is best suited for development
, you can refer this link
https://mail.google.com/mail/#sent/1411177bb5a650a2

the problem here is , i can see the system vm's shown as running in the UI
, but i cannot access their console from the MS, they are like half live
half dead .
and secondary system vm is failing to download the template(tiny linux)
since the agent is shown null in the UI.

i shall try to register a new template or iso from a remote web server.

regards,
punith s












On Thu, Oct 3, 2013 at 6:28 PM

, Wei ZHOU  wrote:

> The host (management server ip) in global setting is fixed as 192.168.56.1
> in tools/devcloud/devcloud.sql
> Maybe you need to change it.
> I use another virtualbox instance with ip 192.168.56.2 as the management
> server, then I change "host" in global setting to 192.168.56.2
>
>
> 2013/10/3 Punith s 
>
> > no i'm using devcloud2 as the HOST ONLY MODE(xen) but i'm building the MS
> > in my localhost which is a DHCP(10.11.1.135)
> > the devcloud's ip is 198.168.56.1.
> >
> > i'm building with ref's to this link
> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/DevCloud
> >
> >
> >
> >
> > On Thu, Oct 3, 2013 at 5:57 PM, Wei ZHOU  wrote:
> >
> > > Is the ip of your management-server 192.168.56.1?
> > >
> > >
> > > 2013/10/3 Punith s 
> > >
> > > > hi wei ,
> > > > thanks for the reply but
> > > >
> > > > like i said i,m using devcloud2 as my host and building my basic
> > > > infrastructure by running the python script
> > > > python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg which
> > > compised
> > > > the package containing sysvm's and tiny linux templates .
> > > >
> > > > all the system vm's are shown running the the MS , but the agent
> state
> > is
> > > > shown null(-),
> > > >
> > > > while creating the instance , i cannot add the default tiny linux
> > > template
> > > > since it is not in the ready state(not yet downloaded by the sec stor
> > vm)
> > > > even though the systemvm's are running, is this due to agent state
> > shown
> > > > null ??
> > > >
> > > > regards,
> > > > punith s
> > > > cloudbyte
> > > >
> > > >
> > > >
> > > >
> > > > On Thu, Oct 3, 2013 at 5:00 PM, Wei ZHOU 
> > wrote:
> > > >
> > > >> Please follow the link to install new systemvm template:
> > > >>
> > > >>
> > >
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack#HowtobuildCloudStack-InstalltheSystemVMTemplate
> > > >>
> > > >> PS: The download url changed to
> > > http://download.cloud.com/templates/4.2/
> > > >> systemvmtemplate-2013-07-12-master-xen.vhd.bz2<
> > >
> >
> http://download.cloud.com/templates/4.2/systemvmtemplate-2013-07-12-master-xen.vhd.bz2
> > > >
> > > >> .
> > > >>
> > > >>
> > > >> 2013/10/3 Punith s 
> > > >>
> > > >> > hi everyone ,
> > > >> >
> > > >> > i just build the cloudstack realese 4.2.0 on my devcloud2 to test
> my
> > > >> plugin
> > > >> > ,
> > > >> >
> > > >> > but i'm unable to create the tiny linux instance here after
> running
> > > the
> > > >> >  python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg
> > > >> >
> > > >> > the template is not getting ready , any suggestions ??
> > > >> >
> > > >> > the vmops.log file shows the following ,
> > > >> >
> > > >> > 2013-10-03 16:12:30,599 DEBUG [cloud.api.ApiServlet]
> > > >> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 --
> > GET
> > > >> >
> > > >> >
> > > >>
> > >
> >
>  
> command=listTemplates&templatefilter=selfexecutable&zoneid=a2ed9972-3f9a-4bcc-b888-d68114a42b7a&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796950532
> > > >> > 2013-10-03 16:12:30,923 DEBUG [agent.manager.DirectAgentAttache]
> > > >> > (DirectAgent-7:null) Seq 1-349175812: Response Received:
> > > >> > 2013-10-03 16:12:30,926 DEBUG [agent.transport.Request]
> > > >> > (DirectAgent-7:null) Seq 1-349175812: Processing:  { Ans: ,
> MgmtId:
> > > >> > 268749071320359, via: 1, Ver: v1, Flags: 10,
> > > >> >
> > > >> >
> > > >>
> > >
> >
> [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}]
> > > >> > }
> > > >> > 2013-10-03 16:12:31,140 DEBUG [storage.download.DownloadListener]
> > > >> > (Timer-5:null) timeout: transitioning to download error state,
> > > >> > currstate=NOT_DOWNLOADED, TEMPLATE: 5 at host 0
> > > >> > 2013-10-03 16:12:31,141 DEBUG
> > [storage.image.BaseImageStoreDriverImpl]
> > > >> > (Timer-5:null) Performing image store createTemplate async
> callback
> > > >> > 2013-10-03 16:12:31,269 WARN  [storage.download.DownloadListener]
> > > >> > (Timer-5:null) Entering download error state: timeout waiting for
> > > >> response
> > > >> > from storage host, TEMPLATE: 5 at host 0
> > > >> > 2013-10-03 16:12:34,311 DEBUG [cloud.api.ApiServlet]
> > > >> > (1995997711@qtp-154760306

Re: CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[Punith s]

yea i'm also finding issue with the sysvm in devcloud at host only mode.
the tiny linux template is not getting downloaded even though the secondary
storage sys vm is shown running in the UI , but i can't access its console.
i even tried ssh into 192.168.56.10(xenbr0) and looked into
 root@devcloud:/opt/storage/secondary/template/tmpl/1/5# ls
ce5b212e-215a-3461-94fb-814a635b2215.vhd  template.properties where the
.vhd is present.

i think The Secondary Storage VM is failing to  retrieve templates and make
the ready to use.
i looked into vmops.log and
found com.cloud.storage.download.DownloadListener.java doing this job ,
perhaps need to debug to know who is calling this.




On Thu, Oct 3, 2013 at 6:38 PM, benoit lair  wrote:

> Okay, i changed the ip of the secondary storage server into the ip range of
> the pod, it doesn't work better.
>
> I change now the network of the secondary storage server.
>
>
> 2013/10/3 benoit lair 
>
> > I thought i could have my secondary storage nfs server into the mgmt cidr
> > ? It were okay with a cs 4.0.0
> >
> > So i need to move my secondary storage nfs server to the 10.32.0.0 cidr ?
> >
> >
> > 2013/10/3 Wei ZHOU 
> >
> >> I guess the root cause could be that your nfs server ip is not in
> storage
> >> network.
> >>
> >
> >
>

Re: CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[Wei ZHOU]

Can you run ssvm_check.sh in SSVM ?
The template is in devcloud2, so it should because of an unknown
misconfiguration.


2013/10/3 Punith s 

> yea i'm also finding issue with the sysvm in devcloud at host only mode.
> the tiny linux template is not getting downloaded even though the secondary
> storage sys vm is shown running in the UI , but i can't access its console.
> i even tried ssh into 192.168.56.10(xenbr0) and looked into
>  root@devcloud:/opt/storage/secondary/template/tmpl/1/5# ls
> ce5b212e-215a-3461-94fb-814a635b2215.vhd  template.properties where the
> .vhd is present.
>
> i think The Secondary Storage VM is failing to  retrieve templates and make
> the ready to use.
> i looked into vmops.log and
> found com.cloud.storage.download.DownloadListener.java doing this job ,
> perhaps need to debug to know who is calling this.
>
>
>
>
> On Thu, Oct 3, 2013 at 6:38 PM, benoit lair  wrote:
>
> > Okay, i changed the ip of the secondary storage server into the ip range
> of
> > the pod, it doesn't work better.
> >
> > I change now the network of the secondary storage server.
> >
> >
> > 2013/10/3 benoit lair 
> >
> > > I thought i could have my secondary storage nfs server into the mgmt
> cidr
> > > ? It were okay with a cs 4.0.0
> > >
> > > So i need to move my secondary storage nfs server to the 10.32.0.0
> cidr ?
> > >
> > >
> > > 2013/10/3 Wei ZHOU 
> > >
> > >> I guess the root cause could be that your nfs server ip is not in
> > storage
> > >> network.
> > >>
> > >
> > >
> >
>

Re: Review Request 14451: Some test for NetUtils

[Laszlo Hornyak]

> On Oct. 3, 2013, 10:10 a.m., Saksham Srivastava wrote:
> > utils/src/com/cloud/utils/net/NetUtils.java, line 366
> > 
> >
> > Any particular reason for making dot as private static ? Making it 
> > local to ip2Long could also solve the purpose as I don't see it being used 
> > anywhere else.
> > If u still want to make it as private static it is better to keep the 
> > variable with all other static variables at the beginning of the class.
> >

static: the point is that it should be created only once, avoiding creating the 
pattern again and again when it is just a local var Pattern is thread safe


> On Oct. 3, 2013, 10:10 a.m., Saksham Srivastava wrote:
> > utils/src/com/cloud/utils/net/NetUtils.java, line 149
> > 
> >
> > Can you mention against which branch the patch was created. Also create 
> > a bug/enhancement in Jira to track the issue.

this test is against master branch

create a jira ticket for what issue?


> On Oct. 3, 2013, 10:10 a.m., Saksham Srivastava wrote:
> > utils/test/com/cloud/utils/net/NetUtilsTest.java, line 225
> > 
> >
> > Can you add few negative test cases like (15, "00:00:00:00:00:ff") in 
> > each of these methods.

Could you add those tests? I have no idea for those tests right now but I will 
read your patch.


- Laszlo


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14451/#review26645
---


On Oct. 2, 2013, 9:19 p.m., Laszlo Hornyak wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14451/
> ---
> 
> (Updated Oct. 2, 2013, 9:19 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> - tests added for mac2Long, byte2Mac, long2Mac, ip2Long and long2Ip
> - isWindows static method removed - it was not used
> - minor changes in the implementations of the tested methods
> 
> 
> Diffs
> -
> 
>   utils/src/com/cloud/utils/net/NetUtils.java 1e72e22 
>   utils/test/com/cloud/utils/net/NetUtilsTest.java 3cfc98f 
> 
> Diff: https://reviews.apache.org/r/14451/diff/
> 
> 
> Testing
> ---
> 
> yes
> 
> 
> Thanks,
> 
> Laszlo Hornyak
> 
>

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Punith s]

hi Wei ,

i found no system virtual running in my infrastructure !! , i think this is
the main reason behind this mess ??
any suggestions to get a virtual router up? and should i be on static ip in
my localhost ??thanks.

regards,
punith s






On Thu, Oct 3, 2013 at 6:47 PM, Punith s  wrote:

> i have been running in the mode, till now it was just fine until my system
> crashed , so i got the new 4.2.0 release and started building on .
> previously i had posted which devcloud mode is best suited for development
> , you can refer this link
> https://mail.google.com/mail/#sent/1411177bb5a650a2
>
> the problem here is , i can see the system vm's shown as running in the UI
> , but i cannot access their console from the MS, they are like half live
> half dead .
> and secondary system vm is failing to download the template(tiny linux)
> since the agent is shown null in the UI.
>
> i shall try to register a new template or iso from a remote web server.
>
> regards,
> punith s
>
>
>
>
>
>
>
>
>
>
>
>
> On Thu, Oct 3, 2013 at 6:28 PM
>
> , Wei ZHOU  wrote:
>
>> The host (management server ip) in global setting is fixed as 192.168.56.1
>> in tools/devcloud/devcloud.sql
>> Maybe you need to change it.
>> I use another virtualbox instance with ip 192.168.56.2 as the management
>> server, then I change "host" in global setting to 192.168.56.2
>>
>>
>> 2013/10/3 Punith s 
>>
>> > no i'm using devcloud2 as the HOST ONLY MODE(xen) but i'm building the
>> MS
>> > in my localhost which is a DHCP(10.11.1.135)
>> > the devcloud's ip is 198.168.56.1.
>> >
>> > i'm building with ref's to this link
>> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/DevCloud
>> >
>> >
>> >
>> >
>> > On Thu, Oct 3, 2013 at 5:57 PM, Wei ZHOU  wrote:
>> >
>> > > Is the ip of your management-server 192.168.56.1?
>> > >
>> > >
>> > > 2013/10/3 Punith s 
>> > >
>> > > > hi wei ,
>> > > > thanks for the reply but
>> > > >
>> > > > like i said i,m using devcloud2 as my host and building my basic
>> > > > infrastructure by running the python script
>> > > > python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg which
>> > > compised
>> > > > the package containing sysvm's and tiny linux templates .
>> > > >
>> > > > all the system vm's are shown running the the MS , but the agent
>> state
>> > is
>> > > > shown null(-),
>> > > >
>> > > > while creating the instance , i cannot add the default tiny linux
>> > > template
>> > > > since it is not in the ready state(not yet downloaded by the sec
>> stor
>> > vm)
>> > > > even though the systemvm's are running, is this due to agent state
>> > shown
>> > > > null ??
>> > > >
>> > > > regards,
>> > > > punith s
>> > > > cloudbyte
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Thu, Oct 3, 2013 at 5:00 PM, Wei ZHOU 
>> > wrote:
>> > > >
>> > > >> Please follow the link to install new systemvm template:
>> > > >>
>> > > >>
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack#HowtobuildCloudStack-InstalltheSystemVMTemplate
>> > > >>
>> > > >> PS: The download url changed to
>> > > http://download.cloud.com/templates/4.2/
>> > > >> systemvmtemplate-2013-07-12-master-xen.vhd.bz2<
>> > >
>> >
>> http://download.cloud.com/templates/4.2/systemvmtemplate-2013-07-12-master-xen.vhd.bz2
>> > > >
>> > > >> .
>> > > >>
>> > > >>
>> > > >> 2013/10/3 Punith s 
>> > > >>
>> > > >> > hi everyone ,
>> > > >> >
>> > > >> > i just build the cloudstack realese 4.2.0 on my devcloud2 to
>> test my
>> > > >> plugin
>> > > >> > ,
>> > > >> >
>> > > >> > but i'm unable to create the tiny linux instance here after
>> running
>> > > the
>> > > >> >  python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg
>> > > >> >
>> > > >> > the template is not getting ready , any suggestions ??
>> > > >> >
>> > > >> > the vmops.log file shows the following ,
>> > > >> >
>> > > >> > 2013-10-03 16:12:30,599 DEBUG [cloud.api.ApiServlet]
>> > > >> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1 --
>> > GET
>> > > >> >
>> > > >> >
>> > > >>
>> > >
>> >
>>  
>> command=listTemplates&templatefilter=selfexecutable&zoneid=a2ed9972-3f9a-4bcc-b888-d68114a42b7a&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796950532
>> > > >> > 2013-10-03 16:12:30,923 DEBUG [agent.manager.DirectAgentAttache]
>> > > >> > (DirectAgent-7:null) Seq 1-349175812: Response Received:
>> > > >> > 2013-10-03 16:12:30,926 DEBUG [agent.transport.Request]
>> > > >> > (DirectAgent-7:null) Seq 1-349175812: Processing:  { Ans: ,
>> MgmtId:
>> > > >> > 268749071320359, via: 1, Ver: v1, Flags: 10,
>> > > >> >
>> > > >> >
>> > > >>
>> > >
>> >
>> [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}]
>> > > >> > }
>> > > >> > 2013-10-03 16:12:31,140 DEBUG [storage.download.DownloadListener]
>> > > >> > (Timer-5:null) timeout: transitioning to download error state,
>> > > >> > currstate=NOT_DOWNLOADED, TEMPLATE: 5 at host 0
>> > > >> > 2013-10-03 

Re: [URGENT] Unable to stop/start system VMs after upgrade to 4.2.0

[Venkata SwamyBabu Budumuru]

What is the hypervisor you are using?

On 03/10/13 6:14 PM, "David Ortiz"  wrote:

>If you manually change the vm status in the database would it let you
>destroy it then?
>
>> Date: Thu, 3 Oct 2013 20:22:33 +0800
>> Subject: Re: [URGENT] Unable to stop/start system VMs after upgrade to
>>4.2.0
>> From: in...@sg.or.id
>> To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
>> 
>> Dear all,
>> 
>> I managed to fix the VRs issue by destroying the routers and restarting
>>the
>> networks associated to the routers.
>> 
>> Only left is the CPVM, I am not able to stop/destroy it. Any advise?
>> 
>> Looking forward to your reply, thank you.
>> 
>> Cheers.
>> 
>> 
>> 
>> On Thu, Oct 3, 2013 at 8:16 PM, Indra Pramana  wrote:
>> 
>> > Dear all,
>> >
>> > I am now in the progress of upgrading my CloudStack from 4.1.1 to
>>4.2.0.
>> > Running cloudstack-sysvmadm can restart the SSVM, but failed to
>>restart the
>> > CPVM and all the VRs.
>> >
>> > 
>> > [1] 3152
>> > root@cs-mgmt-01:~/backup/20131003# tail -f sysvm.log
>> > nohup: ignoring input
>> > /usr/bin/cloudstack-sysvmadm: line 21: /etc/rc.d/init.d/functions: No
>>such
>> > file or directory
>> >
>> > Stopping and starting 1 secondary storage vm(s)...
>> > Done stopping and starting secondary storage vm(s)
>> >
>> > Stopping and starting 1 console proxy vm(s)...
>> > ERROR: Failed to stop console proxy vm with id 1980
>> >
>> > Done stopping and starting console proxy vm(s) .
>> >
>> > Stopping and starting 0 running routing vm(s)...
>> > 
>> >
>> > SSVM seems OK, I have run health check script and everything is in
>>order.
>> >
>> > VM state of CPVM is running, but state is disconnected. I can't stop
>>or
>> > destroy the CPVM.
>> >
>> > All the VRs are running now but I am not too sure if they are already
>> > using the new 4.2 template or still using the old template, since it
>>seems
>> > the sysvmadm script was unable to detect the virtual routers.
>> >
>> > Anyone can help?
>> >
>> > Thank you.
>> >
> 

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Wei ZHOU]

The virtual router will be created when you deploy the first VM.


2013/10/3 Punith s 

> hi Wei ,
>
> i found no system virtual running in my infrastructure !! , i think this
> is the main reason behind this mess ??
> any suggestions to get a virtual router up? and should i be on static ip
> in my localhost ??thanks.
>
> regards,
> punith s
>
>
>
>
>
>
> On Thu, Oct 3, 2013 at 6:47 PM, Punith s  wrote:
>
>> i have been running in the mode, till now it was just fine until my
>> system crashed , so i got the new 4.2.0 release and started building on .
>> previously i had posted which devcloud mode is best suited for
>> development , you can refer this link
>> https://mail.google.com/mail/#sent/1411177bb5a650a2
>>
>> the problem here is , i can see the system vm's shown as running in the
>> UI , but i cannot access their console from the MS, they are like half live
>> half dead .
>> and secondary system vm is failing to download the template(tiny linux)
>> since the agent is shown null in the UI.
>>
>> i shall try to register a new template or iso from a remote web server.
>>
>> regards,
>> punith s
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> On Thu, Oct 3, 2013 at 6:28 PM
>>
>> , Wei ZHOU  wrote:
>>
>>> The host (management server ip) in global setting is fixed as
>>> 192.168.56.1
>>> in tools/devcloud/devcloud.sql
>>> Maybe you need to change it.
>>> I use another virtualbox instance with ip 192.168.56.2 as the management
>>> server, then I change "host" in global setting to 192.168.56.2
>>>
>>>
>>> 2013/10/3 Punith s 
>>>
>>> > no i'm using devcloud2 as the HOST ONLY MODE(xen) but i'm building the
>>> MS
>>> > in my localhost which is a DHCP(10.11.1.135)
>>> > the devcloud's ip is 198.168.56.1.
>>> >
>>> > i'm building with ref's to this link
>>> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/DevCloud
>>> >
>>> >
>>> >
>>> >
>>> > On Thu, Oct 3, 2013 at 5:57 PM, Wei ZHOU 
>>> wrote:
>>> >
>>> > > Is the ip of your management-server 192.168.56.1?
>>> > >
>>> > >
>>> > > 2013/10/3 Punith s 
>>> > >
>>> > > > hi wei ,
>>> > > > thanks for the reply but
>>> > > >
>>> > > > like i said i,m using devcloud2 as my host and building my basic
>>> > > > infrastructure by running the python script
>>> > > > python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg which
>>> > > compised
>>> > > > the package containing sysvm's and tiny linux templates .
>>> > > >
>>> > > > all the system vm's are shown running the the MS , but the agent
>>> state
>>> > is
>>> > > > shown null(-),
>>> > > >
>>> > > > while creating the instance , i cannot add the default tiny linux
>>> > > template
>>> > > > since it is not in the ready state(not yet downloaded by the sec
>>> stor
>>> > vm)
>>> > > > even though the systemvm's are running, is this due to agent state
>>> > shown
>>> > > > null ??
>>> > > >
>>> > > > regards,
>>> > > > punith s
>>> > > > cloudbyte
>>> > > >
>>> > > >
>>> > > >
>>> > > >
>>> > > > On Thu, Oct 3, 2013 at 5:00 PM, Wei ZHOU 
>>> > wrote:
>>> > > >
>>> > > >> Please follow the link to install new systemvm template:
>>> > > >>
>>> > > >>
>>> > >
>>> >
>>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack#HowtobuildCloudStack-InstalltheSystemVMTemplate
>>> > > >>
>>> > > >> PS: The download url changed to
>>> > > http://download.cloud.com/templates/4.2/
>>> > > >> systemvmtemplate-2013-07-12-master-xen.vhd.bz2<
>>> > >
>>> >
>>> http://download.cloud.com/templates/4.2/systemvmtemplate-2013-07-12-master-xen.vhd.bz2
>>> > > >
>>> > > >> .
>>> > > >>
>>> > > >>
>>> > > >> 2013/10/3 Punith s 
>>> > > >>
>>> > > >> > hi everyone ,
>>> > > >> >
>>> > > >> > i just build the cloudstack realese 4.2.0 on my devcloud2 to
>>> test my
>>> > > >> plugin
>>> > > >> > ,
>>> > > >> >
>>> > > >> > but i'm unable to create the tiny linux instance here after
>>> running
>>> > > the
>>> > > >> >  python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg
>>> > > >> >
>>> > > >> > the template is not getting ready , any suggestions ??
>>> > > >> >
>>> > > >> > the vmops.log file shows the following ,
>>> > > >> >
>>> > > >> > 2013-10-03 16:12:30,599 DEBUG [cloud.api.ApiServlet]
>>> > > >> > (1995997711@qtp-1547603062-3:null) ===END===  0:0:0:0:0:0:0:1
>>> --
>>> > GET
>>> > > >> >
>>> > > >> >
>>> > > >>
>>> > >
>>> >
>>>  
>>> command=listTemplates&templatefilter=selfexecutable&zoneid=a2ed9972-3f9a-4bcc-b888-d68114a42b7a&response=json&sessionkey=yCeA7XxmdJZEF47qnBCzXPrV7Go%3D&_=1380796950532
>>> > > >> > 2013-10-03 16:12:30,923 DEBUG [agent.manager.DirectAgentAttache]
>>> > > >> > (DirectAgent-7:null) Seq 1-349175812: Response Received:
>>> > > >> > 2013-10-03 16:12:30,926 DEBUG [agent.transport.Request]
>>> > > >> > (DirectAgent-7:null) Seq 1-349175812: Processing:  { Ans: ,
>>> MgmtId:
>>> > > >> > 268749071320359, via: 1, Ver: v1, Flags: 10,
>>> > > >> >
>>> > > >> >
>>> > > >>
>>> > >
>>> >
>>> [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"r

Re: CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[Punith s]

i cannot access the console of SSVM ,
i ran a python ../marvin/marvin/deployDataCenter.py -i devcloud.cfg python
script to setup my basic zone.
but my virtual router shown 0 in the infrastructure even after restarting
my MS, any idea on why on getting my virtual router up ?? thanks.

regards,
punith s


On Thu, Oct 3, 2013 at 7:04 PM, Wei ZHOU  wrote:

> Can you run ssvm_check.sh in SSVM ?
> The template is in devcloud2, so it should because of an unknown
> misconfiguration.
>
>
> 2013/10/3 Punith s 
>
> > yea i'm also finding issue with the sysvm in devcloud at host only mode.
> > the tiny linux template is not getting downloaded even though the
> secondary
> > storage sys vm is shown running in the UI , but i can't access its
> console.
> > i even tried ssh into 192.168.56.10(xenbr0) and looked into
> >  root@devcloud:/opt/storage/secondary/template/tmpl/1/5# ls
> > ce5b212e-215a-3461-94fb-814a635b2215.vhd  template.properties where the
> > .vhd is present.
> >
> > i think The Secondary Storage VM is failing to  retrieve templates and
> make
> > the ready to use.
> > i looked into vmops.log and
> > found com.cloud.storage.download.DownloadListener.java doing this job ,
> > perhaps need to debug to know who is calling this.
> >
> >
> >
> >
> > On Thu, Oct 3, 2013 at 6:38 PM, benoit lair 
> wrote:
> >
> > > Okay, i changed the ip of the secondary storage server into the ip
> range
> > of
> > > the pod, it doesn't work better.
> > >
> > > I change now the network of the secondary storage server.
> > >
> > >
> > > 2013/10/3 benoit lair 
> > >
> > > > I thought i could have my secondary storage nfs server into the mgmt
> > cidr
> > > > ? It were okay with a cs 4.0.0
> > > >
> > > > So i need to move my secondary storage nfs server to the 10.32.0.0
> > cidr ?
> > > >
> > > >
> > > > 2013/10/3 Wei ZHOU 
> > > >
> > > >> I guess the root cause could be that your nfs server ip is not in
> > > storage
> > > >> network.
> > > >>
> > > >
> > > >
> > >
> >
>

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Punith s]

hi wei,

i tried to re deploy the db ran the MS again , in parallel i ran the
devcloud python script , this is my MS console log , i saw some xen
resources missing ,

WARN  [cloud.cluster.ClusterManagerImpl] (Cluster-Notification-1:)
Notifying management server join event took 175 ms
INFO  [cloud.configuration.ConfigurationManagerImpl]
(1927634425@qtp-938693467-3:) adding a new subnet to the network 204
INFO  [cloud.resource.ResourceManagerImpl] (1927634425@qtp-938693467-3:)
Trying to add a new host at http://192.168.56.10/ in data center 1
INFO  [xen.discoverer.XcpServerDiscoverer] (1927634425@qtp-938693467-3:)
Found host devcloud ip=192.168.56.10 product version=1.6.0
INFO  [xen.resource.CitrixResourceBase] (1927634425@qtp-938693467-3:)
Private Network is Pool-wide network associated with eth0 for host
192.168.56.10
INFO  [xen.resource.CitrixResourceBase] (1927634425@qtp-938693467-3:) Guest
Network is Pool-wide network associated with eth0 for host 192.168.56.10
INFO  [xen.resource.CitrixResourceBase] (1927634425@qtp-938693467-3:)
Public Network is Pool-wide network associated with eth0 for host
192.168.56.10
INFO  [xen.discoverer.XcpServerDiscoverer] (1927634425@qtp-938693467-3:)
Host: devcloud connected with hypervisor type: XenServer. Checking CIDR...
INFO  [agent.manager.DirectAgentAttache] (1927634425@qtp-938693467-3:)
StartupAnswer received 1 Interval = 60
*WARN  [xen.resource.CitrixResourceBase] (DirectAgent-1:) We cannot locate
/home/punith/Desktop/apache-cloudstack-4.2.0-src/client/target/cloud-client-ui-4.2.0/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xcposs/../ovsgre
*
*WARN  [xen.resource.CitrixResourceBase] (DirectAgent-1:) We cannot locate
/home/punith/Desktop/apache-cloudstack-4.2.0-src/client/target/cloud-client-ui-4.2.0/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xcposs/../../../../network/domr//ipassoc.sh
*
*WARN  [xen.resource.CitrixResourceBase] (DirectAgent-1:) We cannot locate
/home/punith/Desktop/apache-cloudstack-4.2.0-src/client/target/cloud-client-ui-4.2.0/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xcposs/../../../../network/domr//getDomRVersion.sh
*
*WARN  [xen.resource.CitrixResourceBase] (DirectAgent-1:) We cannot locate
/home/punith/Desktop/apache-cloudstack-4.2.0-src/client/target/cloud-client-ui-4.2.0/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xcposs/../../../../network/domr//getRouterStatus.sh
*
*WARN  [xen.resource.CitrixResourceBase] (DirectAgent-1:) We cannot locate
/home/punith/Desktop/apache-cloudstack-4.2.0-src/client/target/cloud-client-ui-4.2.0/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xcposs/../../../../network/domr//networkUsage.sh
*
*WARN  [xen.resource.CitrixResourceBase] (DirectAgent-1:) We cannot locate
/home/punith/Desktop/apache-cloudstack-4.2.0-src/client/target/cloud-client-ui-4.2.0/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xcposs/../../../../network/domr//l2tp_vpn.sh
*
*WARN  [xen.resource.CitrixResourceBase] (DirectAgent-1:) We cannot locate
/home/punith/Desktop/apache-cloudstack-4.2.0-src/client/target/cloud-client-ui-4.2.0/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xcposs/../vhd-util
*
INFO  [network.security.SecurityGroupListener] (1927634425@qtp-938693467-3:)
Received a host startup notification
INFO  [network.security.SecurityGroupListener] (1927634425@qtp-938693467-3:)
Scheduled network rules cleanup, interval=2669
INFO  [network.security.SecurityGroupListener] (1927634425@qtp-938693467-3:)
Received a host startup notification
INFO  [cloud.resource.ResourceManagerImpl] (1927634425@qtp-938693467-3:)
server resources successfully discovered by XCP Agent
INFO  [datastore.lifecycle.CloudStackImageStoreLifeCycleImpl]
(1927634425@qtp-938693467-3:) Trying to add a new data store at
nfs://192.168.56.10/opt/storage/secondary to data center 1
INFO  [cloud.configuration.ConfigurationManagerImpl]
(1927634425@qtp-938693467-3:) No storage traffic type was specified by
admin, create default storage traffic on physical network 200 with same
configure of management traffic type
INFO  [storage.endpoint.DefaultEndPointSelector] (StatsCollector-3:) No
running ssvm is found, so command will be sent to LocalHostEndPoint
INFO  [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:)
No running secondary storage vms found in datacenter id=1, starting one
INFO  [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:) No
stopped secondary storage vm is available, need to allocate a new secondary
storage vm
INFO  [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:) No
stopped console proxy is available, need to allocate a new console proxy
INFO  [storage.volume.VolumeServiceImpl] (consoleproxy-1:) lock is acquired
for VMTemplateStoragePool 1
INFO  [storage.volume.VolumeServiceImpl] (consoleproxy-1:) releasing lock
for VMTemplateStoragePool 1
WARN  [utils.db.Merovingian2] (consoleproxy-1:) Was unable to find lock for
the key template_spool_ref1 and thread id 566503218
INFO  [storage.volume.VolumeServiceImpl] 

Review Request 14469: CLOUDSTACK-4637: Fix failures in test_egress_fw_rules.py

[Girish Shilamkar]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14469/
---

Review request for cloudstack, Harikrishna Patnala and venkata swamy babu  
budumuru.


Bugs: CLOUDSTACK-4637


Repository: cloudstack-git


Description
---

Add logic to wait for router to boot.


Diffs
-

  test/integration/component/test_egress_fw_rules.py 5c18f9c 

Diff: https://reviews.apache.org/r/14469/diff/


Testing
---


Thanks,

Girish Shilamkar

Re: Configuration table changes and database update

[Darren Shepherd]

Let me look at this today.  The spring changes I have will greatly improve 
these initialization issues.  The current state of spring on master makes it 
very difficult to deterministic ally initialize beans.  With the spring changes 
I have in place the database upgrade stuff is in the bootstrap context and will 
be initialized before everything else.

You mentioned there's an issue with the database upgrade depending on a DAO.  
I'll look into that and fix it today.  The fix will be on the 
spring-modularization branch which I'd like to get merge ASAP.

Darren

> On Oct 3, 2013, at 2:08 AM, Hugo Trippaers  wrote:
> 
> Heya guys,
> 
> I'm still running into this problem. Our jenkins automagically installs and 
> tests the latest packages based on master. With a clean database on clean 
> machines.
> 
> The error reported is similar to the error encountered:
> 
> Caused by: com.cloud.utils.exception.CloudRuntimeException: DB Exception on: 
> com.mysql.jdbc.JDBC4PreparedStatement@64726693: SELECT 
> configuration.instance, configuration.component, configuration.name, 
> configuration.value, configuration.default_value, configuration.description, 
> configuration.category, configuration.is_dynamic, configuration.scope, 
> configuration.updated FROM configuration WHERE configuration.name = 
> _binary'storage.cache.replacement.lru.interval'  ORDER BY RAND() LIMIT 1
>at 
> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:421)
>at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>at 
> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:356)
>at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>at 
> com.cloud.utils.db.GenericDaoBase.findOneIncludingRemovedBy(GenericDaoBase.java:869)
>at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>at 
> org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.findByName(ConfigurationDaoImpl.java:201)
>at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>at 
> org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.getValue(ConfigurationDaoImpl.java:166)
>at 
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>at 
> org.apache.cloudstack.storage.cache.manager.StorageCacheReplacementAlgorithmLRU.initialize(StorageCacheReplacementAlgorithmLRU.java:63)
>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>at java.lang.reflect.Method.invoke(Method.java:616)
>at 
> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:346)
>at 
> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:299)
>at 
> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:132)
>... 79 more
> Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown 
> column 'configuration.default_value' in 'field list'
>at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
>at com.mysql.jdbc.Util.getInstance(Util.java:386)
>at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1053)
>at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4074)
>at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4006)
>at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2468)
>at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2629)
>at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2719)
>at 
> com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2155)
>at 
> com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2318)
>at 
> org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
>at 
> org.apache.commons.dbcp.De

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Wei ZHOU]

It is normal.
You can get more information in vmops.log

Re: A question on vm migrations when hosts are set into a maintenance mode.

[Alex Ough]

Hi Koushik,

Thanks for your reply, but unfortunately, this setting does NOT cover
'MigrateCommand'.
As you specified, it seems to be effective only in Start/Stop/CopyCommand.

So can we include 'MigrateCommand' in that setting?

Thanks
Alex Ough


On Wed, Oct 2, 2013 at 11:44 PM, Koushik Das  wrote:

> It is already a global setting in 4.2. The name of the setting is
> "execute.in.sequence.hypervisor.commands".
>
> Check out Config.java
>
> ExecuteInSequence("Advanced", ManagementServer.class, Boolean.class,
> "execute.in.sequence.hypervisor.commands", "true", "If set to true,
> StartCommand, StopCommand, CopyCommand will be synchronized on the agent
> side." +
> " If set to false, these commands become asynchronous. Default value
> is true.", null),
>
>
> -Koushik
>
> On 02-Oct-2013, at 10:43 PM, Alex Ough  alex.o...@sungard.com>> wrote:
>
> Thanks for the reply, Marcus.
>
> What about the option #3, which is to make it as a global setting?
> I think it can prevent side effects if exist.
>
> Alex Ough
>
>
> On Wed, Oct 2, 2013 at 11:37 AM, Marcus Sorensen  >wrote:
>
> Not sure. I don't know the history well enough to know if there were
> issues in the past, it might be that some hypervisors were fine and
> others weren't.
>
> On Wed, Oct 2, 2013 at 9:21 AM, Alex Ough  alex.o...@sungard.com>> wrote:
> Marcus/Kelven,
>
> Any thoughts on my suggestions?
>
> Thanks
> Alex Ough
>
>
> On Tue, Sep 24, 2013 at 12:09 PM, Alex Ough  alex.o...@sungard.com>>
> wrote:
>
> Oh, sorry for the confusion. I must have reversed the flags.
> As Kelven pointed, it is set as 'TRUE', which makes the process as
> sequential.
>
> So my questions are
> 1. If there is any reason why the method have been defined to return
> 'TRUE' always?
> 2. Do we expect any side effects and/or malfunctioning if we change it
> to
> returning 'FALSE'?
> 3. For a resolution without breaking possible flows, can we add the
> value
> of 'executeInSequence' to the global setting if #2 answers YES?
>
>
> On Tue, Sep 24, 2013 at 11:19 AM, Marcus Sorensen  >
> wrote:
>
> I thought executeInSequence of 'true' made it go serially, or
> sequentially. In my codebase for 4.1,4.2,master it's been 'true' since
> August of 2010:
>
> 2010-08-11 09:13:29 -0700 19) public class MigrateCommand extends
> Command
> {
> 2010-08-11 09:13:29 -0700 20) String vmName;
> 2010-08-11 09:13:29 -0700 21) String destIp;
> 2011-08-10 10:26:04 -0700 22) String hostGuid;
> 2010-08-11 09:13:29 -0700 23) boolean isWindows;
> 2010-08-11 09:13:29 -0700 24)
> 2010-08-11 09:13:29 -0700 25)
> 2010-08-11 09:13:29 -0700 26) protected MigrateCommand() {
> 2010-08-11 09:13:29 -0700 27) }
> 2012-12-03 22:06:41 -0800 28)
> 2010-08-11 09:13:29 -0700 29) public MigrateCommand(String vmName,
> String destIp, boolean isWindows)
> 2010-08-11 09:13:29 -0700 30) this.vmName = vmName;
> 2010-08-11 09:13:29 -0700 31) this.destIp = destIp;
> 2010-08-11 09:13:29 -0700 32) this.isWindows = isWindows;
> 2010-08-11 09:13:29 -0700 33) }
> 2012-12-03 22:06:41 -0800 34)
> 2010-08-11 09:13:29 -0700 35) public boolean isWindows() {
> 2010-08-11 09:13:29 -0700 36) return isWindows;
> 2010-08-11 09:13:29 -0700 37) }
> 2012-12-03 22:06:41 -0800 38)
> 2010-08-11 09:13:29 -0700 39) public String getDestinationIp() {
> 2010-08-11 09:13:29 -0700 40) return destIp;
> 2010-08-11 09:13:29 -0700 41) }
> 2012-12-03 22:06:41 -0800 42)
> 2010-08-11 09:13:29 -0700 43) public String getVmName() {
> 2010-08-11 09:13:29 -0700 44) return vmName;
> 2010-08-11 09:13:29 -0700 45) }
> 2012-12-03 22:06:41 -0800 46)
> 2011-08-10 10:26:04 -0700 47) public void setHostGuid(String guid)
> {
> 2011-08-10 10:26:04 -0700 48) this.hostGuid = guid;
> 2011-08-10 10:26:04 -0700 49) }
> 2012-12-03 22:06:41 -0800 50)
> 2011-08-10 10:26:04 -0700 51) public String getHostGuid() {
> 2011-08-10 10:26:04 -0700 52) return this.hostGuid;
> 2011-08-10 10:26:04 -0700 53) }
> 2010-08-11 09:13:29 -0700 54)
> 2010-08-11 09:13:29 -0700 55) @Override
> 2010-08-11 09:13:29 -0700 56) public boolean executeInSequence() {
> 2010-08-11 09:13:29 -0700 57) return true;
> 2010-08-11 09:13:29 -0700 58) }
> 2010-08-11 09:13:29 -0700 59) }
>
> On Tue, Sep 24, 2013 at 9:58 AM, Chip Childers
> mailto:chip.child...@sungard.com>> wrote:
> Hey Kelven - This topic was discussed briefly in the past [1].  Are
> you
> able to provide any thoughts on Alex's ideas below?
>
> -chip
>
>
> [1] http://markmail.org/message/fznrszaswruvlmuy
>
>
>
> On Tue, Sep 24, 2013 at 10:53:04AM -0500, Alex Ough wrote:
> For a resolution without breaking possible flows, I'd like to add
> the
> value
> of 'executeInSequence' to the global setting.
> Is there any reason not to do this?
>
> Thanks
> Alex Ough
>
>
> On Mon, Sep 23, 2013 at 12:57 PM, Alex Ough  alex.o...@sungard.com>>
> wrote:

RE: [MERGE] spring-modularization to master - Spring Modularization

[Rayees Namathponnan]

Hi Prasanna,



If we are running BVT or regression on specific branch, marvin should also from 
same branch right ? but we always getting marvin from master branch  job 
"cloudstack-marvin"



Regards,

Rayees



-Original Message-
From: Prasanna Santhanam [mailto:t...@apache.org]
Sent: Wednesday, October 02, 2013 10:06 PM
To: dev@cloudstack.apache.org
Subject: Re: [MERGE] spring-modularization to master - Spring Modularization



I switched the test infrastructure on jenkins.buildacloud.org to run the bvts 
[1] against master last week. Couple of weeks before that the simulator [2] 
tests were switched to run against master. Both are broken unfortunately and 
the bvt and checkin tests aren't running.



I've filed a bug here:

https://issues.apache.org/jira//browse/CLOUDSTACK-4791



[1] http://jenkins.buildacloud.org/view/cloudstack-qa/

[2] http://jenkins.buildacloud.org/view/simulator/



Anyone who has access to the jenkins can run the bvts on their desired branch. 
Simply login and change the test-yumrepo-refresh job to point to your branch. 
Build that to refresh the remote repository with the packages made from your 
branch. Then switch test-matrix to point to the same development branch and 
fire a build. That's about it.



On Wed, Oct 02, 2013 at 05:42:54PM -0700, Darren Shepherd wrote:

> Yes agreed.  I've extensively tested this, but that is never enough.

> How do I get the BVTs ran against this.  Due to the cross cutting

> nature of this I want to get this merged as fast as possible.

>

> Darren

>

> > On Oct 2, 2013, at 4:43 PM, Alex Huang 
> > mailto:alex.hu...@citrix.com>> wrote:

> >

> > +1 on running the BVT on it.  We've been through this one once before.  
> > Should be careful.

> >

> > --Alex

> >

> >> -Original Message-

> >> From: Kelven Yang [mailto:kelven.y...@citrix.com]

> >> Sent: Wednesday, October 2, 2013 4:39 PM

> >> To: dev@cloudstack.apache.org

> >> Subject: Re: [MERGE] spring-modularization to master - Spring

> >> Modularization

> >>

> >> Darren,

> >>

> >> This looks really nice. A few questions on Spring AOP replacement.

> >>

> >> 1) Spring AOP is proxy-based, the reason we ended up of using

> >> customized AOP is mainly due to that inside existing CloudStack

> >> codebase, we have many places that are doing run-time type-casting,

> >> the code in these places assumes a real object that implements all 
> >> interfaces in the semantics context.

> >> At the time when I initially converted to Spring, I couldn't ensure

> >> that switching to proxy-based AOP can have 100% coverage for these

> >> run-time cases. What is your approach to address this run-time 
> >> type-casting issue?

> >>

> >> 2) We've run into a huge-memory footprint issue that may be caused

> >> by conflicts of CGLIB usage in Spring AOP and the CGLIB usage in

> >> CloudStack Dao layer. Do you have a chance to run a memory analysis

> >> in the heap after management server is started.

> >>

> >> I might be good to run BVT test on the branch before the merge,

> >> could someone initiate the effort?

> >>

> >> kelven

> >>

> >>

> >>

> >> On 10/2/13 3:48 PM, "Darren Shepherd" 
> >> mailto:darren.s.sheph...@gmail.com>>

> >> wrote:

> >>

> >>> Not sure how this works...  I would like to merge in the new

> >>> modularized Spring setup to master. There is info on the wiki

> >>> about it [1] [2] [3].  The primary change is to break apart the

> >>> monolithic applicationContext.xml and componentContext.xml files

> >>> such that each plugin can maintain and contribute its own configuration.

> >>>

> >>> In addition to breaking up the configuration we no longer use ACS

> >>> custom AOP and it is now fully Spring AOP.

> >>>

> >>> Now adding/removing a plug-in is a matter of just adding a jar to

> >>> the classpath (exception being commands.properties, I'll address

> >>> that in a different thread).  Unfortunately this branch does not

> >>> have the changes to package things in different RPMs.  So it would

> >>> be great if somebody could take up the packaging effort to split

> >>> out all the plugins into different RPMs.

> >>>

> >>> Darren

> >>>

> >>> [1]

> >>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Modularize+

> >>> Sp

> >> rin

> >>> g

> >>> [2]

> >>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Plug-

> >> ins%2C+Modu

> >>> les

> >>> %2C+and+Extensions

> >>> [3]

> >>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Extensions

> >



--

Prasanna.,





Powered by BigRock.com

Re: [MERGE] spring-modularization to master - Spring Modularization

[Chip Childers]

On Wed, Oct 2, 2013 at 8:59 PM, Darren Shepherd  wrote:

> It's actually really easy to turn this off.  If you look at the last
> commit of the branch you'll see what changes to turn it on.  So you can
> just reverse that one commit to disable it.
>
>  I'd rather merge this and then do the BVTs on master if possible.  I
> really want to get this committed.  Every time somebody changes a spring
> config file I have to keep making the corresponding changes.  It seems like
> people are gearing up and developing stuff right now for 4.3.  So the
> longer we wait the more headache it is for everyone.
>
> Again, if we find out this is a complete disaster, I can just flip some
> config settings and were back to the old style.  I had to keep
> compatibility with the old style as Awsapi and usage still use it.
>
> Darren
>


I get the desire, but *please* let's use BVT on this.  We, unfortunately,
have a poor track record with changes like this breaking things in master.
 I'm not saying this as a judgement / measurement of your branch, I'm
making a general historical statement.  We really need to hold ourselves to
the goal of keeping master stable through clear test results in feature
branches prior to a merge.

Re: [DISCUSS] Breaking out Marvin from CloudStack

[Chip Childers]

On Thu, Oct 03, 2013 at 05:55:14AM +, Santhosh Edukulla wrote:
> I believe both can exist independently. The framework should have more 
> flexibility and facilitation to run features\test cases based upon a  given 
> release and version on a given test bed. It should be intelligent enough to 
> run those cases  and only those cases pertaining to that release with few 
> config variables. Keeping aside branch\repo terminology, for me all marvin 
> both framework and tests should be at one place and separate from main 
> product code.

The problem with tests being broken out from the main repo is that we
end up having a really hard time confirming that new features include
appropriate tests.  Plus, tests are tied to features, which are tied to
the code.  They should be versioned together.

As you said though, the framework is the framework...  that's a tool.
Frankly, with auto-discovery going forward, Marvin becomes no different
from any other testing framework software that has to be installed to do
useful things with the code in the main repo.  Ex: maven!

-chip

Re: Can't compile cloudstack 4.2 rpms from source

[Chip Childers]

On Thu, Oct 03, 2013 at 11:21:57AM +0200, benoit lair wrote:
> A precision, the linux centos 6.3 i used is a ghost of the centos 6.3
> environment i use for compiling apache cloudstack 4.0.0-incubating, which
> works very well, but not with cs 4.2.0

Are you able to build using maven (don't use the package.sh script, do
mvn clean install).

Re: Wiki access

[Chip Childers]

On Thu, Oct 03, 2013 at 09:58:03AM +, Bharat Kumar wrote:
> Hi All,
> any one please grant me the edit or add page permission to cwiki. my user 
> name is bharat.kumar

Done

Re: Review Request 14467: fix for Invalid SMTP breaks HA

[Chip Childers]

On Thu, Oct 03, 2013 at 11:31:50AM +, Anshul Gangwar wrote:
> Description
> ---
> 
> added the connection and socket timeout parameters for SMTP and sending 
> message in new thread so that HA doesn't get blocked beacause of hang in 
> sending email alert

Wouldn't a better approach be to ensure that email sending runs async to
critical operations like HA?

Re: Can't compile cloudstack 4.2 rpms from source

[benoit lair]

Hello Chip,

Yes i do. I've tried mvn clean install, and :

mvn
mvn clean install
mvn - P deps (as the install way of cs 4.0.0)
mvn clean install


I got always the same errors.


2013/10/3 Chip Childers 

> On Thu, Oct 03, 2013 at 11:21:57AM +0200, benoit lair wrote:
> > A precision, the linux centos 6.3 i used is a ghost of the centos 6.3
> > environment i use for compiling apache cloudstack 4.0.0-incubating, which
> > works very well, but not with cs 4.2.0
>
> Are you able to build using maven (don't use the package.sh script, do
> mvn clean install).
>

Re: [Proposal] Improve VR upgrades

[Chip Childers]

On Thu, Oct 03, 2013 at 11:47:57AM +, Kishan Kavala wrote:
> During CS upgrade, VRs are required to be upgraded to use newer systemVm 
> template . 
> The current VR upgrade procedure has following limitations:
>  - takes 'long' time and the time exponentially increases with the size of 
> the cloud
> - no way to sequence upgrade of different parts of the cloud, i.e., specific 
> clusters or pods or even zones
> - there is no way to determine when a particular customer's services (e.g. 
> VR) will be upgraded with the upgrade interval
> 
> Goals for this feature are to address the above issues
> 
> 1. Give admin control to sequence the upgrade of the cloud by:
>- Infrastructure hierarchy: by Cluster, Pod, and Zone etc.
>- Administrative hierarchy: by Tenant or Domain 
> 2. Minimize service interruption to users
> 3. Improve the speed of the upgrade time by making as many upgrade operations 
> in parallel as possible
> 
> I've created JIRA ticket:
> https://issues.apache.org/jira/browse/CLOUDSTACK-4793
> 
> thanks,
> Kishan
>

This proposal sounds great, but the devil will be in the implementation
details.  To do this as rolling, we'd need to ensure backward compat
with agent>MS communications, right?

-chip

Re: Can't compile cloudstack 4.2 rpms from source

[benoit lair]

In order to be sure that there weren't something wrong with my environment,
i've retried to create rpms for apache cloudstack 4.0.0 and it worked well.
I've deleted the cs 4.2.0 src dir, tar xvfz of the tarbal file of cs 4.2
sources, retried to launch package.sh, same error. Retried a mvn clean and
so a mvn -P deps as in the cs 4.0.0 docs, and i got the same error.

Thanks for your help.

Regards, Benoit


2013/10/3 benoit lair 

> Hello Chip,
>
> Yes i do. I've tried mvn clean install, and :
>
> mvn
> mvn clean install
> mvn - P deps (as the install way of cs 4.0.0)
> mvn clean install
>
>
> I got always the same errors.
>
>
> 2013/10/3 Chip Childers 
>
>> On Thu, Oct 03, 2013 at 11:21:57AM +0200, benoit lair wrote:
>> > A precision, the linux centos 6.3 i used is a ghost of the centos 6.3
>> > environment i use for compiling apache cloudstack 4.0.0-incubating,
>> which
>> > works very well, but not with cs 4.2.0
>>
>> Are you able to build using maven (don't use the package.sh script, do
>> mvn clean install).
>>
>
>

Re: Can't compile cloudstack 4.2 rpms from source

[Wei ZHOU]

mvn -P developer,systemvm clean install

Re: Can't compile cloudstack 4.2 rpms from source

[Chip Childers]

So the mvn build has the same issues as the RPM build?  I'm just
confirming what you are saying is the condition.

On Thu, Oct 03, 2013 at 05:20:19PM +0200, benoit lair wrote:
> Hello Chip,
> 
> Yes i do. I've tried mvn clean install, and :
> 
> mvn
> mvn clean install
> mvn - P deps (as the install way of cs 4.0.0)
> mvn clean install
> 
> 
> I got always the same errors.
> 
> 
> 2013/10/3 Chip Childers 
> 
> > On Thu, Oct 03, 2013 at 11:21:57AM +0200, benoit lair wrote:
> > > A precision, the linux centos 6.3 i used is a ghost of the centos 6.3
> > > environment i use for compiling apache cloudstack 4.0.0-incubating, which
> > > works very well, but not with cs 4.2.0
> >
> > Are you able to build using maven (don't use the package.sh script, do
> > mvn clean install).
> >

[URGENT] Mounting issues from KVM hosts to secondary storage

[Indra Pramana]

Dear all,

We face a major problem after upgrading to 4.2.0. Mounting from KVM hosts
to secondary storage seems to fail, every time a new VM instance is
created, it will use up the / (root) partition of the KVM hosts instead.

Here is the df result:


root@hv-kvm-02:/home/indra# df
Filesystem  1K-blocksUsed
Available Use% Mounted on
/dev/sda1 4195924
4195924 0 100% /
udev132053356   4
132053352   1% /dev
tmpfs52825052 440
52824612   1% /run
none 5120
0  5120   0% /run/lock
none132062620   0
132062620   0% /run/shm
cgroup  132062620   0
132062620   0% /sys/fs/cgroup
/dev/sda610650544 2500424
7609092  25% /home
10.237.11.31:/mnt/vol1/sec-storage2/template/tmpl/2/288   4195924
4195924 0 100% /mnt/5230667e-9c58-3ff6-983c-5fc2a72df669


The strange thing is that df shows that it seems to be mounted, but it's
actually not mounted. If you noticed, the total capacity of the mount point
is exactly the same as the capacity of the / (root) partition. By right it
should show 7 TB instead of just 4 GB.

This caused VM creation to be error due to out of disk space. This also
affect the KVM operations since the / (root) partition becomes full, and we
can only release the space after we reboot the KVM host.

Anyone experience this problem before? We are at loss on how to resolve the
problem.

Looking forward to your reply, thank you.

Cheers.

Re: CS 4.2.0 - Bug with ssvm - wrong capacity recognized

[benoit lair]

Okay, i deleted my secondary storage server from the ui.
Change the ip of my secondary storage server vm, switched to the good vlan
from xencenter
Declared the new secondary storage server from the UI
Seen that i do not configured the good xenserver storage traffic label, so
i got the storage traffic routed on a bad nic on the hypervisor (it's my
fault so, you can't throw the tomatoes)
Rebooted the ssvm vm from the UI, got a clear ssvm fresh install pointing
on the nfs server.
So ssh into the ssvm, seen that the nfs server is well mounted.
I just tried to upload a template, my template is uploading into my nfs
server into templates directory.


Thanks a lot Wei !


2013/10/3 benoit lair 

> Okay, i changed the ip of the secondary storage server into the ip range
> of the pod, it doesn't work better.
>
> I change now the network of the secondary storage server.
>
>
> 2013/10/3 benoit lair 
>
>> I thought i could have my secondary storage nfs server into the mgmt cidr
>> ? It were okay with a cs 4.0.0
>>
>> So i need to move my secondary storage nfs server to the 10.32.0.0 cidr ?
>>
>>
>> 2013/10/3 Wei ZHOU 
>>
>>> I guess the root cause could be that your nfs server ip is not in storage
>>> network.
>>>
>>
>>
>

[RESOLVED] Re: [URGENT] Unable to stop/start system VMs after upgrade to 4.2.0

[Indra Pramana]

Dear Venkata and all,

This has been resolved earlier. Realised that the KVM host (where the CPVM
is on) is on disconnected state. Problem was resolved after the problematic
KVM host was rebooted.

Thank you every one for your help.

Cheers.


On Thu, Oct 3, 2013 at 9:42 PM, Venkata SwamyBabu Budumuru <
venkataswamybabu.budum...@citrix.com> wrote:

> What is the hypervisor you are using?
>
> On 03/10/13 6:14 PM, "David Ortiz"  wrote:
>
> >If you manually change the vm status in the database would it let you
> >destroy it then?
> >
> >> Date: Thu, 3 Oct 2013 20:22:33 +0800
> >> Subject: Re: [URGENT] Unable to stop/start system VMs after upgrade to
> >>4.2.0
> >> From: in...@sg.or.id
> >> To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
> >>
> >> Dear all,
> >>
> >> I managed to fix the VRs issue by destroying the routers and restarting
> >>the
> >> networks associated to the routers.
> >>
> >> Only left is the CPVM, I am not able to stop/destroy it. Any advise?
> >>
> >> Looking forward to your reply, thank you.
> >>
> >> Cheers.
> >>
> >>
> >>
> >> On Thu, Oct 3, 2013 at 8:16 PM, Indra Pramana  wrote:
> >>
> >> > Dear all,
> >> >
> >> > I am now in the progress of upgrading my CloudStack from 4.1.1 to
> >>4.2.0.
> >> > Running cloudstack-sysvmadm can restart the SSVM, but failed to
> >>restart the
> >> > CPVM and all the VRs.
> >> >
> >> > 
> >> > [1] 3152
> >> > root@cs-mgmt-01:~/backup/20131003# tail -f sysvm.log
> >> > nohup: ignoring input
> >> > /usr/bin/cloudstack-sysvmadm: line 21: /etc/rc.d/init.d/functions: No
> >>such
> >> > file or directory
> >> >
> >> > Stopping and starting 1 secondary storage vm(s)...
> >> > Done stopping and starting secondary storage vm(s)
> >> >
> >> > Stopping and starting 1 console proxy vm(s)...
> >> > ERROR: Failed to stop console proxy vm with id 1980
> >> >
> >> > Done stopping and starting console proxy vm(s) .
> >> >
> >> > Stopping and starting 0 running routing vm(s)...
> >> > 
> >> >
> >> > SSVM seems OK, I have run health check script and everything is in
> >>order.
> >> >
> >> > VM state of CPVM is running, but state is disconnected. I can't stop
> >>or
> >> > destroy the CPVM.
> >> >
> >> > All the VRs are running now but I am not too sure if they are already
> >> > using the new 4.2 template or still using the old template, since it
> >>seems
> >> > the sysvmadm script was unable to detect the virtual routers.
> >> >
> >> > Anyone can help?
> >> >
> >> > Thank you.
> >> >
> >
>
>

Re: [MERGE] spring-modularization to master - Spring Modularization

[Darren Shepherd]

Sure can switch jenkins.buildacloud.org to build off of
spring-modularization?  It will at least fix the DB upgrade issues. I
really don't understand the whole test environment.  What tests are
ran where, how to get "BVT" running etc.

Darren

On Thu, Oct 3, 2013 at 7:58 AM, Chip Childers  wrote:
> On Wed, Oct 2, 2013 at 8:59 PM, Darren Shepherd > wrote:
>
>> It's actually really easy to turn this off.  If you look at the last
>> commit of the branch you'll see what changes to turn it on.  So you can
>> just reverse that one commit to disable it.
>>
>>  I'd rather merge this and then do the BVTs on master if possible.  I
>> really want to get this committed.  Every time somebody changes a spring
>> config file I have to keep making the corresponding changes.  It seems like
>> people are gearing up and developing stuff right now for 4.3.  So the
>> longer we wait the more headache it is for everyone.
>>
>> Again, if we find out this is a complete disaster, I can just flip some
>> config settings and were back to the old style.  I had to keep
>> compatibility with the old style as Awsapi and usage still use it.
>>
>> Darren
>>
>
>
> I get the desire, but *please* let's use BVT on this.  We, unfortunately,
> have a poor track record with changes like this breaking things in master.
>  I'm not saying this as a judgement / measurement of your branch, I'm
> making a general historical statement.  We really need to hold ourselves to
> the goal of keeping master stable through clear test results in feature
> branches prior to a merge.

Re: [MERGE] spring-modularization to master - Spring Modularization

[Darren Shepherd]

This should be fixed on the spring-modularization branch.

Darren

On Wed, Oct 2, 2013 at 10:05 PM, Prasanna Santhanam  wrote:
> I switched the test infrastructure on jenkins.buildacloud.org to run
> the bvts [1] against master last week. Couple of weeks before that the
> simulator [2] tests were switched to run against master. Both are
> broken unfortunately and the bvt and checkin tests aren't running.
>
> I've filed a bug here:
> https://issues.apache.org/jira//browse/CLOUDSTACK-4791
>
> [1] http://jenkins.buildacloud.org/view/cloudstack-qa/
> [2] http://jenkins.buildacloud.org/view/simulator/
>
> Anyone who has access to the jenkins can run the bvts on their desired
> branch. Simply login and change the test-yumrepo-refresh job to point
> to your branch. Build that to refresh the remote repository with the
> packages made from your branch. Then switch test-matrix to point to
> the same development branch and fire a build. That's about it.
>
> On Wed, Oct 02, 2013 at 05:42:54PM -0700, Darren Shepherd wrote:
>> Yes agreed.  I've extensively tested this, but that is never enough.
>> How do I get the BVTs ran against this.  Due to the cross cutting
>> nature of this I want to get this merged as fast as possible.
>>
>> Darren
>>
>> > On Oct 2, 2013, at 4:43 PM, Alex Huang  wrote:
>> >
>> > +1 on running the BVT on it.  We've been through this one once before.  
>> > Should be careful.
>> >
>> > --Alex
>> >
>> >> -Original Message-
>> >> From: Kelven Yang [mailto:kelven.y...@citrix.com]
>> >> Sent: Wednesday, October 2, 2013 4:39 PM
>> >> To: dev@cloudstack.apache.org
>> >> Subject: Re: [MERGE] spring-modularization to master - Spring
>> >> Modularization
>> >>
>> >> Darren,
>> >>
>> >> This looks really nice. A few questions on Spring AOP replacement.
>> >>
>> >> 1) Spring AOP is proxy-based, the reason we ended up of using customized
>> >> AOP is mainly due to that inside existing CloudStack codebase, we have 
>> >> many
>> >> places that are doing run-time type-casting, the code in these places
>> >> assumes a real object that implements all interfaces in the semantics 
>> >> context.
>> >> At the time when I initially converted to Spring, I couldn't ensure that
>> >> switching to proxy-based AOP can have 100% coverage for these run-time
>> >> cases. What is your approach to address this run-time type-casting issue?
>> >>
>> >> 2) We've run into a huge-memory footprint issue that may be caused by
>> >> conflicts of CGLIB usage in Spring AOP and the CGLIB usage in CloudStack 
>> >> Dao
>> >> layer. Do you have a chance to run a memory analysis in the heap after
>> >> management server is started.
>> >>
>> >> I might be good to run BVT test on the branch before the merge, could
>> >> someone initiate the effort?
>> >>
>> >> kelven
>> >>
>> >>
>> >>
>> >> On 10/2/13 3:48 PM, "Darren Shepherd" 
>> >> wrote:
>> >>
>> >>> Not sure how this works...  I would like to merge in the new
>> >>> modularized Spring setup to master. There is info on the wiki about it
>> >>> [1] [2] [3].  The primary change is to break apart the monolithic
>> >>> applicationContext.xml and componentContext.xml files such that each
>> >>> plugin can maintain and contribute its own configuration.
>> >>>
>> >>> In addition to breaking up the configuration we no longer use ACS
>> >>> custom AOP and it is now fully Spring AOP.
>> >>>
>> >>> Now adding/removing a plug-in is a matter of just adding a jar to the
>> >>> classpath (exception being commands.properties, I'll address that in a
>> >>> different thread).  Unfortunately this branch does not have the changes
>> >>> to package things in different RPMs.  So it would be great if somebody
>> >>> could take up the packaging effort to split out all the plugins into
>> >>> different RPMs.
>> >>>
>> >>> Darren
>> >>>
>> >>> [1]
>> >>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Modularize+Sp
>> >> rin
>> >>> g
>> >>> [2]
>> >>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Plug-
>> >> ins%2C+Modu
>> >>> les
>> >>> %2C+and+Extensions
>> >>> [3] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Extensions
>> >
>
> --
> Prasanna.,
>
> 
> Powered by BigRock.com
>

Re: Configuration table changes and database update

[Darren Shepherd]

I've done my best to test various DB upgrade scenarios and I believe
all this stuff should be fixed in the spring-modularization branch.  I
stated wrong before, the database upgrade stuff is in the system
context.  So the majority of ACS is in the "core" context which is
initialized after system.

Darren

On Thu, Oct 3, 2013 at 7:35 AM, Darren Shepherd
 wrote:
> Let me look at this today.  The spring changes I have will greatly improve 
> these initialization issues.  The current state of spring on master makes it 
> very difficult to deterministic ally initialize beans.  With the spring 
> changes I have in place the database upgrade stuff is in the bootstrap 
> context and will be initialized before everything else.
>
> You mentioned there's an issue with the database upgrade depending on a DAO.  
> I'll look into that and fix it today.  The fix will be on the 
> spring-modularization branch which I'd like to get merge ASAP.
>
> Darren
>
>> On Oct 3, 2013, at 2:08 AM, Hugo Trippaers  wrote:
>>
>> Heya guys,
>>
>> I'm still running into this problem. Our jenkins automagically installs and 
>> tests the latest packages based on master. With a clean database on clean 
>> machines.
>>
>> The error reported is similar to the error encountered:
>>
>> Caused by: com.cloud.utils.exception.CloudRuntimeException: DB Exception on: 
>> com.mysql.jdbc.JDBC4PreparedStatement@64726693: SELECT 
>> configuration.instance, configuration.component, configuration.name, 
>> configuration.value, configuration.default_value, configuration.description, 
>> configuration.category, configuration.is_dynamic, configuration.scope, 
>> configuration.updated FROM configuration WHERE configuration.name = 
>> _binary'storage.cache.replacement.lru.interval'  ORDER BY RAND() LIMIT 1
>>at 
>> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:421)
>>at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>at 
>> com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:356)
>>at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>at 
>> com.cloud.utils.db.GenericDaoBase.findOneIncludingRemovedBy(GenericDaoBase.java:869)
>>at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>at 
>> org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.findByName(ConfigurationDaoImpl.java:201)
>>at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>at 
>> org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.getValue(ConfigurationDaoImpl.java:166)
>>at 
>> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>>at 
>> org.apache.cloudstack.storage.cache.manager.StorageCacheReplacementAlgorithmLRU.initialize(StorageCacheReplacementAlgorithmLRU.java:63)
>>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>at 
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>at 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>at java.lang.reflect.Method.invoke(Method.java:616)
>>at 
>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:346)
>>at 
>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:299)
>>at 
>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:132)
>>... 79 more
>> Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: 
>> Unknown column 'configuration.default_value' in 'field list'
>>at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>>at 
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>>at 
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>>at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>>at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
>>at com.mysql.jdbc.Util.getInstance(Util.java:386)
>>at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1053)
>>at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4074)
>>at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4006)
>>at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2468)
>>at com.mys

Re: Can't compile cloudstack 4.2 rpms from source

[benoit lair]

Yes Chip,

Even if try to compile cs 4.2.0 with mvn -P deps or if i try to compile
with the package.sh script, i have the same errors.

here is the ouput generated with package.sh :

http://pastebin.com/TNegzXUX

Regards, Benoit Lair.


2013/10/3 Chip Childers 

> So the mvn build has the same issues as the RPM build?  I'm just
> confirming what you are saying is the condition.
>
> On Thu, Oct 03, 2013 at 05:20:19PM +0200, benoit lair wrote:
> > Hello Chip,
> >
> > Yes i do. I've tried mvn clean install, and :
> >
> > mvn
> > mvn clean install
> > mvn - P deps (as the install way of cs 4.0.0)
> > mvn clean install
> >
> >
> > I got always the same errors.
> >
> >
> > 2013/10/3 Chip Childers 
> >
> > > On Thu, Oct 03, 2013 at 11:21:57AM +0200, benoit lair wrote:
> > > > A precision, the linux centos 6.3 i used is a ghost of the centos 6.3
> > > > environment i use for compiling apache cloudstack 4.0.0-incubating,
> which
> > > > works very well, but not with cs 4.2.0
> > >
> > > Are you able to build using maven (don't use the package.sh script, do
> > > mvn clean install).
> > >
>

Re: A question on vm migrations when hosts are set into a maintenance mode.

[Koushik Das]

Alena,
I see that you had added this config setting. Any specific reason that this 
only for Start/Stop/Copy and not for all the commands as Alex mentioned? The 
name of the setting looks generic.

-Koushik

On 03-Oct-2013, at 8:10 PM, Alex Ough  wrote:

> Hi Koushik,
> 
> Thanks for your reply, but unfortunately, this setting does NOT cover
> 'MigrateCommand'.
> As you specified, it seems to be effective only in Start/Stop/CopyCommand.
> 
> So can we include 'MigrateCommand' in that setting?
> 
> Thanks
> Alex Ough
> 
> 
> On Wed, Oct 2, 2013 at 11:44 PM, Koushik Das  wrote:
> 
>> It is already a global setting in 4.2. The name of the setting is
>> "execute.in.sequence.hypervisor.commands".
>> 
>> Check out Config.java
>> 
>>ExecuteInSequence("Advanced", ManagementServer.class, Boolean.class,
>> "execute.in.sequence.hypervisor.commands", "true", "If set to true,
>> StartCommand, StopCommand, CopyCommand will be synchronized on the agent
>> side." +
>>" If set to false, these commands become asynchronous. Default value
>> is true.", null),
>> 
>> 
>> -Koushik
>> 
>> On 02-Oct-2013, at 10:43 PM, Alex Ough > alex.o...@sungard.com>> wrote:
>> 
>> Thanks for the reply, Marcus.
>> 
>> What about the option #3, which is to make it as a global setting?
>> I think it can prevent side effects if exist.
>> 
>> Alex Ough
>> 
>> 
>> On Wed, Oct 2, 2013 at 11:37 AM, Marcus Sorensen > >wrote:
>> 
>> Not sure. I don't know the history well enough to know if there were
>> issues in the past, it might be that some hypervisors were fine and
>> others weren't.
>> 
>> On Wed, Oct 2, 2013 at 9:21 AM, Alex Ough > alex.o...@sungard.com>> wrote:
>> Marcus/Kelven,
>> 
>> Any thoughts on my suggestions?
>> 
>> Thanks
>> Alex Ough
>> 
>> 
>> On Tue, Sep 24, 2013 at 12:09 PM, Alex Ough > alex.o...@sungard.com>>
>> wrote:
>> 
>> Oh, sorry for the confusion. I must have reversed the flags.
>> As Kelven pointed, it is set as 'TRUE', which makes the process as
>> sequential.
>> 
>> So my questions are
>> 1. If there is any reason why the method have been defined to return
>> 'TRUE' always?
>> 2. Do we expect any side effects and/or malfunctioning if we change it
>> to
>> returning 'FALSE'?
>> 3. For a resolution without breaking possible flows, can we add the
>> value
>> of 'executeInSequence' to the global setting if #2 answers YES?
>> 
>> 
>> On Tue, Sep 24, 2013 at 11:19 AM, Marcus Sorensen > >
>> wrote:
>> 
>> I thought executeInSequence of 'true' made it go serially, or
>> sequentially. In my codebase for 4.1,4.2,master it's been 'true' since
>> August of 2010:
>> 
>> 2010-08-11 09:13:29 -0700 19) public class MigrateCommand extends
>> Command
>> {
>> 2010-08-11 09:13:29 -0700 20) String vmName;
>> 2010-08-11 09:13:29 -0700 21) String destIp;
>> 2011-08-10 10:26:04 -0700 22) String hostGuid;
>> 2010-08-11 09:13:29 -0700 23) boolean isWindows;
>> 2010-08-11 09:13:29 -0700 24)
>> 2010-08-11 09:13:29 -0700 25)
>> 2010-08-11 09:13:29 -0700 26) protected MigrateCommand() {
>> 2010-08-11 09:13:29 -0700 27) }
>> 2012-12-03 22:06:41 -0800 28)
>> 2010-08-11 09:13:29 -0700 29) public MigrateCommand(String vmName,
>> String destIp, boolean isWindows)
>> 2010-08-11 09:13:29 -0700 30) this.vmName = vmName;
>> 2010-08-11 09:13:29 -0700 31) this.destIp = destIp;
>> 2010-08-11 09:13:29 -0700 32) this.isWindows = isWindows;
>> 2010-08-11 09:13:29 -0700 33) }
>> 2012-12-03 22:06:41 -0800 34)
>> 2010-08-11 09:13:29 -0700 35) public boolean isWindows() {
>> 2010-08-11 09:13:29 -0700 36) return isWindows;
>> 2010-08-11 09:13:29 -0700 37) }
>> 2012-12-03 22:06:41 -0800 38)
>> 2010-08-11 09:13:29 -0700 39) public String getDestinationIp() {
>> 2010-08-11 09:13:29 -0700 40) return destIp;
>> 2010-08-11 09:13:29 -0700 41) }
>> 2012-12-03 22:06:41 -0800 42)
>> 2010-08-11 09:13:29 -0700 43) public String getVmName() {
>> 2010-08-11 09:13:29 -0700 44) return vmName;
>> 2010-08-11 09:13:29 -0700 45) }
>> 2012-12-03 22:06:41 -0800 46)
>> 2011-08-10 10:26:04 -0700 47) public void setHostGuid(String guid)
>> {
>> 2011-08-10 10:26:04 -0700 48) this.hostGuid = guid;
>> 2011-08-10 10:26:04 -0700 49) }
>> 2012-12-03 22:06:41 -0800 50)
>> 2011-08-10 10:26:04 -0700 51) public String getHostGuid() {
>> 2011-08-10 10:26:04 -0700 52) return this.hostGuid;
>> 2011-08-10 10:26:04 -0700 53) }
>> 2010-08-11 09:13:29 -0700 54)
>> 2010-08-11 09:13:29 -0700 55) @Override
>> 2010-08-11 09:13:29 -0700 56) public boolean executeInSequence() {
>> 2010-08-11 09:13:29 -0700 57) return true;
>> 2010-08-11 09:13:29 -0700 58) }
>> 2010-08-11 09:13:29 -0700 59) }
>> 
>> On Tue, Sep 24, 2013 at 9:58 AM, Chip Childers
>> mailto:chip.child...@sungard.com>> wrote:
>> Hey Kelven - This topic was discussed briefly in the past [1].  Are
>> you
>> able to provide any thoughts on Al

Re: [URGENT] Mounting issues from KVM hosts to secondary storage

[Marcus Sorensen]

Are you using the release artifacts, or your own 4.2 build?

When you rebooted the host, did the problem go away or come back the
same? You may want to look at 'virsh pool-list' to see if libvirt is
mounting/registering the secondary storage.

Is this happening on multiple hosts, the same way? You may want to
look at /etc/mtab, if the system reports it's mounted, though it's
not, it might be in there. Look at /proc/mounts as well.

On Thu, Oct 3, 2013 at 9:53 AM, Indra Pramana  wrote:
> Dear all,
>
> We face a major problem after upgrading to 4.2.0. Mounting from KVM hosts
> to secondary storage seems to fail, every time a new VM instance is
> created, it will use up the / (root) partition of the KVM hosts instead.
>
> Here is the df result:
>
> 
> root@hv-kvm-02:/home/indra# df
> Filesystem  1K-blocksUsed
> Available Use% Mounted on
> /dev/sda1 4195924
> 4195924 0 100% /
> udev132053356   4
> 132053352   1% /dev
> tmpfs52825052 440
> 52824612   1% /run
> none 5120
> 0  5120   0% /run/lock
> none132062620   0
> 132062620   0% /run/shm
> cgroup  132062620   0
> 132062620   0% /sys/fs/cgroup
> /dev/sda610650544 2500424
> 7609092  25% /home
> 10.237.11.31:/mnt/vol1/sec-storage2/template/tmpl/2/288   4195924
> 4195924 0 100% /mnt/5230667e-9c58-3ff6-983c-5fc2a72df669
> 
>
> The strange thing is that df shows that it seems to be mounted, but it's
> actually not mounted. If you noticed, the total capacity of the mount point
> is exactly the same as the capacity of the / (root) partition. By right it
> should show 7 TB instead of just 4 GB.
>
> This caused VM creation to be error due to out of disk space. This also
> affect the KVM operations since the / (root) partition becomes full, and we
> can only release the space after we reboot the KVM host.
>
> Anyone experience this problem before? We are at loss on how to resolve the
> problem.
>
> Looking forward to your reply, thank you.
>
> Cheers.

Re: A question on vm migrations when hosts are set into a maintenance mode.

[Alena Prokharchyk]

On 10/3/13 9:25 AM, "Koushik Das"  wrote:

>Alena,
>I see that you had added this config setting. Any specific reason that
>this only for Start/Stop/Copy and not for all the commands as Alex
>mentioned? The name of the setting looks generic.

Because these are the commands for which hypervisors support parallel
execution for sure (tested by QA on Xen/KVM/VmWare).

As all our commands are generic, and not hypervisor specific, you have to
be very careful if decide to enable parallel execution for MigrateCommand
and test it on all the hypervisors CS supports.

-Alena.

>
>-Koushik
>
>On 03-Oct-2013, at 8:10 PM, Alex Ough  wrote:
>
>> Hi Koushik,
>> 
>> Thanks for your reply, but unfortunately, this setting does NOT cover
>> 'MigrateCommand'.
>> As you specified, it seems to be effective only in
>>Start/Stop/CopyCommand.
>> 
>> So can we include 'MigrateCommand' in that setting?
>> 
>> Thanks
>> Alex Ough
>> 
>> 
>> On Wed, Oct 2, 2013 at 11:44 PM, Koushik Das 
>>wrote:
>> 
>>> It is already a global setting in 4.2. The name of the setting is
>>> "execute.in.sequence.hypervisor.commands".
>>> 
>>> Check out Config.java
>>> 
>>>ExecuteInSequence("Advanced", ManagementServer.class, Boolean.class,
>>> "execute.in.sequence.hypervisor.commands", "true", "If set to true,
>>> StartCommand, StopCommand, CopyCommand will be synchronized on the
>>>agent
>>> side." +
>>>" If set to false, these commands become asynchronous. Default value
>>> is true.", null),
>>> 
>>> 
>>> -Koushik
>>> 
>>> On 02-Oct-2013, at 10:43 PM, Alex Ough >> alex.o...@sungard.com>> wrote:
>>> 
>>> Thanks for the reply, Marcus.
>>> 
>>> What about the option #3, which is to make it as a global setting?
>>> I think it can prevent side effects if exist.
>>> 
>>> Alex Ough
>>> 
>>> 
>>> On Wed, Oct 2, 2013 at 11:37 AM, Marcus Sorensen >> >wrote:
>>> 
>>> Not sure. I don't know the history well enough to know if there were
>>> issues in the past, it might be that some hypervisors were fine and
>>> others weren't.
>>> 
>>> On Wed, Oct 2, 2013 at 9:21 AM, Alex Ough
> alex.o...@sungard.com>> wrote:
>>> Marcus/Kelven,
>>> 
>>> Any thoughts on my suggestions?
>>> 
>>> Thanks
>>> Alex Ough
>>> 
>>> 
>>> On Tue, Sep 24, 2013 at 12:09 PM, Alex Ough
> alex.o...@sungard.com>>
>>> wrote:
>>> 
>>> Oh, sorry for the confusion. I must have reversed the flags.
>>> As Kelven pointed, it is set as 'TRUE', which makes the process as
>>> sequential.
>>> 
>>> So my questions are
>>> 1. If there is any reason why the method have been defined to return
>>> 'TRUE' always?
>>> 2. Do we expect any side effects and/or malfunctioning if we change it
>>> to
>>> returning 'FALSE'?
>>> 3. For a resolution without breaking possible flows, can we add the
>>> value
>>> of 'executeInSequence' to the global setting if #2 answers YES?
>>> 
>>> 
>>> On Tue, Sep 24, 2013 at 11:19 AM, Marcus Sorensen >> >
>>> wrote:
>>> 
>>> I thought executeInSequence of 'true' made it go serially, or
>>> sequentially. In my codebase for 4.1,4.2,master it's been 'true' since
>>> August of 2010:
>>> 
>>> 2010-08-11 09:13:29 -0700 19) public class MigrateCommand extends
>>> Command
>>> {
>>> 2010-08-11 09:13:29 -0700 20) String vmName;
>>> 2010-08-11 09:13:29 -0700 21) String destIp;
>>> 2011-08-10 10:26:04 -0700 22) String hostGuid;
>>> 2010-08-11 09:13:29 -0700 23) boolean isWindows;
>>> 2010-08-11 09:13:29 -0700 24)
>>> 2010-08-11 09:13:29 -0700 25)
>>> 2010-08-11 09:13:29 -0700 26) protected MigrateCommand() {
>>> 2010-08-11 09:13:29 -0700 27) }
>>> 2012-12-03 22:06:41 -0800 28)
>>> 2010-08-11 09:13:29 -0700 29) public MigrateCommand(String vmName,
>>> String destIp, boolean isWindows)
>>> 2010-08-11 09:13:29 -0700 30) this.vmName = vmName;
>>> 2010-08-11 09:13:29 -0700 31) this.destIp = destIp;
>>> 2010-08-11 09:13:29 -0700 32) this.isWindows = isWindows;
>>> 2010-08-11 09:13:29 -0700 33) }
>>> 2012-12-03 22:06:41 -0800 34)
>>> 2010-08-11 09:13:29 -0700 35) public boolean isWindows() {
>>> 2010-08-11 09:13:29 -0700 36) return isWindows;
>>> 2010-08-11 09:13:29 -0700 37) }
>>> 2012-12-03 22:06:41 -0800 38)
>>> 2010-08-11 09:13:29 -0700 39) public String getDestinationIp() {
>>> 2010-08-11 09:13:29 -0700 40) return destIp;
>>> 2010-08-11 09:13:29 -0700 41) }
>>> 2012-12-03 22:06:41 -0800 42)
>>> 2010-08-11 09:13:29 -0700 43) public String getVmName() {
>>> 2010-08-11 09:13:29 -0700 44) return vmName;
>>> 2010-08-11 09:13:29 -0700 45) }
>>> 2012-12-03 22:06:41 -0800 46)
>>> 2011-08-10 10:26:04 -0700 47) public void setHostGuid(String guid)
>>> {
>>> 2011-08-10 10:26:04 -0700 48) this.hostGuid = guid;
>>> 2011-08-10 10:26:04 -0700 49) }
>>> 2012-12-03 22:06:41 -0800 50)
>>> 2011-08-10 10:26:04 -0700 51) public String getHostGuid() {
>>> 2011-08-10 10:26:04 -0700 52) return this.hostGuid;
>>> 2011-08-10 10:2

Re: Can't compile cloudstack 4.2 rpms from source

[benoit lair]

Hi Wei,

What is the result expected with "mvn -P developer" ?

It will intent to give me rpms usable for a production environment ?

Thanks for your reponse.

Regards, Benoit.


2013/10/3 Wei ZHOU 

> mvn -P developer,systemvm clean install
>

Re: A question on vm migrations when hosts are set into a maintenance mode.

[Alex Ough]

I'm not sure what else commands 'MigrateCommand' actually execute in
addition to 'Start/Stop/CopyCommand', but can we include 'MigrateCommand'
if it consists of only those 3 commands?

Thanks
Alex Ough


On Thu, Oct 3, 2013 at 11:31 AM, Alena Prokharchyk <
alena.prokharc...@citrix.com> wrote:

> On 10/3/13 9:25 AM, "Koushik Das"  wrote:
>
> >Alena,
> >I see that you had added this config setting. Any specific reason that
> >this only for Start/Stop/Copy and not for all the commands as Alex
> >mentioned? The name of the setting looks generic.
>
> Because these are the commands for which hypervisors support parallel
> execution for sure (tested by QA on Xen/KVM/VmWare).
>
> As all our commands are generic, and not hypervisor specific, you have to
> be very careful if decide to enable parallel execution for MigrateCommand
> and test it on all the hypervisors CS supports.
>
> -Alena.
>
> >
> >-Koushik
> >
> >On 03-Oct-2013, at 8:10 PM, Alex Ough  wrote:
> >
> >> Hi Koushik,
> >>
> >> Thanks for your reply, but unfortunately, this setting does NOT cover
> >> 'MigrateCommand'.
> >> As you specified, it seems to be effective only in
> >>Start/Stop/CopyCommand.
> >>
> >> So can we include 'MigrateCommand' in that setting?
> >>
> >> Thanks
> >> Alex Ough
> >>
> >>
> >> On Wed, Oct 2, 2013 at 11:44 PM, Koushik Das 
> >>wrote:
> >>
> >>> It is already a global setting in 4.2. The name of the setting is
> >>> "execute.in.sequence.hypervisor.commands".
> >>>
> >>> Check out Config.java
> >>>
> >>>ExecuteInSequence("Advanced", ManagementServer.class, Boolean.class,
> >>> "execute.in.sequence.hypervisor.commands", "true", "If set to true,
> >>> StartCommand, StopCommand, CopyCommand will be synchronized on the
> >>>agent
> >>> side." +
> >>>" If set to false, these commands become asynchronous. Default value
> >>> is true.", null),
> >>>
> >>>
> >>> -Koushik
> >>>
> >>> On 02-Oct-2013, at 10:43 PM, Alex Ough  >>> alex.o...@sungard.com>> wrote:
> >>>
> >>> Thanks for the reply, Marcus.
> >>>
> >>> What about the option #3, which is to make it as a global setting?
> >>> I think it can prevent side effects if exist.
> >>>
> >>> Alex Ough
> >>>
> >>>
> >>> On Wed, Oct 2, 2013 at 11:37 AM, Marcus Sorensen  >>> >wrote:
> >>>
> >>> Not sure. I don't know the history well enough to know if there were
> >>> issues in the past, it might be that some hypervisors were fine and
> >>> others weren't.
> >>>
> >>> On Wed, Oct 2, 2013 at 9:21 AM, Alex Ough
> >>> >>> alex.o...@sungard.com>> wrote:
> >>> Marcus/Kelven,
> >>>
> >>> Any thoughts on my suggestions?
> >>>
> >>> Thanks
> >>> Alex Ough
> >>>
> >>>
> >>> On Tue, Sep 24, 2013 at 12:09 PM, Alex Ough
> >>> >>> alex.o...@sungard.com>>
> >>> wrote:
> >>>
> >>> Oh, sorry for the confusion. I must have reversed the flags.
> >>> As Kelven pointed, it is set as 'TRUE', which makes the process as
> >>> sequential.
> >>>
> >>> So my questions are
> >>> 1. If there is any reason why the method have been defined to return
> >>> 'TRUE' always?
> >>> 2. Do we expect any side effects and/or malfunctioning if we change it
> >>> to
> >>> returning 'FALSE'?
> >>> 3. For a resolution without breaking possible flows, can we add the
> >>> value
> >>> of 'executeInSequence' to the global setting if #2 answers YES?
> >>>
> >>>
> >>> On Tue, Sep 24, 2013 at 11:19 AM, Marcus Sorensen  >>> >
> >>> wrote:
> >>>
> >>> I thought executeInSequence of 'true' made it go serially, or
> >>> sequentially. In my codebase for 4.1,4.2,master it's been 'true' since
> >>> August of 2010:
> >>>
> >>> 2010-08-11 09:13:29 -0700 19) public class MigrateCommand extends
> >>> Command
> >>> {
> >>> 2010-08-11 09:13:29 -0700 20) String vmName;
> >>> 2010-08-11 09:13:29 -0700 21) String destIp;
> >>> 2011-08-10 10:26:04 -0700 22) String hostGuid;
> >>> 2010-08-11 09:13:29 -0700 23) boolean isWindows;
> >>> 2010-08-11 09:13:29 -0700 24)
> >>> 2010-08-11 09:13:29 -0700 25)
> >>> 2010-08-11 09:13:29 -0700 26) protected MigrateCommand() {
> >>> 2010-08-11 09:13:29 -0700 27) }
> >>> 2012-12-03 22:06:41 -0800 28)
> >>> 2010-08-11 09:13:29 -0700 29) public MigrateCommand(String vmName,
> >>> String destIp, boolean isWindows)
> >>> 2010-08-11 09:13:29 -0700 30) this.vmName = vmName;
> >>> 2010-08-11 09:13:29 -0700 31) this.destIp = destIp;
> >>> 2010-08-11 09:13:29 -0700 32) this.isWindows = isWindows;
> >>> 2010-08-11 09:13:29 -0700 33) }
> >>> 2012-12-03 22:06:41 -0800 34)
> >>> 2010-08-11 09:13:29 -0700 35) public boolean isWindows() {
> >>> 2010-08-11 09:13:29 -0700 36) return isWindows;
> >>> 2010-08-11 09:13:29 -0700 37) }
> >>> 2012-12-03 22:06:41 -0800 38)
> >>> 2010-08-11 09:13:29 -0700 39) public String getDestinationIp() {
> >>> 2010-08-11 09:13:29 -0700 40) return destIp;
> >>> 2010-08-11 09:13:29 -0700 41) }
> >>> 2012-12-03 22:06:41 -0800 42)
> >>> 2010-08-11 09:13:29 -0700

Re: unable to get tiny linux template in ready state, DOWNLOAD ERROR

[Min Chen]

Punith,

Your log shows that your ssvm cannot connect back to MS. As Wei
mentioned, your host configuration may not be correct, and need to be
changed to correct Ip. Do you see an entry in your db host table with type
SecondaryStorageVM?

Thanks
-min

On 10/3/13 7:36 AM, "Wei ZHOU"  wrote:

>It is normal.
>You can get more information in vmops.log

Re: [DISCUSS] Leaky abstractions [was review requests 13238, 13896, 14320]

[Daan Hoogland]

Murali,

What our admins need is the ability to instantiate an abstract thing called
a virtual redundant high available router. They need be able to tune it
with all sorts of features is such a way that other routers redundant or
not and high availible or not, may but do not have to have the same tuning
parameters. This 'feature' of httpClose is just one of the many things they
need to be able to tune. Others include a more fine grained control over
the iptables/firewall rules and monitoring of the functionality/daemons
running on the machines. I am not biased as to the way how to do/implement
this control. The networkoffering seemed like the way to do it.

Having said that I didn't think that httpClose would be considered haproxy
specific. It seems worrying that someone could device a proxy or a
loadbalancer that does not support either one of the features of
maximizing - or pooling connections. I'm not into that market recently so I
might be mistaking. This maybe besides the point but it discomforts me
somewhat.

regards,
Daan


On Thu, Oct 3, 2013 at 2:22 PM, murali reddy wrote:

> On Thu, Oct 3, 2013 at 4:18 PM, Daan Hoogland  >wrote:
>
> > Chiradeep,
> >
> > I have been thinking about your concern and there is something bothering
> me
> > about it. The issue CLOUDSTACK-4328 of which
> > https://reviews.apache.org/r/14320/ is an implementation. This issue has
> > been brought up by the engineers at Schuberg Philis. These are cloud
> > operators and domain admins. So these are the people that need to be
> > bothered by this tuning and they are certainly haproxy and xen experts to
> > an extend. For them not being able to use connection caching was a bug.
> And
> > the proposed solution still seems reasonable to me. It is exposing the
> > abstract feature only to those instantiating a vpc, isn't it? This last
> > question probably touches on the reason you are addressing my submission
> > together with the ones from Nicolas  I see only people instantiating a
> vpc
> > having to be bothered by which netoffering to use (with respect to
> > httpClose functionality) If this is not the case how should I isolate
> this
> > concern from other , more mondain users?
> >
> > btw I did not create an FS page as the issue was created as a jira
> ticket.
> > I am willing to do that in hind sight but want to have a path to follow
> > first.
> >
> > regards,
> > Daan
> >
> > On Tue, Oct 1, 2013 at 11:06 PM, Chiradeep Vittal <
> > chiradeep.vit...@citrix.com> wrote:
> > >
> > > We have a couple of people trying to expose the advanced capabilities
> of
> > the underlying physical resources to the end-user. In the case of Nicolas
> > FOATA, he is trying to expose some of the advanced functions of
> > XenServer/XCP, and in the case of Daan, he is trying to expose some
> feature
> > of HAProxy.
> > >
> > > Users are ideally abstracted from these details and shouldn't have to
> > wonder which offering to choose [because they are not Xen/HAProxy
> experts].
> > > After all one of the goals of CS is to hide these messy details and let
> > users focus on their apps.
> > >
> > > Is there a possibility of a generic way of leaking abstractions for
> > sufficiently advanced users?
> > >
> >
>
> Generally as a principle core API's abstract and expose functionality that
> is commonly available across the hypervisors and network service providers
> etc.. I believe we should continue to enforce it.
>
> But we do have a pattern of API's configure* (configurevirtualrouter,
> configurenetscaler etc) where a hypervisor/network element plug-in can let
> admin to configure params specific to plug-in. Perhaps we can use this
> API's fine tune a plugin for advanced configurations. For e.g both HaProxy
> max connections, httpModeEnabled can be parameters that can be configured
> with configureVirtualRouter api.
>
> Daan,
>
> does this approach works for you?
>
> -Murali
>
>
> > > https://reviews.apache.org/r/13238/
> > > https://reviews.apache.org/r/14320/
> > > https://reviews.apache.org/r/13896/
> > >
> > > BTW, I really prefer that these changes are discussed by putting up an
> FS
> > on the wiki rather than submitting patch requests.
> > > If it touches more than a few files, it is probably worth discussing
> with
> > a [DISCUSS] tag line.
> > > Also, it requires tests.
> > >
> > >
> > >
> >
>

Re: Can't compile cloudstack 4.2 rpms from source

[Chip Childers]

On Thu, Oct 03, 2013 at 06:24:57PM +0200, benoit lair wrote:
> Hi Wei,
> 
> What is the result expected with "mvn -P developer" ?
> 
> It will intent to give me rpms usable for a production environment ?

No, it's intended to test that maven builds are functional for you.

If you just want the RPMs, have you considered pulling them down from
our repo?

http://cloudstack.apt-get.eu/rhel/4.2/

> 
> Thanks for your reponse.
> 
> Regards, Benoit.
> 
> 
> 2013/10/3 Wei ZHOU 
> 
> > mvn -P developer,systemvm clean install
> >

Re: [PROPOSAL] Revert to VM disk Snapshot

[Daan Hoogland]

go go go


On Wed, Oct 2, 2013 at 5:07 PM, David Ortiz  wrote:

> This sounds like a great idea.
>
> > From: chiradeep.vit...@citrix.com
> > To: dev@cloudstack.apache.org
> > Subject: Re: [PROPOSAL] Revert to VM disk Snapshot
> > Date: Mon, 30 Sep 2013 21:53:35 +
> >
> > +1.
> >
> > On 9/30/13 2:31 PM, "SuichII, Christopher" 
> wrote:
> >
> > >The storage subsystem API currently has an interface for takeSnapshot()
> > >and an associated externally facing API for takeSnapshot. There is also
> a
> > >method on the primary data store interface for revertSnapshot().
> However,
> > >this method is unused. We would like this storage subsystem interface
> > >method be hooked up to an externally facing API so that we can provide
> > >true VM disk backup and recovery.
> > >
> > >I will work on formalizing a full functional spec but wanted to get this
> > >up for discussion ASAP.
> > >
> > >I have created a JIRA ticket:
> > >https://issues.apache.org/jira/browse/CLOUDSTACK-4771
> > >
> > >Thanks,
> > >Chris
> > >--
> > >Chris Suich
> > >chris.su...@netapp.com
> > >NetApp Software Engineer
> > >Data Center Platforms ­ Cloud Solutions
> > >Citrix, Cisco & Red Hat
> > >
> >
>
>

Re: Wiki access

[Ian Duffy]

Hi,

May I get access to edit/add pages as well?
My username is imduffy15.

Thanks,
Ian

On 3 October 2013 16:13, Chip Childers  wrote:
> On Thu, Oct 03, 2013 at 09:58:03AM +, Bharat Kumar wrote:
>> Hi All,
>> any one please grant me the edit or add page permission to cwiki. my 
>> user name is bharat.kumar
>
> Done

RE: [DISCUSS] Breaking out Marvin from CloudStack

[Santhosh Edukulla]

>The problem with tests being broken out from the main repo is that we
end up having a really hard time confirming that new features include
appropriate tests.  Plus, tests are tied to features, which are tied to
the code.  They should be versioned together.

I believe this makes more sense for unit tests though, where tests need to be 
there with the code and both go hand in hand with release. 

As mentioned earlier, keeping or separating automation code\tests with the main 
product will not make much of an impact as a whole. 

Regards,
Santhosh

From: Chip Childers [chip.child...@sungard.com]
Sent: Thursday, October 03, 2013 11:07 AM
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] Breaking out Marvin from CloudStack

On Thu, Oct 03, 2013 at 05:55:14AM +, Santhosh Edukulla wrote:
> I believe both can exist independently. The framework should have more 
> flexibility and facilitation to run features\test cases based upon a  given 
> release and version on a given test bed. It should be intelligent enough to 
> run those cases  and only those cases pertaining to that release with few 
> config variables. Keeping aside branch\repo terminology, for me all marvin 
> both framework and tests should be at one place and separate from main 
> product code.

The problem with tests being broken out from the main repo is that we
end up having a really hard time confirming that new features include
appropriate tests.  Plus, tests are tied to features, which are tied to
the code.  They should be versioned together.

As you said though, the framework is the framework...  that's a tool.
Frankly, with auto-discovery going forward, Marvin becomes no different
from any other testing framework software that has to be installed to do
useful things with the code in the main repo.  Ex: maven!

-chip

Re: Wiki access

[Daan Hoogland]

I'm not seeing any links for editting permissions either. id == dahn


On Thu, Oct 3, 2013 at 7:26 PM, Ian Duffy  wrote:

> Hi,
>
> May I get access to edit/add pages as well?
> My username is imduffy15.
>
> Thanks,
> Ian
>
> On 3 October 2013 16:13, Chip Childers  wrote:
> > On Thu, Oct 03, 2013 at 09:58:03AM +, Bharat Kumar wrote:
> >> Hi All,
> >> any one please grant me the edit or add page permission to cwiki.
> my user name is bharat.kumar
> >
> > Done
>

Re: Can't compile cloudstack 4.2 rpms from source

[Wei ZHOU]

I downloaded and built cloudstack 4.2.0 source code just now. It is ok.



[INFO]

[INFO] Building Apache CloudStack Plugin - Hypervisor Xen 4.2.0
[INFO]

[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @
cloud-plugin-hypervisor-xen ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @
cloud-plugin-hypervisor-xen ---
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @
cloud-plugin-hypervisor-xen ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/root/apache-cloudstack-4.2.0-src/plugins/hypervisors/xen/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @
cloud-plugin-hypervisor-xen ---
[INFO] Compiling 19 source files to
/root/apache-cloudstack-4.2.0-src/plugins/hypervisors/xen/target/classes
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources)
@ cloud-plugin-hypervisor-xen ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/root/apache-cloudstack-4.2.0-src/plugins/hypervisors/xen/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @
cloud-plugin-hypervisor-xen ---
[INFO] Compiling 1 source file to
/root/apache-cloudstack-4.2.0-src/plugins/hypervisors/xen/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @
cloud-plugin-hypervisor-xen ---
[INFO] Surefire report directory:
/root/apache-cloudstack-4.2.0-src/plugins/hypervisors/xen/target/surefire-reports
---
 T E S T S
---
Running com.cloud.hypervisor.xen.resource.CitrixResourceBaseTest
log4j:WARN No appenders could be found for logger
(com.cloud.hypervisor.xen.resource.XenServerConnectionPool).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
more info.
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.174 sec
Results :
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @
cloud-plugin-hypervisor-xen ---
[INFO] Building jar:
/root/apache-cloudstack-4.2.0-src/plugins/hypervisors/xen/target/cloud-plugin-hypervisor-xen-4.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.1:attach-descriptor (attach-descriptor) @
cloud-plugin-hypervisor-xen ---
[INFO]
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @
cloud-plugin-hypervisor-xen ---
[INFO] Installing
/root/apache-cloudstack-4.2.0-src/plugins/hypervisors/xen/target/cloud-plugin-hypervisor-xen-4.2.0.jar
to
/root/.m2/repository/org/apache/cloudstack/cloud-plugin-hypervisor-xen/4.2.0/cloud-plugin-hypervisor-xen-4.2.0.jar
[INFO] Installing
/root/apache-cloudstack-4.2.0-src/plugins/hypervisors/xen/pom.xml to
/root/.m2/repository/org/apache/cloudstack/cloud-plugin-hypervisor-xen/4.2.0/cloud-plugin-hypervisor-xen-4.2.0.pom
[INFO]


2013/10/3 benoit lair 

> Hi Wei,
>
> What is the result expected with "mvn -P developer" ?
>
> It will intent to give me rpms usable for a production environment ?
>
> Thanks for your reponse.
>
> Regards, Benoit.
>
>
> 2013/10/3 Wei ZHOU 
>
> > mvn -P developer,systemvm clean install
> >
>

Re: [URGENT] Mounting issues from KVM hosts to secondary storage

[Indra Pramana]

Hi Marcus,

Good day to you, and thank you for your e-mail. See my reply inline.

On Fri, Oct 4, 2013 at 12:29 AM, Marcus Sorensen wrote:

> Are you using the release artifacts, or your own 4.2 build?
>

[Indra:] We are using the release artifacts from below repo since we are
using Ubuntu:

deb http://cloudstack.apt-get.eu/ubuntu precise 4.2


> When you rebooted the host, did the problem go away or come back the
> same?


[Indra:] When I rebooted the host, the problem go away for a while, but it
will come back again after some time. It will come randomly at the time
when we need to create a new instance on that host, or start an existing
stopped instance.


> You may want to look at 'virsh pool-list' to see if libvirt is
> mounting/registering the secondary storage.
>

[Indra:] This is the result of the virsh pool-list command:

root@hv-kvm-02:/var/log/libvirt# virsh pool-list
Name State  Autostart
-
301071ac-4c1d-4eac-855b-124126da0a38 active no
5230667e-9c58-3ff6-983c-5fc2a72df669 active no
d433809b-01ea-3947-ba0f-48077244e4d6 active no

Strange thing is that none of my secondary storage IDs are there. Could it
be that the ID might have changed during Cloudstack upgrade? Here is the
list of my secondary storage (there are two of them) even though they are
on the same NFS server:
c02da448-b9f4-401b-b8d5-83e8ead5cfdenfs://10.237.11.31/mnt/vol1/sec-storage
NFS 5937edb6-2e95-4ae2-907b-80fe4599ed87nfs://
10.237.11.31/mnt/vol1/sec-storage2NFS

> Is this happening on multiple hosts, the same way?


[Indra:] Yes, it is happening on all the two hosts that I have, the same
way.


> You may want to
> look at /etc/mtab, if the system reports it's mounted, though it's
> not, it might be in there. Look at /proc/mounts as well.
>

[Indra:] Please find result of df, /etc/mtab and /proc/mounts below. The
"ghost" mount point is on df and /etc/mtab, but not on /proc/mounts.

root@hv-kvm-02:/etc# df
Filesystem  1K-blocksUsed
Available Use% Mounted on
/dev/sda1 4195924
4192372 0 100% /
udev132053356   4
132053352   1% /dev
tmpfs52825052 704
52824348   1% /run
none 5120
0  5120   0% /run/lock
none132062620   0
132062620   0% /run/shm
cgroup  132062620   0
132062620   0% /sys/fs/cgroup
/dev/sda610650544 2500460
7609056  25% /home
10.237.11.31:/mnt/vol1/sec-storage2/template/tmpl/2/288   4195924
4192372 0 100% /mnt/5230667e-9c58-3ff6-983c-5fc2a72df669

root@hv-kvm-02:/etc# cat /etc/mtab
/dev/sda1 / ext4 rw,errors=remount-ro 0 0
proc /proc proc rw,noexec,nosuid,nodev 0 0
sysfs /sys sysfs rw,noexec,nosuid,nodev 0 0
none /sys/fs/fuse/connections fusectl rw 0 0
none /sys/kernel/debug debugfs rw 0 0
none /sys/kernel/security securityfs rw 0 0
udev /dev devtmpfs rw,mode=0755 0 0
devpts /dev/pts devpts rw,noexec,nosuid,gid=5,mode=0620 0 0
tmpfs /run tmpfs rw,noexec,nosuid,size=10%,mode=0755 0 0
none /run/lock tmpfs rw,noexec,nosuid,nodev,size=5242880 0 0
none /run/shm tmpfs rw,nosuid,nodev 0 0
cgroup /sys/fs/cgroup tmpfs rw,relatime,mode=755 0 0
cgroup /sys/fs/cgroup/cpuset cgroup rw,relatime,cpuset 0 0
cgroup /sys/fs/cgroup/cpu cgroup rw,relatime,cpu 0 0
cgroup /sys/fs/cgroup/cpuacct cgroup rw,relatime,cpuacct 0 0
cgroup /sys/fs/cgroup/memory cgroup rw,relatime,memory 0 0
cgroup /sys/fs/cgroup/devices cgroup rw,relatime,devices 0 0
cgroup /sys/fs/cgroup/freezer cgroup rw,relatime,freezer 0 0
cgroup /sys/fs/cgroup/blkio cgroup rw,relatime,blkio 0 0
cgroup /sys/fs/cgroup/perf_event cgroup rw,relatime,perf_event 0 0
/dev/sda6 /home ext4 rw 0 0
rpc_pipefs /run/rpc_pipefs rpc_pipefs rw 0 0
binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,noexec,nosuid,nodev 0 0
10.237.11.31:/mnt/vol1/sec-storage2/template/tmpl/2/288
/mnt/5230667e-9c58-3ff6-983c-5fc2a72df669 nfs rw,addr=10.237.11.31 0 0

rootfs / rootfs rw 0 0
sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
udev /dev devtmpfs rw,relatime,size=132053356k,nr_inodes=33013339,mode=755
0 0
devpts /dev/pts devpts
rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /run tmpfs rw,nosuid,relatime,size=52825052k,mode=755 0 0
/dev/disk/by-uuid/d21f4676-075d-44be-a378-92ef6aaf2496 / ext4
rw,relatime,errors=remount-ro,data=ordered 0 0
none /sys/fs/fuse/connections fusectl rw,relatime 0 0
none /sys/kernel/debug debugfs rw,relatime 0 0
cgroup /sys/fs/cgroup tmpfs rw,relatime,mode=755 0 0
none /sys/kernel/security securityfs rw,relatime 0 0
none /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0
none /run/shm tmpfs rw,n

Re: A question on vm migrations when hosts are set into a maintenance mode.

[Chip Childers]

On Thu, Oct 03, 2013 at 11:44:46AM -0500, Alex Ough wrote:
> I'm not sure what else commands 'MigrateCommand' actually execute in
> addition to 'Start/Stop/CopyCommand', but can we include 'MigrateCommand'
> if it consists of only those 3 commands?
> 
> Thanks
> Alex Ough

In the case of VMware, the migrate command is executed via the
MigrateVMTask that's part of the VMware SDK (see
vmware-base/src/com/cloud/hypervisor/vmware/mo/VirtualMachineMO.java).

For VMware, I know that vCenter will queue and process concurrent
requests for migrations.  Specifically, it will throttle the migrations
happening, based on it's internal concurrency constraints, but the task
queue will still accept more connections.  Obviously the risk are the
VMware layer tasks timing out if it takes too long for the task queue to
complete.

As for XenServer, it's happening in what appears to be a similar way
(although the source host is the target for the migration API call).

Check
plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java.

I'm not familiar enough with XenServer's concurrency model for
migrations.  Any experts know the answer to if it can handle concurrency
in a stable way?

With KVM, it's obviously executing via the agent.  Similarly to
XenServer, I'm not familiar enough to know about concurrent operations.

So do the HV experts on the list have any opinions about XenServer and
KVM migration concurrency?

-chip

Re: [URGENT] Mounting issues from KVM hosts to secondary storage

[Indra Pramana]

Hi Dean,

Good day to you, and thank you for your e-mail.

The current setting (value) of storage.overprovisioning.factor is 2. Do you
think it matters? I can't remember whether the value was the default value,
or is it something that we changed earlier. Do you think changing this to 1
will help?

Looking forward to your reply, thank you.

Cheers.



On Fri, Oct 4, 2013 at 12:24 AM, Dean Kamali  wrote:

> have you looked at storage over-provisioning settings ??
>
>
> On Thu, Oct 3, 2013 at 11:53 AM, Indra Pramana  wrote:
>
> > Dear all,
> >
> > We face a major problem after upgrading to 4.2.0. Mounting from KVM hosts
> > to secondary storage seems to fail, every time a new VM instance is
> > created, it will use up the / (root) partition of the KVM hosts instead.
> >
> > Here is the df result:
> >
> > 
> > root@hv-kvm-02:/home/indra# df
> > Filesystem  1K-blocksUsed
> > Available Use% Mounted on
> > /dev/sda1 4195924
> > 4195924 0 100% /
> > udev132053356   4
> > 132053352   1% /dev
> > tmpfs52825052 440
> > 52824612   1% /run
> > none 5120
> > 0  5120   0% /run/lock
> > none132062620   0
> > 132062620   0% /run/shm
> > cgroup  132062620   0
> > 132062620   0% /sys/fs/cgroup
> > /dev/sda610650544 2500424
> > 7609092  25% /home
> > 10.237.11.31:/mnt/vol1/sec-storage2/template/tmpl/2/288   4195924
> > 4195924 0 100% /mnt/5230667e-9c58-3ff6-983c-5fc2a72df669
> > 
> >
> > The strange thing is that df shows that it seems to be mounted, but it's
> > actually not mounted. If you noticed, the total capacity of the mount
> point
> > is exactly the same as the capacity of the / (root) partition. By right
> it
> > should show 7 TB instead of just 4 GB.
> >
> > This caused VM creation to be error due to out of disk space. This also
> > affect the KVM operations since the / (root) partition becomes full, and
> we
> > can only release the space after we reboot the KVM host.
> >
> > Anyone experience this problem before? We are at loss on how to resolve
> the
> > problem.
> >
> > Looking forward to your reply, thank you.
> >
> > Cheers.
> >
>

Re: Wiki access

[Chip Childers]

On Thu, Oct 03, 2013 at 06:26:19PM +0100, Ian Duffy wrote:
> Hi,
> 
> May I get access to edit/add pages as well?
> My username is imduffy15.

Added

Re: [URGENT] Mounting issues from KVM hosts to secondary storage

[Indra Pramana]

Hi Marcus and all,

I also find some strange and interesting error messages from the libvirt
logs:

http://pastebin.com/5ByfNpAf

Looking forward to your reply, thank you.

Cheers.



On Fri, Oct 4, 2013 at 1:38 AM, Indra Pramana  wrote:

> Hi Marcus,
>
> Good day to you, and thank you for your e-mail. See my reply inline.
>
> On Fri, Oct 4, 2013 at 12:29 AM, Marcus Sorensen wrote:
>
>> Are you using the release artifacts, or your own 4.2 build?
>>
>
> [Indra:] We are using the release artifacts from below repo since we are
> using Ubuntu:
>
> deb http://cloudstack.apt-get.eu/ubuntu precise 4.2
>
>
>> When you rebooted the host, did the problem go away or come back the
>> same?
>
>
> [Indra:] When I rebooted the host, the problem go away for a while, but it
> will come back again after some time. It will come randomly at the time
> when we need to create a new instance on that host, or start an existing
> stopped instance.
>
>
>> You may want to look at 'virsh pool-list' to see if libvirt is
>> mounting/registering the secondary storage.
>>
>
> [Indra:] This is the result of the virsh pool-list command:
>
> root@hv-kvm-02:/var/log/libvirt# virsh pool-list
> Name State  Autostart
> -
> 301071ac-4c1d-4eac-855b-124126da0a38 active no
> 5230667e-9c58-3ff6-983c-5fc2a72df669 active no
> d433809b-01ea-3947-ba0f-48077244e4d6 active no
>
> Strange thing is that none of my secondary storage IDs are there. Could it
> be that the ID might have changed during Cloudstack upgrade? Here is the
> list of my secondary storage (there are two of them) even though they are
> on the same NFS server:
>   c02da448-b9f4-401b-b8d5-83e8ead5cfde nfs://
> 10.237.11.31/mnt/vol1/sec-storage NFS
> 5937edb6-2e95-4ae2-907b-80fe4599ed87 nfs://
> 10.237.11.31/mnt/vol1/sec-storage2 NFS
>
>> Is this happening on multiple hosts, the same way?
>
>
> [Indra:] Yes, it is happening on all the two hosts that I have, the same
> way.
>
>
>> You may want to
>> look at /etc/mtab, if the system reports it's mounted, though it's
>> not, it might be in there. Look at /proc/mounts as well.
>>
>
> [Indra:] Please find result of df, /etc/mtab and /proc/mounts below. The
> "ghost" mount point is on df and /etc/mtab, but not on /proc/mounts.
>
> root@hv-kvm-02:/etc# df
>
> Filesystem  1K-blocksUsed
> Available Use% Mounted on
> /dev/sda1 4195924
> 4192372 0 100% /
>
> udev132053356   4
> 132053352   1% /dev
> tmpfs52825052 704
> 52824348   1% /run
>
> none 5120
> 0  5120   0% /run/lock
> none132062620   0
> 132062620   0% /run/shm
> cgroup  132062620   0
> 132062620   0% /sys/fs/cgroup
> /dev/sda610650544
> 2500460   7609056  25% /home
> 10.237.11.31:/mnt/vol1/sec-storage2/template/tmpl/2/288   4195924
> 4192372 0 100% /mnt/5230667e-9c58-3ff6-983c-5fc2a72df669
>
> root@hv-kvm-02:/etc# cat /etc/mtab
> /dev/sda1 / ext4 rw,errors=remount-ro 0 0
> proc /proc proc rw,noexec,nosuid,nodev 0 0
> sysfs /sys sysfs rw,noexec,nosuid,nodev 0 0
> none /sys/fs/fuse/connections fusectl rw 0 0
> none /sys/kernel/debug debugfs rw 0 0
> none /sys/kernel/security securityfs rw 0 0
> udev /dev devtmpfs rw,mode=0755 0 0
> devpts /dev/pts devpts rw,noexec,nosuid,gid=5,mode=0620 0 0
> tmpfs /run tmpfs rw,noexec,nosuid,size=10%,mode=0755 0 0
> none /run/lock tmpfs rw,noexec,nosuid,nodev,size=5242880 0 0
> none /run/shm tmpfs rw,nosuid,nodev 0 0
> cgroup /sys/fs/cgroup tmpfs rw,relatime,mode=755 0 0
> cgroup /sys/fs/cgroup/cpuset cgroup rw,relatime,cpuset 0 0
> cgroup /sys/fs/cgroup/cpu cgroup rw,relatime,cpu 0 0
> cgroup /sys/fs/cgroup/cpuacct cgroup rw,relatime,cpuacct 0 0
> cgroup /sys/fs/cgroup/memory cgroup rw,relatime,memory 0 0
> cgroup /sys/fs/cgroup/devices cgroup rw,relatime,devices 0 0
> cgroup /sys/fs/cgroup/freezer cgroup rw,relatime,freezer 0 0
> cgroup /sys/fs/cgroup/blkio cgroup rw,relatime,blkio 0 0
> cgroup /sys/fs/cgroup/perf_event cgroup rw,relatime,perf_event 0 0
> /dev/sda6 /home ext4 rw 0 0
> rpc_pipefs /run/rpc_pipefs rpc_pipefs rw 0 0
> binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,noexec,nosuid,nodev 0 0
> 10.237.11.31:/mnt/vol1/sec-storage2/template/tmpl/2/288
> /mnt/5230667e-9c58-3ff6-983c-5fc2a72df669 nfs rw,addr=10.237.11.31 0 0
>
> rootfs / rootfs rw 0 0
> sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
> proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
> udev /dev devtmpfs rw,relatime,size=132053356k,nr_inodes=33013339,mode=755
> 0 0
> devpts /dev/pts devpts
> rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
> tmpfs /run tmpfs rw,

XenServer Question

[Mike Tutkowski]

Hi,

On one of my SRs, I see the following information:

100.2 GB used of 200 GB total (100 GB allocated)

Can someone explain how 'used' can be larger than 'allocated'?

On storage systems I've worked on before, 'allocated' is generally
synonymous with 'reserved' or 'provisioned'. On these systems, 'used' is
always less than or equal to 'allocated'. Typically 'used' is less than
'allocated' because as 'used' approaches 'allocated', 'allocated' is
expanded (until it runs into 'total').

Thanks!

-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*

Re: Wiki access

[Chip Childers]

On Thu, Oct 03, 2013 at 07:33:14PM +0200, Daan Hoogland wrote:
> I'm not seeing any links for editting permissions either. id == dahn

You have space admin rights...

Do this:

1) go to any page in the space (this will do:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Home )

2) click on Browse (upper right hand corner)

3) click on Space Admin in the Browse dropdown (should be the last in
first part of the menu list, right before the )

4) Click on Security / Permissions in the left hand menu

5) Enter your creds again to elevate permissions

6) From there, you'll see the table of groups and individual users.
Click the "Edit Permissions" button at the *bottom* of the individual
users table.

7) Have fun editing!

Re: Wiki access

[Chiradeep Vittal]

Daan, it is at the 'Browse' drop down at the upper right. Heh


On 10/3/13 10:33 AM, "Daan Hoogland"  wrote:

>I'm not seeing any links for editting permissions either. id == dahn
>
>
>On Thu, Oct 3, 2013 at 7:26 PM, Ian Duffy  wrote:
>
>> Hi,
>>
>> May I get access to edit/add pages as well?
>> My username is imduffy15.
>>
>> Thanks,
>> Ian
>>
>> On 3 October 2013 16:13, Chip Childers 
>>wrote:
>> > On Thu, Oct 03, 2013 at 09:58:03AM +, Bharat Kumar wrote:
>> >> Hi All,
>> >> any one please grant me the edit or add page permission to cwiki.
>> my user name is bharat.kumar
>> >
>> > Done
>>

Re: [DISCUSS] Breaking out Marvin from CloudStack

[Chip Childers]

On Thu, Oct 03, 2013 at 05:27:27PM +, Santhosh Edukulla wrote:
> >The problem with tests being broken out from the main repo is that we
> > end up having a really hard time confirming that new features include
> > appropriate tests.  Plus, tests are tied to features, which are tied to
> > the code.  They should be versioned together.
> 
> I believe this makes more sense for unit tests though, where tests need to be 
> there with the code and both go hand in hand with release. 
> 
> As mentioned earlier, keeping or separating automation code\tests with the 
> main product will not make much of an impact as a whole. 

Right, it makes absolutely 100% sense for unit tests (in fact, we would
be idiots to break them out).

My point still stands.  Integration tests should be part of building a
feature.  No tests, no commit to master.  I don't want to have to cross
reference between two different repos, when a simple feature branch diff
(with an up-to-date feature branch) will make it clear that a merge
includes good changes *and* integration tests.

-chip

Re: Wiki access

[Chip Childers]

On Thu, Oct 03, 2013 at 05:47:15PM +, Chiradeep Vittal wrote:
> Daan, it is at the 'Browse' drop down at the upper right. Heh

Yeah - not sure what UX genius decided to put it there...  ;-)

Re: [URGENT] Mounting issues from KVM hosts to secondary storage

[Marcus Sorensen]

It sort of looks like the out of space triggered the issue. Libvirt shows

2013-10-03 15:38:57.414+: 2710: error : virCommandWait:2348 :
internal error Child process (/bin/umount
/mnt/5230667e-9c58-3ff6-983c-5fc2a72df669) unexpected exit status 32:
error writing /etc/mtab.tmp: No space left on device

So that entry of the filesystem being mounted is orphaned in
/etc/mtab, since it can't be removed. That seems to be the source of
why 'df' shows the thing mounted when it isn't, at least.


On Thu, Oct 3, 2013 at 11:45 AM, Indra Pramana  wrote:
> Hi Marcus and all,
>
> I also find some strange and interesting error messages from the libvirt
> logs:
>
> http://pastebin.com/5ByfNpAf
>
> Looking forward to your reply, thank you.
>
> Cheers.
>
>
>
> On Fri, Oct 4, 2013 at 1:38 AM, Indra Pramana  wrote:
>
>> Hi Marcus,
>>
>> Good day to you, and thank you for your e-mail. See my reply inline.
>>
>> On Fri, Oct 4, 2013 at 12:29 AM, Marcus Sorensen wrote:
>>
>>> Are you using the release artifacts, or your own 4.2 build?
>>>
>>
>> [Indra:] We are using the release artifacts from below repo since we are
>> using Ubuntu:
>>
>> deb http://cloudstack.apt-get.eu/ubuntu precise 4.2
>>
>>
>>> When you rebooted the host, did the problem go away or come back the
>>> same?
>>
>>
>> [Indra:] When I rebooted the host, the problem go away for a while, but it
>> will come back again after some time. It will come randomly at the time
>> when we need to create a new instance on that host, or start an existing
>> stopped instance.
>>
>>
>>> You may want to look at 'virsh pool-list' to see if libvirt is
>>> mounting/registering the secondary storage.
>>>
>>
>> [Indra:] This is the result of the virsh pool-list command:
>>
>> root@hv-kvm-02:/var/log/libvirt# virsh pool-list
>> Name State  Autostart
>> -
>> 301071ac-4c1d-4eac-855b-124126da0a38 active no
>> 5230667e-9c58-3ff6-983c-5fc2a72df669 active no
>> d433809b-01ea-3947-ba0f-48077244e4d6 active no
>>
>> Strange thing is that none of my secondary storage IDs are there. Could it
>> be that the ID might have changed during Cloudstack upgrade? Here is the
>> list of my secondary storage (there are two of them) even though they are
>> on the same NFS server:
>>   c02da448-b9f4-401b-b8d5-83e8ead5cfde nfs://
>> 10.237.11.31/mnt/vol1/sec-storage NFS
>> 5937edb6-2e95-4ae2-907b-80fe4599ed87 nfs://
>> 10.237.11.31/mnt/vol1/sec-storage2 NFS
>>
>>> Is this happening on multiple hosts, the same way?
>>
>>
>> [Indra:] Yes, it is happening on all the two hosts that I have, the same
>> way.
>>
>>
>>> You may want to
>>> look at /etc/mtab, if the system reports it's mounted, though it's
>>> not, it might be in there. Look at /proc/mounts as well.
>>>
>>
>> [Indra:] Please find result of df, /etc/mtab and /proc/mounts below. The
>> "ghost" mount point is on df and /etc/mtab, but not on /proc/mounts.
>>
>> root@hv-kvm-02:/etc# df
>>
>> Filesystem  1K-blocksUsed
>> Available Use% Mounted on
>> /dev/sda1 4195924
>> 4192372 0 100% /
>>
>> udev132053356   4
>> 132053352   1% /dev
>> tmpfs52825052 704
>> 52824348   1% /run
>>
>> none 5120
>> 0  5120   0% /run/lock
>> none132062620   0
>> 132062620   0% /run/shm
>> cgroup  132062620   0
>> 132062620   0% /sys/fs/cgroup
>> /dev/sda610650544
>> 2500460   7609056  25% /home
>> 10.237.11.31:/mnt/vol1/sec-storage2/template/tmpl/2/288   4195924
>> 4192372 0 100% /mnt/5230667e-9c58-3ff6-983c-5fc2a72df669
>>
>> root@hv-kvm-02:/etc# cat /etc/mtab
>> /dev/sda1 / ext4 rw,errors=remount-ro 0 0
>> proc /proc proc rw,noexec,nosuid,nodev 0 0
>> sysfs /sys sysfs rw,noexec,nosuid,nodev 0 0
>> none /sys/fs/fuse/connections fusectl rw 0 0
>> none /sys/kernel/debug debugfs rw 0 0
>> none /sys/kernel/security securityfs rw 0 0
>> udev /dev devtmpfs rw,mode=0755 0 0
>> devpts /dev/pts devpts rw,noexec,nosuid,gid=5,mode=0620 0 0
>> tmpfs /run tmpfs rw,noexec,nosuid,size=10%,mode=0755 0 0
>> none /run/lock tmpfs rw,noexec,nosuid,nodev,size=5242880 0 0
>> none /run/shm tmpfs rw,nosuid,nodev 0 0
>> cgroup /sys/fs/cgroup tmpfs rw,relatime,mode=755 0 0
>> cgroup /sys/fs/cgroup/cpuset cgroup rw,relatime,cpuset 0 0
>> cgroup /sys/fs/cgroup/cpu cgroup rw,relatime,cpu 0 0
>> cgroup /sys/fs/cgroup/cpuacct cgroup rw,relatime,cpuacct 0 0
>> cgroup /sys/fs/cgroup/memory cgroup rw,relatime,memory 0 0
>> cgroup /sys/fs/cgroup/devices cgroup rw,relatime,devices 0 0
>> cgroup /sys/fs/cgroup/freezer cgroup rw,relatime,freezer 0 0
>> cgroup /sys/fs/cgroup/blkio cgroup rw,relatime,blkio 0 0
>>

Re: [URGENT] Mounting issues from KVM hosts to secondary storage

[Indra Pramana]

Hi Marcus,

It happens randomly, mounting fails, and then / gets filled. I suspect this
occurs when the mounting fails, any files which is supposed to be
transferred to the mount point (e.g. templates used to create VMs) will
fill-up the / partition of the KVM host instead. This doesn't happen in
4.1.1, this only happens after we upgraded to 4.2.0.

And how about virsh pool-list result which is not reflecting the actual IDs
of the secondary storage we see from Cloudstack GUI, is it supposed to be
the case? If not, how to rectify it?

Looking forward to your reply, thank you.

Cheers.




On Fri, Oct 4, 2013 at 1:51 AM, Marcus Sorensen  wrote:

> It sort of looks like the out of space triggered the issue. Libvirt shows
>
> 2013-10-03 15:38:57.414+: 2710: error : virCommandWait:2348 :
> internal error Child process (/bin/umount
> /mnt/5230667e-9c58-3ff6-983c-5fc2a72df669) unexpected exit status 32:
> error writing /etc/mtab.tmp: No space left on device
>
> So that entry of the filesystem being mounted is orphaned in
> /etc/mtab, since it can't be removed. That seems to be the source of
> why 'df' shows the thing mounted when it isn't, at least.
>
>
> On Thu, Oct 3, 2013 at 11:45 AM, Indra Pramana  wrote:
> > Hi Marcus and all,
> >
> > I also find some strange and interesting error messages from the libvirt
> > logs:
> >
> > http://pastebin.com/5ByfNpAf
> >
> > Looking forward to your reply, thank you.
> >
> > Cheers.
> >
> >
> >
> > On Fri, Oct 4, 2013 at 1:38 AM, Indra Pramana  wrote:
> >
> >> Hi Marcus,
> >>
> >> Good day to you, and thank you for your e-mail. See my reply inline.
> >>
> >> On Fri, Oct 4, 2013 at 12:29 AM, Marcus Sorensen  >wrote:
> >>
> >>> Are you using the release artifacts, or your own 4.2 build?
> >>>
> >>
> >> [Indra:] We are using the release artifacts from below repo since we are
> >> using Ubuntu:
> >>
> >> deb http://cloudstack.apt-get.eu/ubuntu precise 4.2
> >>
> >>
> >>> When you rebooted the host, did the problem go away or come back the
> >>> same?
> >>
> >>
> >> [Indra:] When I rebooted the host, the problem go away for a while, but
> it
> >> will come back again after some time. It will come randomly at the time
> >> when we need to create a new instance on that host, or start an existing
> >> stopped instance.
> >>
> >>
> >>> You may want to look at 'virsh pool-list' to see if libvirt is
> >>> mounting/registering the secondary storage.
> >>>
> >>
> >> [Indra:] This is the result of the virsh pool-list command:
> >>
> >> root@hv-kvm-02:/var/log/libvirt# virsh pool-list
> >> Name State  Autostart
> >> -
> >> 301071ac-4c1d-4eac-855b-124126da0a38 active no
> >> 5230667e-9c58-3ff6-983c-5fc2a72df669 active no
> >> d433809b-01ea-3947-ba0f-48077244e4d6 active no
> >>
> >> Strange thing is that none of my secondary storage IDs are there. Could
> it
> >> be that the ID might have changed during Cloudstack upgrade? Here is the
> >> list of my secondary storage (there are two of them) even though they
> are
> >> on the same NFS server:
> >>   c02da448-b9f4-401b-b8d5-83e8ead5cfde nfs://
> >> 10.237.11.31/mnt/vol1/sec-storage NFS
> >> 5937edb6-2e95-4ae2-907b-80fe4599ed87 nfs://
> >> 10.237.11.31/mnt/vol1/sec-storage2 NFS
> >>
> >>> Is this happening on multiple hosts, the same way?
> >>
> >>
> >> [Indra:] Yes, it is happening on all the two hosts that I have, the same
> >> way.
> >>
> >>
> >>> You may want to
> >>> look at /etc/mtab, if the system reports it's mounted, though it's
> >>> not, it might be in there. Look at /proc/mounts as well.
> >>>
> >>
> >> [Indra:] Please find result of df, /etc/mtab and /proc/mounts below. The
> >> "ghost" mount point is on df and /etc/mtab, but not on /proc/mounts.
> >>
> >> root@hv-kvm-02:/etc# df
> >>
> >> Filesystem  1K-blocks
>  Used
> >> Available Use% Mounted on
> >> /dev/sda1 4195924
> >> 4192372 0 100% /
> >>
> >> udev132053356
> 4
> >> 132053352   1% /dev
> >> tmpfs52825052
> 704
> >> 52824348   1% /run
> >>
> >> none 5120
> >> 0  5120   0% /run/lock
> >> none132062620
> 0
> >> 132062620   0% /run/shm
> >> cgroup  132062620
> 0
> >> 132062620   0% /sys/fs/cgroup
> >> /dev/sda610650544
> >> 2500460   7609056  25% /home
> >> 10.237.11.31:/mnt/vol1/sec-storage2/template/tmpl/2/288   4195924
> >> 4192372 0 100% /mnt/5230667e-9c58-3ff6-983c-5fc2a72df669
> >>
> >> root@hv-kvm-02:/etc# cat /etc/mtab
> >> /dev/sda1 / ext4 rw,errors=remount-ro 0 0
> >> proc /proc proc rw,noexec,nosuid,nodev 0 0
> >> sysfs /sys sysfs rw,noexec,nosuid,nodev 0 0
> >> none /sys/fs/f

[DOCS] CS-docs patch

[Travis Graham]

Here is a patch for the "Deployment Architecture Overview" section until things 
get setup in Review Board for the new repo or there's a GitHub mirror that pull 
requests can be sent to for review. Will the github mirror and PR route be 
supported in tandem with the Review Board process or not at all?

It adds in links to other docs it only loosely referenced by name and adds the 
Primary Storage info about being zone wide for 4.2.

Travis

Re: [DISCUSS] Leaky abstractions [was review requests 13238, 13896, 14320]

[Darren Shepherd]

We are always going to run into the issue where they're implementation
specific features that can't be represented in a generic way in the
API.  First class attributes in the API need to essentially be the
lowest common denominator.  ACS already has this pattern of *_details
tables.  I honestly don't know completely how they are used, but I
would hope that pattern could be used to address these types of
issues.  By allowing the admin to add arbitrary key/value pairs to the
various offerings/entities we can use that to tap into provider
specific or advanced configuration.  For the http close proposal you
could just add haproxy.httpClose=true on the network offering and the
haproxy impl can respect that and use it.  So implementations can
document what additional key/value parameters they support to access
advanced features.

Review 13896 adds an otherOptions field to the service offering.
Conceptually that is fine in my mind, but I just don't understand why
the *_details tables can't be used instead.  Just like XenServer has
other_config on all types, I'd like it if ACS had a similar thing
(which I kinda, sorta think it does?).  So we should be able to
arbitrary data onto any type.  Can somebody comment on how this idea
may relate with the existing implementation of "details" and "tags" in
ACS?

Darren

On Thu, Oct 3, 2013 at 10:21 AM, Daan Hoogland  wrote:
> Murali,
>
> What our admins need is the ability to instantiate an abstract thing called
> a virtual redundant high available router. They need be able to tune it
> with all sorts of features is such a way that other routers redundant or
> not and high availible or not, may but do not have to have the same tuning
> parameters. This 'feature' of httpClose is just one of the many things they
> need to be able to tune. Others include a more fine grained control over
> the iptables/firewall rules and monitoring of the functionality/daemons
> running on the machines. I am not biased as to the way how to do/implement
> this control. The networkoffering seemed like the way to do it.
>
> Having said that I didn't think that httpClose would be considered haproxy
> specific. It seems worrying that someone could device a proxy or a
> loadbalancer that does not support either one of the features of
> maximizing - or pooling connections. I'm not into that market recently so I
> might be mistaking. This maybe besides the point but it discomforts me
> somewhat.
>
> regards,
> Daan
>
>
> On Thu, Oct 3, 2013 at 2:22 PM, murali reddy wrote:
>
>> On Thu, Oct 3, 2013 at 4:18 PM, Daan Hoogland > >wrote:
>>
>> > Chiradeep,
>> >
>> > I have been thinking about your concern and there is something bothering
>> me
>> > about it. The issue CLOUDSTACK-4328 of which
>> > https://reviews.apache.org/r/14320/ is an implementation. This issue has
>> > been brought up by the engineers at Schuberg Philis. These are cloud
>> > operators and domain admins. So these are the people that need to be
>> > bothered by this tuning and they are certainly haproxy and xen experts to
>> > an extend. For them not being able to use connection caching was a bug.
>> And
>> > the proposed solution still seems reasonable to me. It is exposing the
>> > abstract feature only to those instantiating a vpc, isn't it? This last
>> > question probably touches on the reason you are addressing my submission
>> > together with the ones from Nicolas  I see only people instantiating a
>> vpc
>> > having to be bothered by which netoffering to use (with respect to
>> > httpClose functionality) If this is not the case how should I isolate
>> this
>> > concern from other , more mondain users?
>> >
>> > btw I did not create an FS page as the issue was created as a jira
>> ticket.
>> > I am willing to do that in hind sight but want to have a path to follow
>> > first.
>> >
>> > regards,
>> > Daan
>> >
>> > On Tue, Oct 1, 2013 at 11:06 PM, Chiradeep Vittal <
>> > chiradeep.vit...@citrix.com> wrote:
>> > >
>> > > We have a couple of people trying to expose the advanced capabilities
>> of
>> > the underlying physical resources to the end-user. In the case of Nicolas
>> > FOATA, he is trying to expose some of the advanced functions of
>> > XenServer/XCP, and in the case of Daan, he is trying to expose some
>> feature
>> > of HAProxy.
>> > >
>> > > Users are ideally abstracted from these details and shouldn't have to
>> > wonder which offering to choose [because they are not Xen/HAProxy
>> experts].
>> > > After all one of the goals of CS is to hide these messy details and let
>> > users focus on their apps.
>> > >
>> > > Is there a possibility of a generic way of leaking abstractions for
>> > sufficiently advanced users?
>> > >
>> >
>>
>> Generally as a principle core API's abstract and expose functionality that
>> is commonly available across the hypervisors and network service providers
>> etc.. I believe we should continue to enforce it.
>>
>> But we do have a pattern of API's configure* (configurevirtualrouter,
>> configure

Re: [DISCUSS] Leaky abstractions [was review requests 13238, 13896, 14320]

[Kelven Yang]

*_details table is currently used as the generic way of passing key/value
pairs that are transparent to API layer and core CloudStack orchestration
flow. When I say transparent, the scope is only limited to API layer and
core generic orchestration flow, specific plugin elements or Gurus still
have the chance to further interpret these key/value data with current
Guru/Element pattern in the flow.

So, we do have such generic facility, but how to present in a more
domain-specific and friendly way is another problem.

Kelven

On 10/3/13 11:15 AM, "Darren Shepherd"  wrote:

>We are always going to run into the issue where they're implementation
>specific features that can't be represented in a generic way in the
>API.  First class attributes in the API need to essentially be the
>lowest common denominator.  ACS already has this pattern of *_details
>tables.  I honestly don't know completely how they are used, but I
>would hope that pattern could be used to address these types of
>issues.  By allowing the admin to add arbitrary key/value pairs to the
>various offerings/entities we can use that to tap into provider
>specific or advanced configuration.  For the http close proposal you
>could just add haproxy.httpClose=true on the network offering and the
>haproxy impl can respect that and use it.  So implementations can
>document what additional key/value parameters they support to access
>advanced features.
>
>Review 13896 adds an otherOptions field to the service offering.
>Conceptually that is fine in my mind, but I just don't understand why
>the *_details tables can't be used instead.  Just like XenServer has
>other_config on all types, I'd like it if ACS had a similar thing
>(which I kinda, sorta think it does?).  So we should be able to
>arbitrary data onto any type.  Can somebody comment on how this idea
>may relate with the existing implementation of "details" and "tags" in
>ACS?
>
>Darren
>
>On Thu, Oct 3, 2013 at 10:21 AM, Daan Hoogland 
>wrote:
>> Murali,
>>
>> What our admins need is the ability to instantiate an abstract thing
>>called
>> a virtual redundant high available router. They need be able to tune it
>> with all sorts of features is such a way that other routers redundant or
>> not and high availible or not, may but do not have to have the same
>>tuning
>> parameters. This 'feature' of httpClose is just one of the many things
>>they
>> need to be able to tune. Others include a more fine grained control over
>> the iptables/firewall rules and monitoring of the functionality/daemons
>> running on the machines. I am not biased as to the way how to
>>do/implement
>> this control. The networkoffering seemed like the way to do it.
>>
>> Having said that I didn't think that httpClose would be considered
>>haproxy
>> specific. It seems worrying that someone could device a proxy or a
>> loadbalancer that does not support either one of the features of
>> maximizing - or pooling connections. I'm not into that market recently
>>so I
>> might be mistaking. This maybe besides the point but it discomforts me
>> somewhat.
>>
>> regards,
>> Daan
>>
>>
>> On Thu, Oct 3, 2013 at 2:22 PM, murali reddy
>>wrote:
>>
>>> On Thu, Oct 3, 2013 at 4:18 PM, Daan Hoogland >> >wrote:
>>>
>>> > Chiradeep,
>>> >
>>> > I have been thinking about your concern and there is something
>>>bothering
>>> me
>>> > about it. The issue CLOUDSTACK-4328 of which
>>> > https://reviews.apache.org/r/14320/ is an implementation. This issue
>>>has
>>> > been brought up by the engineers at Schuberg Philis. These are cloud
>>> > operators and domain admins. So these are the people that need to be
>>> > bothered by this tuning and they are certainly haproxy and xen
>>>experts to
>>> > an extend. For them not being able to use connection caching was a
>>>bug.
>>> And
>>> > the proposed solution still seems reasonable to me. It is exposing
>>>the
>>> > abstract feature only to those instantiating a vpc, isn't it? This
>>>last
>>> > question probably touches on the reason you are addressing my
>>>submission
>>> > together with the ones from Nicolas  I see only people instantiating
>>>a
>>> vpc
>>> > having to be bothered by which netoffering to use (with respect to
>>> > httpClose functionality) If this is not the case how should I isolate
>>> this
>>> > concern from other , more mondain users?
>>> >
>>> > btw I did not create an FS page as the issue was created as a jira
>>> ticket.
>>> > I am willing to do that in hind sight but want to have a path to
>>>follow
>>> > first.
>>> >
>>> > regards,
>>> > Daan
>>> >
>>> > On Tue, Oct 1, 2013 at 11:06 PM, Chiradeep Vittal <
>>> > chiradeep.vit...@citrix.com> wrote:
>>> > >
>>> > > We have a couple of people trying to expose the advanced
>>>capabilities
>>> of
>>> > the underlying physical resources to the end-user. In the case of
>>>Nicolas
>>> > FOATA, he is trying to expose some of the advanced functions of
>>> > XenServer/XCP, and in the case of Daan, he is trying to expose some
>>> feature
>>>

Re: [URGENT] Mounting issues from KVM hosts to secondary storage

[Marcus Sorensen]

You'll have to go back further in the log then, and/or go to the agent
log, because the issue of the ghost mount is due to the filesystem
being full, and if that's your secondary storage I'm not sure why it
would be written to from the kvm host unless you were doing backups or
snapshots.

On Thu, Oct 3, 2013 at 12:03 PM, Indra Pramana  wrote:
> Hi Marcus,
>
> It happens randomly, mounting fails, and then / gets filled. I suspect this
> occurs when the mounting fails, any files which is supposed to be
> transferred to the mount point (e.g. templates used to create VMs) will
> fill-up the / partition of the KVM host instead. This doesn't happen in
> 4.1.1, this only happens after we upgraded to 4.2.0.
>
> And how about virsh pool-list result which is not reflecting the actual IDs
> of the secondary storage we see from Cloudstack GUI, is it supposed to be
> the case? If not, how to rectify it?
>
> Looking forward to your reply, thank you.
>
> Cheers.
>
>
>
>
> On Fri, Oct 4, 2013 at 1:51 AM, Marcus Sorensen  wrote:
>
>> It sort of looks like the out of space triggered the issue. Libvirt shows
>>
>> 2013-10-03 15:38:57.414+: 2710: error : virCommandWait:2348 :
>> internal error Child process (/bin/umount
>> /mnt/5230667e-9c58-3ff6-983c-5fc2a72df669) unexpected exit status 32:
>> error writing /etc/mtab.tmp: No space left on device
>>
>> So that entry of the filesystem being mounted is orphaned in
>> /etc/mtab, since it can't be removed. That seems to be the source of
>> why 'df' shows the thing mounted when it isn't, at least.
>>
>>
>> On Thu, Oct 3, 2013 at 11:45 AM, Indra Pramana  wrote:
>> > Hi Marcus and all,
>> >
>> > I also find some strange and interesting error messages from the libvirt
>> > logs:
>> >
>> > http://pastebin.com/5ByfNpAf
>> >
>> > Looking forward to your reply, thank you.
>> >
>> > Cheers.
>> >
>> >
>> >
>> > On Fri, Oct 4, 2013 at 1:38 AM, Indra Pramana  wrote:
>> >
>> >> Hi Marcus,
>> >>
>> >> Good day to you, and thank you for your e-mail. See my reply inline.
>> >>
>> >> On Fri, Oct 4, 2013 at 12:29 AM, Marcus Sorensen > >wrote:
>> >>
>> >>> Are you using the release artifacts, or your own 4.2 build?
>> >>>
>> >>
>> >> [Indra:] We are using the release artifacts from below repo since we are
>> >> using Ubuntu:
>> >>
>> >> deb http://cloudstack.apt-get.eu/ubuntu precise 4.2
>> >>
>> >>
>> >>> When you rebooted the host, did the problem go away or come back the
>> >>> same?
>> >>
>> >>
>> >> [Indra:] When I rebooted the host, the problem go away for a while, but
>> it
>> >> will come back again after some time. It will come randomly at the time
>> >> when we need to create a new instance on that host, or start an existing
>> >> stopped instance.
>> >>
>> >>
>> >>> You may want to look at 'virsh pool-list' to see if libvirt is
>> >>> mounting/registering the secondary storage.
>> >>>
>> >>
>> >> [Indra:] This is the result of the virsh pool-list command:
>> >>
>> >> root@hv-kvm-02:/var/log/libvirt# virsh pool-list
>> >> Name State  Autostart
>> >> -
>> >> 301071ac-4c1d-4eac-855b-124126da0a38 active no
>> >> 5230667e-9c58-3ff6-983c-5fc2a72df669 active no
>> >> d433809b-01ea-3947-ba0f-48077244e4d6 active no
>> >>
>> >> Strange thing is that none of my secondary storage IDs are there. Could
>> it
>> >> be that the ID might have changed during Cloudstack upgrade? Here is the
>> >> list of my secondary storage (there are two of them) even though they
>> are
>> >> on the same NFS server:
>> >>   c02da448-b9f4-401b-b8d5-83e8ead5cfde nfs://
>> >> 10.237.11.31/mnt/vol1/sec-storage NFS
>> >> 5937edb6-2e95-4ae2-907b-80fe4599ed87 nfs://
>> >> 10.237.11.31/mnt/vol1/sec-storage2 NFS
>> >>
>> >>> Is this happening on multiple hosts, the same way?
>> >>
>> >>
>> >> [Indra:] Yes, it is happening on all the two hosts that I have, the same
>> >> way.
>> >>
>> >>
>> >>> You may want to
>> >>> look at /etc/mtab, if the system reports it's mounted, though it's
>> >>> not, it might be in there. Look at /proc/mounts as well.
>> >>>
>> >>
>> >> [Indra:] Please find result of df, /etc/mtab and /proc/mounts below. The
>> >> "ghost" mount point is on df and /etc/mtab, but not on /proc/mounts.
>> >>
>> >> root@hv-kvm-02:/etc# df
>> >>
>> >> Filesystem  1K-blocks
>>  Used
>> >> Available Use% Mounted on
>> >> /dev/sda1 4195924
>> >> 4192372 0 100% /
>> >>
>> >> udev132053356
>> 4
>> >> 132053352   1% /dev
>> >> tmpfs52825052
>> 704
>> >> 52824348   1% /run
>> >>
>> >> none 5120
>> >> 0  5120   0% /run/lock
>> >> none132062620
>> 0
>> >> 132062620   0% /run/shm
>> >> cgroup  132062620

RE: Post-release work

[Animesh Chaturvedi]

I merged 4.2-forward into 4.2 last night. I will keep 4.2-forward around for 
couple of days just in case something is missed. I will send a separate email 
to mailing list that 4.2 is now open for checkin and do not checkin into 
4.2-forward.

> -Original Message-
> From: Animesh Chaturvedi [mailto:animesh.chaturv...@citrix.com]
> Sent: Wednesday, October 02, 2013 12:13 PM
> To: dev@cloudstack.apache.org
> Subject: RE: Post-release work
> 
> 
> 
> > -Original Message-
> > From: David Nalley [mailto:da...@gnsa.us]
> > Sent: Wednesday, October 02, 2013 7:22 AM
> > To: dev@cloudstack.apache.org
> > Subject: Post-release work
> >
> > As previously discussed, now that 4.2 is released, I moving docs to
> > their own repo.
> >
> > https://git-wip-us.apache.org/repos/cloudstack-docs.git
> >
> > For present, I am pushing the 4.2 docs into a 4.2 branch, and will
> > deal with master in a bit.
> >
> >
> > We also need to merge anything in 4.2-forward into 4.2 and purge 4.2-
> > forward as we prepare for 4.2.1.
> [Animesh>] Yes I plan to do it later today.

> >
> > --David

Re: [DISCUSS] Leaky abstractions [was review requests 13238, 13896, 14320]

[Chiradeep Vittal]

I was thinking along the same lines that a offering could have a generic
key/value map (where the value could be a string/json string/whatever).
CloudStack core wouldn't have any idea about the semantics of the keys or
values, but the specific hypervisor/provider might decide to interpret it.


On 10/3/13 11:15 AM, "Darren Shepherd"  wrote:

>We are always going to run into the issue where they're implementation
>specific features that can't be represented in a generic way in the
>API.  First class attributes in the API need to essentially be the
>lowest common denominator.  ACS already has this pattern of *_details
>tables.  I honestly don't know completely how they are used, but I
>would hope that pattern could be used to address these types of
>issues.  By allowing the admin to add arbitrary key/value pairs to the
>various offerings/entities we can use that to tap into provider
>specific or advanced configuration.  For the http close proposal you
>could just add haproxy.httpClose=true on the network offering and the
>haproxy impl can respect that and use it.  So implementations can
>document what additional key/value parameters they support to access
>advanced features.
>
>Review 13896 adds an otherOptions field to the service offering.
>Conceptually that is fine in my mind, but I just don't understand why
>the *_details tables can't be used instead.  Just like XenServer has
>other_config on all types, I'd like it if ACS had a similar thing
>(which I kinda, sorta think it does?).  So we should be able to
>arbitrary data onto any type.  Can somebody comment on how this idea
>may relate with the existing implementation of "details" and "tags" in
>ACS?
>
>Darren
>
>On Thu, Oct 3, 2013 at 10:21 AM, Daan Hoogland 
>wrote:
>> Murali,
>>
>> What our admins need is the ability to instantiate an abstract thing
>>called
>> a virtual redundant high available router. They need be able to tune it
>> with all sorts of features is such a way that other routers redundant or
>> not and high availible or not, may but do not have to have the same
>>tuning
>> parameters. This 'feature' of httpClose is just one of the many things
>>they
>> need to be able to tune. Others include a more fine grained control over
>> the iptables/firewall rules and monitoring of the functionality/daemons
>> running on the machines. I am not biased as to the way how to
>>do/implement
>> this control. The networkoffering seemed like the way to do it.
>>
>> Having said that I didn't think that httpClose would be considered
>>haproxy
>> specific. It seems worrying that someone could device a proxy or a
>> loadbalancer that does not support either one of the features of
>> maximizing - or pooling connections. I'm not into that market recently
>>so I
>> might be mistaking. This maybe besides the point but it discomforts me
>> somewhat.
>>
>> regards,
>> Daan
>>
>>
>> On Thu, Oct 3, 2013 at 2:22 PM, murali reddy
>>wrote:
>>
>>> On Thu, Oct 3, 2013 at 4:18 PM, Daan Hoogland >> >wrote:
>>>
>>> > Chiradeep,
>>> >
>>> > I have been thinking about your concern and there is something
>>>bothering
>>> me
>>> > about it. The issue CLOUDSTACK-4328 of which
>>> > https://reviews.apache.org/r/14320/ is an implementation. This issue
>>>has
>>> > been brought up by the engineers at Schuberg Philis. These are cloud
>>> > operators and domain admins. So these are the people that need to be
>>> > bothered by this tuning and they are certainly haproxy and xen
>>>experts to
>>> > an extend. For them not being able to use connection caching was a
>>>bug.
>>> And
>>> > the proposed solution still seems reasonable to me. It is exposing
>>>the
>>> > abstract feature only to those instantiating a vpc, isn't it? This
>>>last
>>> > question probably touches on the reason you are addressing my
>>>submission
>>> > together with the ones from Nicolas  I see only people instantiating
>>>a
>>> vpc
>>> > having to be bothered by which netoffering to use (with respect to
>>> > httpClose functionality) If this is not the case how should I isolate
>>> this
>>> > concern from other , more mondain users?
>>> >
>>> > btw I did not create an FS page as the issue was created as a jira
>>> ticket.
>>> > I am willing to do that in hind sight but want to have a path to
>>>follow
>>> > first.
>>> >
>>> > regards,
>>> > Daan
>>> >
>>> > On Tue, Oct 1, 2013 at 11:06 PM, Chiradeep Vittal <
>>> > chiradeep.vit...@citrix.com> wrote:
>>> > >
>>> > > We have a couple of people trying to expose the advanced
>>>capabilities
>>> of
>>> > the underlying physical resources to the end-user. In the case of
>>>Nicolas
>>> > FOATA, he is trying to expose some of the advanced functions of
>>> > XenServer/XCP, and in the case of Daan, he is trying to expose some
>>> feature
>>> > of HAProxy.
>>> > >
>>> > > Users are ideally abstracted from these details and shouldn't have
>>>to
>>> > wonder which offering to choose [because they are not Xen/HAProxy
>>> experts].
>>> > > After all one of the goals of CS is to 

Re: [DISCUSS] Leaky abstractions [was review requests 13238, 13896, 14320]

[Chip Childers]

> On Oct 3, 2013, at 3:01 PM, Chiradeep Vittal  
> wrote:
>
> I was thinking along the same lines that a offering could have a generic
> key/value map (where the value could be a string/json string/whatever).
> CloudStack core wouldn't have any idea about the semantics of the keys or
> values, but the specific hypervisor/provider might decide to interpret it.

+1 - a model for extensions like that makes perfect sense.

>
>
>> On 10/3/13 11:15 AM, "Darren Shepherd"  wrote:
>>
>> We are always going to run into the issue where they're implementation
>> specific features that can't be represented in a generic way in the
>> API.  First class attributes in the API need to essentially be the
>> lowest common denominator.  ACS already has this pattern of *_details
>> tables.  I honestly don't know completely how they are used, but I
>> would hope that pattern could be used to address these types of
>> issues.  By allowing the admin to add arbitrary key/value pairs to the
>> various offerings/entities we can use that to tap into provider
>> specific or advanced configuration.  For the http close proposal you
>> could just add haproxy.httpClose=true on the network offering and the
>> haproxy impl can respect that and use it.  So implementations can
>> document what additional key/value parameters they support to access
>> advanced features.
>>
>> Review 13896 adds an otherOptions field to the service offering.
>> Conceptually that is fine in my mind, but I just don't understand why
>> the *_details tables can't be used instead.  Just like XenServer has
>> other_config on all types, I'd like it if ACS had a similar thing
>> (which I kinda, sorta think it does?).  So we should be able to
>> arbitrary data onto any type.  Can somebody comment on how this idea
>> may relate with the existing implementation of "details" and "tags" in
>> ACS?
>>
>> Darren
>>
>> On Thu, Oct 3, 2013 at 10:21 AM, Daan Hoogland 
>> wrote:
>>> Murali,
>>>
>>> What our admins need is the ability to instantiate an abstract thing
>>> called
>>> a virtual redundant high available router. They need be able to tune it
>>> with all sorts of features is such a way that other routers redundant or
>>> not and high availible or not, may but do not have to have the same
>>> tuning
>>> parameters. This 'feature' of httpClose is just one of the many things
>>> they
>>> need to be able to tune. Others include a more fine grained control over
>>> the iptables/firewall rules and monitoring of the functionality/daemons
>>> running on the machines. I am not biased as to the way how to
>>> do/implement
>>> this control. The networkoffering seemed like the way to do it.
>>>
>>> Having said that I didn't think that httpClose would be considered
>>> haproxy
>>> specific. It seems worrying that someone could device a proxy or a
>>> loadbalancer that does not support either one of the features of
>>> maximizing - or pooling connections. I'm not into that market recently
>>> so I
>>> might be mistaking. This maybe besides the point but it discomforts me
>>> somewhat.
>>>
>>> regards,
>>> Daan
>>>
>>>
>>> On Thu, Oct 3, 2013 at 2:22 PM, murali reddy
>>> wrote:
>>>
 On Thu, Oct 3, 2013 at 4:18 PM, Daan Hoogland  wrote:

> Chiradeep,
>
> I have been thinking about your concern and there is something
 bothering
 me
> about it. The issue CLOUDSTACK-4328 of which
> https://reviews.apache.org/r/14320/ is an implementation. This issue
 has
> been brought up by the engineers at Schuberg Philis. These are cloud
> operators and domain admins. So these are the people that need to be
> bothered by this tuning and they are certainly haproxy and xen
 experts to
> an extend. For them not being able to use connection caching was a
 bug.
 And
> the proposed solution still seems reasonable to me. It is exposing
 the
> abstract feature only to those instantiating a vpc, isn't it? This
 last
> question probably touches on the reason you are addressing my
 submission
> together with the ones from Nicolas  I see only people instantiating
 a
 vpc
> having to be bothered by which netoffering to use (with respect to
> httpClose functionality) If this is not the case how should I isolate
 this
> concern from other , more mondain users?
>
> btw I did not create an FS page as the issue was created as a jira
 ticket.
> I am willing to do that in hind sight but want to have a path to
 follow
> first.
>
> regards,
> Daan
>
> On Tue, Oct 1, 2013 at 11:06 PM, Chiradeep Vittal <
> chiradeep.vit...@citrix.com> wrote:
>>
>> We have a couple of people trying to expose the advanced
 capabilities
 of
> the underlying physical resources to the end-user. In the case of
 Nicolas
> FOATA, he is trying to expose some of the advanced functions of
> XenServer/XCP, and in the case of Daan, he is trying to expose so