Re: Review Request 13701: Automation Tests for HA Proxy Stickiness

[suresh sadhu]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/13701/#review26060
---



test/integration/component/test_haproxy.py


def test_03_supported_policies_by_network

This method is checking only  tag "supported Stickynessmethods"  but not 
checking  displayed supported methods under this tag.

script should retrive  and compare the displayed value with supported 
values.
if both matches then it should return true.




- suresh sadhu


On Aug. 27, 2013, 5:36 a.m., Girish Shilamkar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/13701/
> ---
> 
> (Updated Aug. 27, 2013, 5:36 a.m.)
> 
> 
> Review request for cloudstack, suresh sadhu and Prasanna Santhanam.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Automation Tests for HA Proxy Stickiness
> 
> 
> Diffs
> -
> 
>   test/integration/component/test_haproxy.py PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/13701/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Girish Shilamkar
> 
>

cloudstack source code in build dir

[黑洞]

The replace.properties file
What is the role







 

云计算基础架构师
Github:https://github.com/heidsoftWeibo: http://weibo.com/liuganbin
研究方向：云计算（云安全）、大数据（数据处理分析）
主要学习: Linux / C / C++ / JAVA
Email:heids...@sina.com
Tell:18601706743











某云计算公司





Jake.liu@heidsoft黑洞




云计算系统架构师








   840608792





heidso...@gmail.com





 weibo.com/liuganbin





 上海 徐汇区












名片二维码

RE: Marvin tests for VPC - why create VPC offering?

[Rajesh Battala]

My observations are
1. VPC offering is to tell what are all the services can be available if you 
create tiers in the vpc.
2. There should be some default providers for each service.(but currently its 
only VpcVR). Or set of providers for each service it can provider.
When vpc_network_offering is created, when this network is getting implemented 
inside this vpc and those services/service providers are validated against what 
are the services/providers can be provided.

I feel while creating "VPC_Offering" flexibility should be provided  at VPC 
level  such that what are the services provided and possible service providers.
But currently there only only 3 possible providers one is VPcVR and 
Netscaler(only for External LB) and internalLB Provider. 

As there are fixed set of providers and the possible combination of VPC 
services offerings are created by default we should be using them to create a 
VPC.

If user wants to create a new VPC offering it will become a copy of the 
existing VPC offering because possible VPC offerings are created by VPCManager.

Thanks
Rajesh Battala

-Original Message-
From: Sowmya Krishnan 
Sent: Thursday, September 12, 2013 8:13 PM
To: dev@cloudstack.apache.org
Cc: Rajesh Battala; Venkata SwamyBabu Budumuru
Subject: RE: Marvin tests for VPC - why create VPC offering?


> -Original Message-
> From: Prasanna Santhanam [mailto:t...@apache.org]
> Sent: Thursday, September 12, 2013 11:55 AM
> To: dev@cloudstack.apache.org
> Cc: Rajesh Battala; Venkata SwamyBabu Budumuru
> Subject: Re: Marvin tests for VPC - why create VPC offering?
> 
> See inline, there seems to be a bug in the design.
> 
> On Thu, Sep 12, 2013 at 05:53:45AM +, Sowmya Krishnan wrote:
> > > -Original Message-
> > > From: Prasanna Santhanam [mailto:t...@apache.org]
> > > Sent: Thursday, September 12, 2013 11:07 AM
> > > To: dev@cloudstack.apache.org
> > > Subject: Re: Marvin tests for VPC - why create VPC offering?
> > >
> > > On Thu, Sep 12, 2013 at 05:15:16AM +, Sowmya Krishnan wrote:
> > > > I find for most of the VPC tests we create a new VPC Offering 
> > > > which provides almost the same set of services as the "Default 
> > > > VPC
> Offering"
> > > > already available by default. We also have a separate function 
> > > > to create this offering, enabling it and then create a VPC using 
> > > > this offering. I wonder why do we have to create vpc offerings 
> > > > for each test suite. Also, we don't expose create VPC offering in the 
> > > > UI.
> > > > We do have an API for that, but I think we should just stick to 
> > > > the default ones available and then create network offerings as 
> > > > required for the test.
> > > >
> > >
> > > Personally, I don't see the harm in that since any offering is 
> > > lightweight. I prefer every test create it's own set of resources 
> > > from scratch if possible. Today we don't track the trail of 
> > > resources that are
> created by a test but we will do that.
> > > That should help with cleanup and audit.
> > >
> > > Do you see a problem though?
> >
> > I feel It's just redundant. API is anyway tested as part of the 
> > other test - test_vpc_offerings.
> 
> Yeah DRY is a good reason to make the test simpler. I don't have an 
> opinion either way.
> 
> > Problem I encounter is, when we try to create a VPC offering, we 
> > don't have the option of choosing the service provider. So by 
> > default, all services will be provided by VPCVR.
> 
> The vpcOffering API only provides a service list which means it 
> shouldn't map to a provider list. If it did, then there's some magic 
> happening in the background.
> 
> > Now, when I try to create a VPC offering with NS as external LB 
> > provider, that's not possible through the API. I have to use the 
> > default offering only.
> 
> This is a bug in the design. Rajesh would be best to comment on this 
> since he included support of NS as LB provider in a VPC.
> 
> > So in effect, it's not going to be consistent across tests - you 
> > create an offering for one test, while use the default one for the 
> > other.
> >
> Agreed.
> 
> > Also, I am not sure - but I wonder if there was a reason why 
> > creation of VPC offering, unlike network offering isn't exposed in the UI.
> >
> No idea. I don't actually see the distinction between vpcofferings and 
> networkofferings too. They're both defining a set of providers and a 
> set of services mapped to those providers. I questioned this many 
> times before internally and IMO, they should just be merged to make it less 
> confusing.

I'll raise a separate thread to figure out why it's designed the way it is.

> 
> >
> > I generally don't like sticking to anything 'Default'
> > > and exposed only in our UI. Exercise all APIs, leave no stone unturned.
> > >
> > > > Except for one test suite - test_vpc_offerings.py, where we are 
> > > > actually testing vpc offerings, I don't think we should be 
> > > > creating vpc offerings elsewhere. Comments?

Re: Security Groups

[Jijun]

hi , i encounter the same problem,

as i know, XenServer 6.2 need not  the CSP.

but the ingress not be blocked by default. i can ping all the Vms in 
that security group.


i don't know why?

Thanks.

On 09/13/2013 02:02 AM, Michael Phillips wrote:

So that is definitely going to be the issue. I missed that in the 8.2.7 section 
of the install guide.


From: sangeetha.hariha...@citrix.com
To: dev@cloudstack.apache.org
Subject: RE: Security Groups
Date: Thu, 12 Sep 2013 17:19:16 +

If you are using Xenserver hosts , can you make sure you have the CSP packages 
installed?

-Thanks
Sangeetha

-Original Message-
From: Michael Phillips [mailto:mphilli7...@hotmail.com]
Sent: Thursday, September 12, 2013 9:33 AM
To: dev@cloudstack.apache.org
Subject: Security Groups

I posed this question in the user list, but I figured I would throw it out here as well...So If I 
have created a zone with the "DefaultSharedNetworkOfferingWithSGService" network 
offering, then created a VM using the default security group, which has 0 ingress rules, I should 
NOT be able to do things like PING that VM correct? The answer to the above question was answered 
"correct"...My next question is, in that case what are some things I could look at to see 
why it's not behaving as expected.






--
Thanks,
Jijun

Re: Review Request 14084: Updates to @ActionEvent to be compatible with Spring AOP

[Kelven Yang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14084/#review26056
---


Darren, I saw you added the annotation for group of events and annotated in 
various places, is there any test done for the business logic validation? 

- Kelven Yang


On Sept. 11, 2013, 5:07 p.m., Darren Shepherd wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14084/
> ---
> 
> (Updated Sept. 11, 2013, 5:07 p.m.)
> 
> 
> Review request for cloudstack, Kelven Yang and Kishan Kavala.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Two fields were added to CallContext to allow call to dynamically change
> the event type and description.  Additionally a @ActionEvents annotation
> was added to allow a method to specify multiple events
> 
> Spring AOP will not intercept calls to "this" so @ActionEvent needs to be
> put on public methods that are externally invoked
> 
> Annotations that needed to be changed were identified by doing byte code 
> analysis using objectweb asm.  Code for that is at 
> https://github.com/ibuildthecloud/cloudstack-findbadactionevents and there
> are instructions to run it there.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/event/ActionEvents.java PRE-CREATION 
>   api/src/org/apache/cloudstack/context/CallContext.java 
> e3c1bf2a7b97573cdeb4f530d0afe74cb7e3e834 
>   engine/components-api/src/com/cloud/configuration/ConfigurationManager.java 
> 6e76b6ffb91c200127589831893d9d79970aafdb 
>   engine/components-api/src/com/cloud/network/rules/FirewallManager.java 
> fa12cd804a67138740f9d9042709938871dc8629 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 
> fb727a1705487416b7069fc2aca5086fd726e700 
>   server/src/com/cloud/event/ActionEventInterceptor.java 
> ba7e270af90f7bc191b570a7cc131319f446e2f6 
>   server/src/com/cloud/event/ActionEventUtils.java 
> 60f5633fc3c53dac960247308de12b60b492de59 
>   server/src/com/cloud/network/firewall/FirewallManagerImpl.java 
> cd83c4e52f85adc9c9d9c7997c28838f2c15b323 
>   server/src/com/cloud/server/ManagementServerImpl.java 
> a3efd2129ce082023d79e55872e8134d1b6bd85c 
>   server/src/com/cloud/user/AccountManagerImpl.java 
> 0602514fcf429b09a62edf65f4b0dc0e87d80b94 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 
> c3a718ac55be05f123b062a627c2de042c4321ab 
>   server/test/com/cloud/network/MockFirewallManagerImpl.java 
> c50459e98737eaf5662bb44c6e9a12fad54b4175 
>   server/test/com/cloud/vpc/MockConfigurationManagerImpl.java 
> 3ec146b953726c9480b1e15848a67e4746dd65a6 
> 
> Diff: https://reviews.apache.org/r/14084/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Darren Shepherd
> 
>

RE: Marvin tests for VPC - why create VPC offering?

[Sowmya Krishnan]

But we don't have an option to choose these service providers with 
createVPCOffering. It's always VPC VR. If let's say, I want to create a VPC 
Offering with LB as NS and say, the following services only: DNS, DHCP and 
SourceNat - it isn't possible.. However this mapping *is* being done internally 
as can be seen from vpc_offering_service_map table.
So providing flexibility to create a VPC but without the ability to choose 
providers is confusing and perhaps limiting in a way?

> -Original Message-
> From: Alena Prokharchyk
> Sent: Thursday, September 12, 2013 10:54 PM
> To: dev@cloudstack.apache.org; Sowmya Krishnan
> Cc: Venkata SwamyBabu Budumuru
> Subject: Re: Marvin tests for VPC - why create VPC offering?
> 
> 
> On 9/12/13 10:12 AM, "Rajesh Battala"  wrote:
> 
> >My observations are
> >1. VPC offering is to tell what are all the services can be available
> >if you create tiers in the vpc.
> 
> Correct
> 
> >2. There should be some default providers for each service.(but
> >currently its only VpcVR). Or set of providers for each service it can 
> >provider.
> >When vpc_network_offering is created, when this network is getting
> >implemented inside this vpc and those services/service providers are
> >validated against what are the services/providers can be provided.
> 
> 
> Only VPC VR/NS/Internal LB vm are supported as VPC providers
> 
> 
> >
> >I feel while creating "VPC_Offering" flexibility should be provided  at
> >VPC level  such that what are the services provided and possible
> >service providers.
> >But currently there only only 3 possible providers one is VPcVR and
> >Netscaler(only for External LB) and internalLB Provider.
> >
> >As there are fixed set of providers and the possible combination of VPC
> >services offerings are created by default we should be using them to
> >create a VPC.
> >
> >If user wants to create a new VPC offering it will become a copy of the
> >existing VPC offering because possible VPC offerings are created by
> >VPCManager.
> 
> Only Admin can create a VPC offering. And this offering doesn't become a copy.
> >
> >Thanks
> >Rajesh Battala
> >
> >-Original Message-
> >From: Sowmya Krishnan
> >Sent: Thursday, September 12, 2013 8:13 PM
> >To: dev@cloudstack.apache.org
> >Cc: Rajesh Battala; Venkata SwamyBabu Budumuru
> >Subject: RE: Marvin tests for VPC - why create VPC offering?
> >
> >
> >> -Original Message-
> >> From: Prasanna Santhanam [mailto:t...@apache.org]
> >> Sent: Thursday, September 12, 2013 11:55 AM
> >> To: dev@cloudstack.apache.org
> >> Cc: Rajesh Battala; Venkata SwamyBabu Budumuru
> >> Subject: Re: Marvin tests for VPC - why create VPC offering?
> >>
> >> See inline, there seems to be a bug in the design.
> >>
> >> On Thu, Sep 12, 2013 at 05:53:45AM +, Sowmya Krishnan wrote:
> >> > > -Original Message-
> >> > > From: Prasanna Santhanam [mailto:t...@apache.org]
> >> > > Sent: Thursday, September 12, 2013 11:07 AM
> >> > > To: dev@cloudstack.apache.org
> >> > > Subject: Re: Marvin tests for VPC - why create VPC offering?
> >> > >
> >> > > On Thu, Sep 12, 2013 at 05:15:16AM +, Sowmya Krishnan wrote:
> >> > > > I find for most of the VPC tests we create a new VPC Offering
> >> > > > which provides almost the same set of services as the "Default
> >> > > > VPC
> >> Offering"
> >> > > > already available by default. We also have a separate function
> >> > > > to create this offering, enabling it and then create a VPC
> >> > > > using this offering. I wonder why do we have to create vpc
> >> > > > offerings for each test suite. Also, we don't expose create VPC
> >> > > > offering in
> >>the UI.
> >> > > > We do have an API for that, but I think we should just stick to
> >> > > > the default ones available and then create network offerings as
> >> > > > required for the test.
> >> > > >
> >> > >
> >> > > Personally, I don't see the harm in that since any offering is
> >> > > lightweight. I prefer every test create it's own set of resources
> >> > > from scratch if possible. Today we don't track the trail of
> >> > > resources that are
> >> created by a test but we will do that.
> >> > > That should help with cleanup and audit.
> >> > >
> >> > > Do you see a problem though?
> >> >
> >> > I feel It's just redundant. API is anyway tested as part of the
> >> > other test - test_vpc_offerings.
> >>
> >> Yeah DRY is a good reason to make the test simpler. I don't have an
> >> opinion either way.
> >>
> >> > Problem I encounter is, when we try to create a VPC offering, we
> >> > don't have the option of choosing the service provider. So by
> >> > default, all services will be provided by VPCVR.
> >>
> >> The vpcOffering API only provides a service list which means it
> >>shouldn't map to a provider list. If it did, then there's some magic
> >>happening in the background.
> >>
> >> > Now, when I try to create a VPC offering with NS as external LB
> >> > provider, that's not possible through the API. I have to use the
> >> > 

RE: plain text authenticator

[Rajesh Battala]

It's not a good idea to iterate on all authenticators, if the real 
authenticator fails for some reason( if it's not able to handle some exception 
properly) it will continue on invalid authenticators and may result in wrong 
value/result.

Thanks
Rajesh Battala
-Original Message-  
From: Ian Duffy [mailto:i...@ianduffy.ie] 
Sent: Friday, September 13, 2013 2:52 AM
To: CloudStack Dev
Subject: Re: plain text authenticator

> Don't authenticators work as plugins in cloudstack with plain text
authenticator as default? I think we should leave it for the customer to decide 
whether he wants to disable or keep the authenticator

Couldn't agree more with this! Going through each authenticator until a 
successful result is found is horrible!


On 12 September 2013 19:09, Frank Zhang  wrote:

> Are all authentication plugins loaded by default and working in an 
> authentication chain?
> Otherwise why should we keep the hash type in DB?
>
> > -Original Message-
> > From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com]
> > Sent: Thursday, September 12, 2013 9:56 AM
> > To: dev@cloudstack.apache.org
> > Subject: plain text authenticator
> >
> > So if you set your password as blah and it gets hashed to xyz and 
> > stored
> in the
> > users table.  Because of the plain text authenticator, you can use 
> > that
> hashed
> > value as your password now.  So specifically the below will work.
> >
> > http://localhost:8080/client/api?command=login&username=user&passwor
> > d=b
> > lah
> >
> > http://localhost:8080/client/api?command=login&username=user&passwor
> > d=x
> > yz
> >
> > This seems bad.  Go and try it yourself (just be careful about URL
> encoding,  +
> > should be %2b).  So because of the existence of the plain text
> authenticator,
> > passwords are still plain text but they just happen to be long 
> > random
> strings.
> > Typically in an auth system you store the hashing type with the 
> > hashed
> value.
> > So then the plain text authenticator would not even attempt to 
> > compare
> values
> > because it would see the value was hashed by a different authenticator.
> >
> > Darren
>

Re: plain text authenticator

[Ian Duffy]

> Don't authenticators work as plugins in cloudstack with plain text
authenticator as default? I think we should leave it for the customer to
decide whether he wants to disable or keep the authenticator

Couldn't agree more with this! Going through each authenticator until a
successful result is found is horrible!


On 12 September 2013 19:09, Frank Zhang  wrote:

> Are all authentication plugins loaded by default and working in an
> authentication chain?
> Otherwise why should we keep the hash type in DB?
>
> > -Original Message-
> > From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com]
> > Sent: Thursday, September 12, 2013 9:56 AM
> > To: dev@cloudstack.apache.org
> > Subject: plain text authenticator
> >
> > So if you set your password as blah and it gets hashed to xyz and stored
> in the
> > users table.  Because of the plain text authenticator, you can use that
> hashed
> > value as your password now.  So specifically the below will work.
> >
> > http://localhost:8080/client/api?command=login&username=user&password=b
> > lah
> >
> > http://localhost:8080/client/api?command=login&username=user&password=x
> > yz
> >
> > This seems bad.  Go and try it yourself (just be careful about URL
> encoding,  +
> > should be %2b).  So because of the existence of the plain text
> authenticator,
> > passwords are still plain text but they just happen to be long random
> strings.
> > Typically in an auth system you store the hashing type with the hashed
> value.
> > So then the plain text authenticator would not even attempt to compare
> values
> > because it would see the value was hashed by a different authenticator.
> >
> > Darren
>

RE: Creating an instance with ssh key pair

[Sanjeev Neelarapu]

Hi Gaurav,

SSH to vm using keyPairFileLocation is template dependent .ie. template must 
have the script as mentioned in the doc.

Thanks,
Sanjeev

-Original Message-
From: Gaurav Aradhye [mailto:gaurav.arad...@clogeny.com] 
Sent: Thursday, September 12, 2013 5:30 PM
To: dev@cloudstack.apache.org
Subject: Creating an instance with ssh key pair

Hello all,

If I create an instance providing ssh key pair while creation, and using a 
"normal template" from the cloudstack setup, then will the SSH to vm using the 
keyPairFlieLocation always work?

Or the template which I am using for creating the instance has to be supporting 
SSH keys? as explained in 5.2.1 section at 
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.2/html/Installation_Guide/using-sshkeys.html

In short, Is the SSH using keyPairFileLocation -  template dependent or will it 
always work if I provide ssh key pair while creating instance and use normal 
template?

Regards,
Gaurav

listAccounts filter by name

[Ian Duffy]

Hi,

Does the given scenario reflect expected functionality?


I am an admin user
I create an account with 1 user, lets call the account example and the user
example.
I query listAccounts with parameter listAll, all accounts are returned
including the one I just created.
I query listAccounts with parameter name and value admin, the admin account
is returned.
I query listAccounts with parameter name and value example, no accounts are
returned.

Should the last query not return the example account I created?
Query by ID appears to work as *I* expected and returned the account
information of the given ID.

Re: listAccounts filter by name

[Ian Duffy]

Went and looked at the source.
Due to same account names across different domains a domain id must be
specified before it will filter by name.


On 13 September 2013 06:16, Ian Duffy  wrote:

> Hi,
>
> Does the given scenario reflect expected functionality?
>
>
> I am an admin user
> I create an account with 1 user, lets call the account example and the
> user example.
> I query listAccounts with parameter listAll, all accounts are returned
> including the one I just created.
> I query listAccounts with parameter name and value admin, the admin
> account is returned.
> I query listAccounts with parameter name and value example, no accounts
> are returned.
>
> Should the last query not return the example account I created?
> Query by ID appears to work as *I* expected and returned the account
> information of the given ID.
>
>
>

what wrong? start cloudstack

[黑洞]

when I execut "mvn -pl :cloud-client-ui jetty:run"
hava follow exception:


 ERROR [web.context.ContextLoader] (main:) Context initialization failed
org.springframework.beans.factory.BeanCreationException: Error creating bean 
with name 'niciraNvpDaoImpl' defined in class path resource 
[componentContext.xml]: BeanPostProcessor before instantiation of bean failed; 
nested exception is net.sf.cglib.core.CodeGenerationException: 
java.lang.reflect.InvocationTargetException-->null
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:452)
at 
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at 
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at 
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at 
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at 
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:609)
at 
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:918)
at 
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:469)
at 
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:383)
at 
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at 
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at 
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:549)




what Wrong?


Thanks













 

云计算基础架构师
Github:https://github.com/heidsoftWeibo: http://weibo.com/liuganbin
研究方向：云计算（云安全）、大数据（数据处理分析）
主要学习: Linux / C / C++ / JAVA
Email:heids...@sina.com
Tell:18601706743











某云计算公司





Jake.liu@heidsoft黑洞




云计算系统架构师








   840608792





heidso...@gmail.com





 weibo.com/liuganbin





 上海 徐汇区












名片二维码












- 原始邮件 -
发件人：Mike Tutkowski 
收件人："dev@cloudstack.apache.org" 
抄送人：Amit Das 
主题：Re: Which DevCloud2 Usage Mode is good for Development and Debugging 
日期：2013年09月13日 07点33分

Re: Missing dependency not listed in docs for 4.1.1

[Prasanna Santhanam]

On Thu, Sep 12, 2013 at 05:59:00PM +0100, Tony Stevenson wrote:
> Aloha, 
> 
> I'm just following -
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/pdf/Installation_Guide/Apache_CloudStack-4.1.1-Installation_Guide-en-US.pdf
> to install CS for the first time on Ubuntu 12.0.4. 
> 
> All has gone well, aside from the docs have missed on dependency. You
> just need to install jsvc too. This only becomes apparent once you start
> trying to install the resulting build .deb's. 

Thanks, I'll fix the docs for the dependency. I see CLOUDSTACK-78 [1]
that should've become a doc bug for rpms. But I'm not sure whether you
faced this issue when installing the agent or the management server.
Could you file a bug report for docs?

> 
> Keep up the good work folks. FWIW this evaluation is for both the ASF to
> consider using it, and my other employer lib.cam.ac.uk 

Awesome. This is great news! Hopefully we'll have more insight into
operational aspects of CloudStack from within the ASF too.

> 
>  
> -- 
[1] https://issues.apache.org/jira/browse/CLOUDSTACK-78
> Cheers,
> Tony
> 
> --
> Tony Stevenson
> 
> t...@pc-tony.com
> pct...@apache.org
> 
> http://www.pc-tony.com
> 
> GPG - 1024D/51047D66
> --
> 

-- 
Prasanna.,


Powered by BigRock.com

Re: Q's about UserAuthenticators and getName()

[Ian Duffy]

> So my problem is that LDAP currently has a null name on getName().  So
which should I do?  Add

Go ahead and add it. I missed that override in error.

run cloustack have a exeception

[黑洞]

INFO  [utils.component.ComponentContext] (Timer-2:) Configuring 
com.cloud.server.ConfigurationServerImpl_EnhancerByCloudStack_e2a1f0b0
INFO  [cloud.server.ConfigurationServerImpl] (Timer-2:) Processing 
updateSSLKeyStore
INFO  [cloud.server.ConfigurationServerImpl] (Timer-2:) SSL keystore located at 
D:\clouddevelop\cloudstack-repo-debug\cloudstack\client\target\cloud-client-ui-4.2.0-SNAPSHOT\WEB-INF\classes/cloud.keystore
WARN  [utils.script.Script] (Timer-2:) Exception: sudo keytool -genkey 
-keystore 
D:\clouddevelop\cloudstack-repo-debug\cloudstack\client\target\cloud-client-ui-4.2.0-SNAPSHOT\WEB-INF\classes/cloud.keystore
 -storepass vmops.com -keypass vmops.com -keyalg RSA -validity 3650 -dname 
cn="Cloudstack User",ou="TYX-020",o="TYX-020",c="Unknown"
java.io.IOException: Cannot run program "sudo": CreateProcess error=2, ?
at java.lang.ProcessBuilder.start(ProcessBuilder.java:460)
at com.cloud.utils.script.Script.execute(Script.java:183)
at com.cloud.utils.script.Script.execute(Script.java:161)
at 
com.cloud.server.ConfigurationServerImpl.generateDefaultKeystore(ConfigurationServerImpl.java:487)
at 
com.cloud.server.ConfigurationServerImpl.updateSSLKeystore(ConfigurationServerImpl.java:510)
at 
com.cloud.server.ConfigurationServerImpl.persistDefaultValues(ConfigurationServerImpl.java:272)
at 
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at 
com.cloud.server.ConfigurationServerImpl.configure(ConfigurationServerImpl.java:148)
at 
com.cloud.utils.component.ComponentContext.initComponentsLifeCycle(ComponentContext.java:111)
at 
com.cloud.servlet.CloudStartupServlet$1.run(CloudStartupServlet.java:50)
at java.util.TimerThread.mainLoop(Timer.java:512)
at java.util.TimerThread.run(Timer.java:462)
Caused by: java.io.IOException: CreateProcess error=2, ?
at java.lang.ProcessImpl.create(Native Method)
at java.lang.ProcessImpl.(ProcessImpl.java:81)
at java.lang.ProcessImpl.start(ProcessImpl.java:30)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)
... 15 more














 

云计算基础架构师
Github:https://github.com/heidsoftWeibo: http://weibo.com/liuganbin
研究方向：云计算（云安全）、大数据（数据处理分析）
主要学习: Linux / C / C++ / JAVA
Email:heids...@sina.com
Tell:18601706743











某云计算公司





Jake.liu@heidsoft黑洞




云计算系统架构师








   840608792





heidso...@gmail.com





 weibo.com/liuganbin





 上海 徐汇区












名片二维码

createVPCOffering (Was:RE: Marvin tests for VPC - why create VPC offering?)

[Sowmya Krishnan]

But we don't have an option to choose service providers with createVPCOffering. 
It's always VPC VR for all services. If let's say, I want to create a VPC 
Offering with LB as Netscaler and say, the following services only: DNS, DHCP 
and SourceNat - it isn't possible from the API.. However this mapping *is* 
being done internally as can be seen from vpc_offering_service_map table.
So providing flexibility to create a VPC with chosen set to services but 
without the ability to choose providers is confusing and perhaps limiting in a 
way?

On the other hand, I am wondering what is the use case for exposing 
createVPCOffering at all? Can we not stick to the default offerings of VPC 
already provided?

> -Original Message-
> From: Alena Prokharchyk
> Sent: Thursday, September 12, 2013 10:54 PM
> To: dev@cloudstack.apache.org; Sowmya Krishnan
> Cc: Venkata SwamyBabu Budumuru
> Subject: Re: Marvin tests for VPC - why create VPC offering?
> 
> 
> On 9/12/13 10:12 AM, "Rajesh Battala"  wrote:
> 
> >My observations are
> >1. VPC offering is to tell what are all the services can be available
> >if you create tiers in the vpc.
> 
> Correct
> 
> >2. There should be some default providers for each service.(but
> >currently its only VpcVR). Or set of providers for each service it can 
> >provider.
> >When vpc_network_offering is created, when this network is getting
> >implemented inside this vpc and those services/service providers are
> >validated against what are the services/providers can be provided.
> 
> 
> Only VPC VR/NS/Internal LB vm are supported as VPC providers
> 
> 
> >
> >I feel while creating "VPC_Offering" flexibility should be provided  at
> >VPC level  such that what are the services provided and possible
> >service providers.
> >But currently there only only 3 possible providers one is VPcVR and
> >Netscaler(only for External LB) and internalLB Provider.
> >
> >As there are fixed set of providers and the possible combination of VPC
> >services offerings are created by default we should be using them to
> >create a VPC.
> >
> >If user wants to create a new VPC offering it will become a copy of the
> >existing VPC offering because possible VPC offerings are created by
> >VPCManager.
> 
> Only Admin can create a VPC offering. And this offering doesn't become a copy.
> >
> >Thanks
> >Rajesh Battala
> >
> >-Original Message-
> >From: Sowmya Krishnan
> >Sent: Thursday, September 12, 2013 8:13 PM
> >To: dev@cloudstack.apache.org
> >Cc: Rajesh Battala; Venkata SwamyBabu Budumuru
> >Subject: RE: Marvin tests for VPC - why create VPC offering?
> >
> >
> >> -Original Message-
> >> From: Prasanna Santhanam [mailto:t...@apache.org]
> >> Sent: Thursday, September 12, 2013 11:55 AM
> >> To: dev@cloudstack.apache.org
> >> Cc: Rajesh Battala; Venkata SwamyBabu Budumuru
> >> Subject: Re: Marvin tests for VPC - why create VPC offering?
> >>
> >> See inline, there seems to be a bug in the design.
> >>
> >> On Thu, Sep 12, 2013 at 05:53:45AM +, Sowmya Krishnan wrote:
> >> > > -Original Message-
> >> > > From: Prasanna Santhanam [mailto:t...@apache.org]
> >> > > Sent: Thursday, September 12, 2013 11:07 AM
> >> > > To: dev@cloudstack.apache.org
> >> > > Subject: Re: Marvin tests for VPC - why create VPC offering?
> >> > >
> >> > > On Thu, Sep 12, 2013 at 05:15:16AM +, Sowmya Krishnan wrote:
> >> > > > I find for most of the VPC tests we create a new VPC Offering
> >> > > > which provides almost the same set of services as the "Default
> >> > > > VPC
> >> Offering"
> >> > > > already available by default. We also have a separate function
> >> > > > to create this offering, enabling it and then create a VPC
> >> > > > using this offering. I wonder why do we have to create vpc
> >> > > > offerings for each test suite. Also, we don't expose create VPC
> >> > > > offering in
> >>the UI.
> >> > > > We do have an API for that, but I think we should just stick to
> >> > > > the default ones available and then create network offerings as
> >> > > > required for the test.
> >> > > >
> >> > >
> >> > > Personally, I don't see the harm in that since any offering is
> >> > > lightweight. I prefer every test create it's own set of resources
> >> > > from scratch if possible. Today we don't track the trail of
> >> > > resources that are
> >> created by a test but we will do that.
> >> > > That should help with cleanup and audit.
> >> > >
> >> > > Do you see a problem though?
> >> >
> >> > I feel It's just redundant. API is anyway tested as part of the
> >> > other test - test_vpc_offerings.
> >>
> >> Yeah DRY is a good reason to make the test simpler. I don't have an
> >> opinion either way.
> >>
> >> > Problem I encounter is, when we try to create a VPC offering, we
> >> > don't have the option of choosing the service provider. So by
> >> > default, all services will be provided by VPCVR.
> >>
> >> The vpcOffering API only provides a service list which means it
> >>shouldn't map to a provider list.

Re: Problem with cloud.storage_pool's used_bytes

[Wei ZHOU]

Mike,
it is  already fixed in master and 4.2-forward branch.
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=7bff499bd3625f8a75a1c93cb9e3e2c90955df5e


2013/9/13 Mike Tutkowski 

> Hi,
>
> I just set up a single zone with one KVM host using master.
>
> My CPVM and SSVM are up and running nicely.
>
> When I look at the storage_pool table, however, I'm concerned with what I
> see for the used_bytes field: 18,218,356,736 (below). This seems way too
> large (almost consuming all of the local space on my KVM host). I wonder if
> this isn't instead available_bytes. I believe available_bytes was changed
> to used_bytes in 4.2 and it looks like this may not be working properly in
> this scenario.
>
> Thoughts?
>
> Thanks!
>
> 1 ubuntu Local Storage a4f6428e-8cfd-41f8-b755-b177ad0315f3 Filesystem 0 1
> 1
> 1 18218356736 20332810240 192.168.233.10 /var/lib/libvirt/images 2013-09-13
> 00:47:39 Up DefaultPrimary HOST 0
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the
> cloud
> *™*
>

Re: Problem with cloud.storage_pool's used_bytes

[Wei ZHOU]

sorry, the url is
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=5c141a46fc3f684fd633d8b1b18f708bcff4


2013/9/13 Wei ZHOU 

> Mike,
> it is  already fixed in master and 4.2-forward branch.
>
> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=7bff499bd3625f8a75a1c93cb9e3e2c90955df5e
>
>
> 2013/9/13 Mike Tutkowski 
>
>> Hi,
>>
>> I just set up a single zone with one KVM host using master.
>>
>> My CPVM and SSVM are up and running nicely.
>>
>> When I look at the storage_pool table, however, I'm concerned with what I
>> see for the used_bytes field: 18,218,356,736 (below). This seems way too
>> large (almost consuming all of the local space on my KVM host). I wonder
>> if
>> this isn't instead available_bytes. I believe available_bytes was changed
>> to used_bytes in 4.2 and it looks like this may not be working properly in
>> this scenario.
>>
>> Thoughts?
>>
>> Thanks!
>>
>> 1 ubuntu Local Storage a4f6428e-8cfd-41f8-b755-b177ad0315f3 Filesystem 0
>> 1 1
>> 1 18218356736 20332810240 192.168.233.10 /var/lib/libvirt/images
>> 2013-09-13
>> 00:47:39 Up DefaultPrimary HOST 0
>>
>>
>>
>> --
>> *Mike Tutkowski*
>> *Senior CloudStack Developer, SolidFire Inc.*
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the
>> cloud
>> *™*
>>
>
>

Review Request 14119: Default null value in ConfigKey results in NPE on second start

[Darren Shepherd]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14119/
---

Review request for cloudstack and Alex Huang.


Repository: cloudstack-git


Description
---

If your ConfigKey has a default value, the second start of the mgmt server will 
result in a NPE when comparing if the persisted default should be updated

java.lang.NullPointerException
at 
org.apache.cloudstack.framework.config.impl.ConfigDepotImpl.populateConfigurations(ConfigDepotImpl.java:103)
at 
com.cloud.server.ConfigurationServerImpl.persistDefaultValues(ConfigurationServerImpl.java:294)
at 
com.cloud.server.ConfigurationServerImpl.configure(ConfigurationServerImpl.java:147)


Diffs
-

  
framework/config/src/org/apache/cloudstack/framework/config/impl/ConfigDepotImpl.java
 b516596 

Diff: https://reviews.apache.org/r/14119/diff/


Testing
---


Thanks,

Darren Shepherd

RE: Volunteers to Complete the 4.2 Release Notes

[Radhika Puthiyetath]

Who is volunteering to provide the list of Fixed issues for the RN?

-Original Message-
From: Animesh Chaturvedi [mailto:animesh.chaturv...@citrix.com] 
Sent: Wednesday, August 28, 2013 4:40 AM
To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
Subject: RE: Volunteers to Complete the 4.2 Release Notes

Community help is needed to fix up the release notes, any volunteers

Animesh

> -Original Message-
> From: Radhika Puthiyetath [mailto:radhika.puthiyet...@citrix.com]
> Sent: Tuesday, August 13, 2013 1:01 AM
> To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
> Subject: Volunteers to Complete the 4.2 Release Notes
> 
> Hi,
> 
> Looking for volunteers to help me with the 4.2 Release Notes.
> 
> I have started filling in the new feature section, and checked in to the
> 4.2 branch.
> 
> A defect is filed https://issues.apache.org/jira/browse/CLOUDSTACK-4245.
> 
> Thanks for the help
> -Radhika

ConfigDepot and null values and defaults

[Darren Shepherd]

If you have a configuration that the value is null and not dynamic, it 
still hits the database on every read.  I'm thinking that's really not 
intentional.


Additionally, if I have a key that is default value is 5, then I later 
change the default to 10.  If the user never changed or set the value, I 
still get 5.  So this is where I kind of disagree with the implementation.


What I'd ideally like to see is that only when a value is explicitly 
changed do we ever persist an entry to the configuration table.  Now I 
know that doesn't work with the current code as everything just hits the 
ConfigurationDao, but ideally I'd like to see it that way.  With the 
current implementation we have no way of really knowing of the field 
which were changed by somebody.


What I'd like to get to is that we can have a config page sort of like 
about:config in firefox.  In firefox there is a "status" column that is 
"default" or "user set".  So as a user I know all the crap I changed, 
and easily I can revert to the defaults.


So if we stick with the current implementation where we throw everything 
in the DB (which I assume we will), then maybe we should have a column 
for "user set."


And also randomly, why is updated column == null mean that its obsolete? 
 I don't see any code to handle that, just the column description.


Darren

com.cloud.ha.RecreatableFencer used?

[Darren Shepherd]

com.cloud.ha.RecreatableFencer is registered in applicationContext.xml 
but never in a componentContext.xml.  So it appears that fencer is never 
used.  Is there a specific reason for this?


Darren

Re: Security Groups

[Jayapal Reddy Uradi]

Hi,

Can you please share your security group rules 'iptables -L -nv' output in 
pastebin
So that see why it is happening.

Thanks,
Jayapal
On 13-Sep-2013, at 9:25 AM, Jijun 
 wrote:

> hi , i encounter the same problem,
> 
> as i know, XenServer 6.2 need not  the CSP.
> 
> but the ingress not be blocked by default. i can ping all the Vms in that 
> security group.
> 
> i don't know why?
> 
> Thanks.
> 
> On 09/13/2013 02:02 AM, Michael Phillips wrote:
>> So that is definitely going to be the issue. I missed that in the 8.2.7 
>> section of the install guide.
>> 
>>> From: sangeetha.hariha...@citrix.com
>>> To: dev@cloudstack.apache.org
>>> Subject: RE: Security Groups
>>> Date: Thu, 12 Sep 2013 17:19:16 +
>>> 
>>> If you are using Xenserver hosts , can you make sure you have the CSP 
>>> packages installed?
>>> 
>>> -Thanks
>>> Sangeetha
>>> 
>>> -Original Message-
>>> From: Michael Phillips [mailto:mphilli7...@hotmail.com]
>>> Sent: Thursday, September 12, 2013 9:33 AM
>>> To: dev@cloudstack.apache.org
>>> Subject: Security Groups
>>> 
>>> I posed this question in the user list, but I figured I would throw it out 
>>> here as well...So If I have created a zone with the 
>>> "DefaultSharedNetworkOfferingWithSGService" network offering, then created 
>>> a VM using the default security group, which has 0 ingress rules, I should 
>>> NOT be able to do things like PING that VM correct? The answer to the above 
>>> question was answered "correct"...My next question is, in that case what 
>>> are some things I could look at to see why it's not behaving as expected.
>>> 
>>  
> 
> 
> -- 
> Thanks,
> Jijun
> 

RE: win7+cygwin+cloudstack having a problem

[Donal Lafferty]

Build problem?

Let me explain:

Bean definitions cross reference .class files, e.g.

Administrator@cc-svr10 ~/github/cifs
$ grep -R iciraNvpDaoImpl * --include=*.xml.in
cloudstack/client/tomcatconf/componentContext.xml.in:  
cloudstack/client/tomcatconf/nonossComponentContext.xml.in:  


Notice I’m using .xml.in above.   The build copies these files and changes 
their extension to .xml

Next, check that the bean’s class has been deployed to the folder that Jetty 
will use, e.g.

Administrator@cc-svr10 ~/github/cifs
$ grep -R "iciraNvpDaoImpl\.class" *
Binary file 
cloudstack/client/target/cloud-client-ui-4.3.0-SNAPSHOT/WEB-INF/lib/cloud-plugin-network-nvp-4.3.0-SNAPSHOT.jar
 matches
Binary file cloudstack/client/target/cloud-client-ui-4.3.0-SNAPSHOT.war matches
Binary file 
cloudstack/plugins/network-elements/nicira-nvp/target/cloud-plugin-network-nvp-4.3.0-SNAPSHOT.jar
 matches


If you don’t see any matches, then the command you used to build may be for an 
older version of CloudStack. :(

This happens whenever we improve the build, because build updates are not 
backwards compatible.

If you are using the Windows Development instructions 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Setting+up+a+CloudStack+dev+environment+on+Windows
 , take a look at the update just I made to “Step 13) Build”.

If you have similar problems in the future, take a look at the most up to date 
build instructions, which are at 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack

DL




From: 黑洞 [mailto:heids...@sina.com]
Sent: 13 September 2013 02:38
To: dev
Subject: win7+cygwin+cloudstack having a problem

I am according to the github cloudstack source code for INSTANL.md
1、cygwin is goode
2、database is goode
3、mvn -pl :cloud-client-ui jetty:run
exception detail:
lassPostProcessor$ImportAwareBeanPostProcessor#0]; root of factory hierarchy
ERROR [web.context.ContextLoader] (main:) Context initialization failed
org.springframework.beans.factory.BeanCreationException: Error creating bean 
with name 'niciraNvpDaoImpl' defined in class path resource 
[componentContext.xml]: BeanPostProcessor before instantiation of bean failed; 
nested exception is net.sf.cglib.core.CodeGenerationException: 
java.lang.reflect.InvocationTargetException-->null
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:452)
at 
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at 
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at 
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at 
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at 
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:609)
at 
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:918)

what wrong?

Thanks

云计算基础架构师
Github:https://github.com/heidsoft
Weibo: http://weibo.com/liuganbin
研究方向：云计算（云安全）、大数据（数据处理分析）
主要学习: Linux / C / C++ / JAVA /Python
Email:heids...@sina.com
Tell:18601706743

Re: Review Request 11626: Automation: Memory limits tests from Resource Limits Tests

[sailaja mada]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11626/#review26076
---

Ship it!


Ship It!

- sailaja mada


On Sept. 12, 2013, 10:19 a.m., Gaurav Aradhye wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11626/
> ---
> 
> (Updated Sept. 12, 2013, 10:19 a.m.)
> 
> 
> Review request for cloudstack, sailaja mada, Sanjay Tripathi, and Prasanna 
> Santhanam.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Adding resource limit tests related to Memory. Changes suggested in CPU 
> resource limit tests which are applicable here are incorporated too.
> 
> Updated test plan is available here: 
> https://cwiki.apache.org/confluence/download/attachments/30757590/LimitResourcesTestPlanUpdate5.xlsx?version=1&modificationDate=1366952352000
> 
> 
> Diffs
> -
> 
>   test/integration/component/memory_limits/test_domain_limits.py PRE-CREATION 
>   test/integration/component/memory_limits/test_maximum_limits.py 
> PRE-CREATION 
>   test/integration/component/memory_limits/test_memory_limits.py PRE-CREATION 
>   test/integration/component/memory_limits/test_project_limits.py 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/11626/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Gaurav Aradhye
> 
>

Re: Which DevCloud2 Usage Mode is good for Development and Debugging ????

[Punith s]

hi guys ,

thanks a lot for the info , you guys are right , now i'm using #*3.host
only mode *in devcloud2 , and i'm able to debug the MS from
eclipse seamlessly in my localhost.
and mike if you have such problems then you can try *full sandbox mode *in
devcloud2 and connect to it remotely from eclipse by giving the ip of the
MS (192.168.56.10) , but again it's pretty uncomfortable having everything
inside devcloud  but anyway its good to try new ways if things work , like
how i switched from fullsandbox to host only mode. thanks again

regards,
punith s
cloudbyte


On Fri, Sep 13, 2013 at 5:03 AM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> Here is a relevant link:
>
> https://cwiki.apache.org/CLOUDSTACK/using-eclipse-with-cloudstack.html
>
> The part at the bottom:
>
> Remote Debugging
>
> You can use Eclipse to attach to the Management Server and debug
> CloudStack. You setup a Remote Debug Session (Run > Debug Configuration),
> connect to Port 8787. Typically you would use the project you want to debug
> as the target and include other projects that you need to debug, e.g.
> cloud-agent, cloud-api, cloud-core and cloud-server.
>
> **
>
> Currently I am having trouble in 4.3 with remote debugging. I'm not sure
> why.
>
> I have my Remote Java Application configured and running. It connects to
> the CloudStack Management Server.
>
> I set a breakpoint and execute some logic on the front end that should hit
> this breakpoint on the back end, but it doesn't break.
>
>
>
> On Thu, Sep 12, 2013 at 12:41 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
> > I should have been a bit more specific.
> >
> > Once you do what I wrote in my previous e-mail, then run your management
> > server.
> >
> > Then run your Remote Java Application and set breakpoints.
> >
> >
> > On Thu, Sep 12, 2013 at 12:27 PM, Mike Tutkowski <
> > mike.tutkow...@solidfire.com> wrote:
> >
> >> If you want to debug remotely, run the CloudStack Management Server with
> >> an environment variable such as the following:
> >>
> >> MAVEN_OPTS=-XX:MaxPermSize=512m -Xmx1024m -Xdebug
> >> -Xrunjdwp:transport=dt_socket,address=8787,server=y,suspend=n
> >>
> >> Then in Eclipse, go to Debug Configurations and create a new Remote Java
> >> Application.
> >>
> >> Browse and select cloud-server for the Project field.
> >>
> >> Enter you IP address for the Host field.
> >>
> >> Assuming you used 8787 in MAVEN_OPTS, use 8787 for the Port field.
> >>
> >> You may now run your management server and set breakpoints as need be.
> >>
> >>
> >> On Thu, Sep 12, 2013 at 12:19 PM, Mike Tutkowski <
> >> mike.tutkow...@solidfire.com> wrote:
> >>
> >>> I prefer #3, as well.
> >>>
> >>>
> >>> On Thu, Sep 12, 2013 at 10:09 AM, Chiradeep Vittal <
> >>> chiradeep.vit...@citrix.com> wrote:
> >>>
>  #3 works best, I think
> 
>  On 9/12/13 2:19 AM, "Punith s"  wrote:
> 
>  >hi folks,
>  >
>  >i'm using Devcloud2 to build cloudstack 4.2 , currently i'm using
> *full
>  >sandbox mode* ,
>  >
>  >devcloud allows following modes ,
>  >*1.full sandbox mode - *build and deploy inside devcloud
>  >*2.deployment mode - *build code in localhost and deploying in
> devcloud
>  >*3.host only mode - *using devcloud only as host
>  >
>  >
>  >which mode do you think its feasible for development and  interactive
>  >debugging ?
>  >can you elaborate more on setting up remote debugging in Devcloud2
>  >(fullsandbox mode) using eclipse ??
>  >
>  >thanks,
>  >punith s
> 
> 
> >>>
> >>>
> >>> --
> >>> *Mike Tutkowski*
> >>> *Senior CloudStack Developer, SolidFire Inc.*
> >>> e: mike.tutkow...@solidfire.com
> >>> o: 303.746.7302
> >>> Advancing the way the world uses the cloud<
> http://solidfire.com/solution/overview/?video=play>
> >>> *™*
> >>>
> >>
> >>
> >>
> >> --
> >> *Mike Tutkowski*
> >> *Senior CloudStack Developer, SolidFire Inc.*
> >> e: mike.tutkow...@solidfire.com
> >> o: 303.746.7302
> >> Advancing the way the world uses the cloud<
> http://solidfire.com/solution/overview/?video=play>
> >> *™*
> >>
> >
> >
> >
> > --
> > *Mike Tutkowski*
> > *Senior CloudStack Developer, SolidFire Inc.*
> > e: mike.tutkow...@solidfire.com
> > o: 303.746.7302
> > Advancing the way the world uses the cloud<
> http://solidfire.com/solution/overview/?video=play>
> > *™*
> >
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the
> cloud
> *™*
>

Review Request 14124: CLOUDSTACK-4622 : If a VM from guest network is added to network tier of VPC then IP reservation allows the CIDR to be a superset of Network CIDR for that VPC tier

[Saksham Srivastava]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14124/
---

Review request for cloudstack and Sateesh Chodapuneedi.


Bugs: CLOUDSTACK-4622


Repository: cloudstack-git


Description
---

Add a new utility method for comparing 2 CIDRs.
The method takes in 2 cidrs, cidrA and cidrB and returns true if cidrA's IP 
range is equal or a subset of cidrB's IP range.


Diffs
-

  server/src/com/cloud/network/NetworkServiceImpl.java 4169d42 
  utils/src/com/cloud/utils/net/NetUtils.java 05b485b 
  utils/test/com/cloud/utils/net/NetUtilsTest.java 3cfc98f 

Diff: https://reviews.apache.org/r/14124/diff/


Testing
---

Added unit test for the utility.
Tested locally.
Build is successful.
Patch applies cleanly.


Thanks,

Saksham Srivastava

Re: Review Request 14084: Updates to @ActionEvent to be compatible with Spring AOP

[Darren Shepherd]

> On Sept. 12, 2013, 5:28 p.m., Kelven Yang wrote:
> > Darren, I saw you added the annotation for group of events and annotated in 
> > various places, is there any test done for the business logic validation?

I added an annotation @ActionEvents and its used in only one place and that is 
on AccountManagerImpl.createUserAccount().  In general nested ActionEvents 
won't work with Spring AOP.  So previously createUserAccount had an 
@ActionEvent and that internally called createUser which also had an 
@ActionEvent.  With Spring AOP the second will not be called.  So the 
@ActionEvents is to specify that two events should be recorded for that method 
invocation.  

In general the whole concept of nesting actionevents is somewhat broken.  The 
eventDetails is stored on the CallContext which is a ThreadLocal.  There is 
only one of those, so as you nest the child's details override the parent's.  
This is how things already were.  I don't think the move to Spring AOP will be 
completely ideal for ActionEvents.  It limits some things you can do.  But I 
would argue that this whole ActionEvents framework should be reconcidered.  
Instead of all this ad-hoc based annotations and random strings of text the 
developers choose, a simple framework in the API can provide more precise and 
useful information for auditing.  Billing is not based off of ActionEvents and 
that information is far more accurate and useful too.  

To further illustrate the complete uselessness (in my opinion) of these events, 
if you reboot a VM, for example, you get an VM.REBOOT event that has a 
description "rebooting user vm: 7"  What is VM 7?  The user has no visibility 
to internal VM ids.

I tested all changes to ensure that the same events were fired as before.  
There was some exceptions though.  In some cases related to the firewall rule 
stuff you would make one change to a rule that would then fire an event for 
every single rule you had.  In situations like that, since nesting is a 
problem, I ensured the top level event was still properly recorded.


- Darren


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14084/#review26056
---


On Sept. 11, 2013, 5:07 p.m., Darren Shepherd wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14084/
> ---
> 
> (Updated Sept. 11, 2013, 5:07 p.m.)
> 
> 
> Review request for cloudstack, Kelven Yang and Kishan Kavala.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Two fields were added to CallContext to allow call to dynamically change
> the event type and description.  Additionally a @ActionEvents annotation
> was added to allow a method to specify multiple events
> 
> Spring AOP will not intercept calls to "this" so @ActionEvent needs to be
> put on public methods that are externally invoked
> 
> Annotations that needed to be changed were identified by doing byte code 
> analysis using objectweb asm.  Code for that is at 
> https://github.com/ibuildthecloud/cloudstack-findbadactionevents and there
> are instructions to run it there.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/event/ActionEvents.java PRE-CREATION 
>   api/src/org/apache/cloudstack/context/CallContext.java 
> e3c1bf2a7b97573cdeb4f530d0afe74cb7e3e834 
>   engine/components-api/src/com/cloud/configuration/ConfigurationManager.java 
> 6e76b6ffb91c200127589831893d9d79970aafdb 
>   engine/components-api/src/com/cloud/network/rules/FirewallManager.java 
> fa12cd804a67138740f9d9042709938871dc8629 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 
> fb727a1705487416b7069fc2aca5086fd726e700 
>   server/src/com/cloud/event/ActionEventInterceptor.java 
> ba7e270af90f7bc191b570a7cc131319f446e2f6 
>   server/src/com/cloud/event/ActionEventUtils.java 
> 60f5633fc3c53dac960247308de12b60b492de59 
>   server/src/com/cloud/network/firewall/FirewallManagerImpl.java 
> cd83c4e52f85adc9c9d9c7997c28838f2c15b323 
>   server/src/com/cloud/server/ManagementServerImpl.java 
> a3efd2129ce082023d79e55872e8134d1b6bd85c 
>   server/src/com/cloud/user/AccountManagerImpl.java 
> 0602514fcf429b09a62edf65f4b0dc0e87d80b94 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 
> c3a718ac55be05f123b062a627c2de042c4321ab 
>   server/test/com/cloud/network/MockFirewallManagerImpl.java 
> c50459e98737eaf5662bb44c6e9a12fad54b4175 
>   server/test/com/cloud/vpc/MockConfigurationManagerImpl.java 
> 3ec146b953726c9480b1e15848a67e4746dd65a6 
> 
> Diff: https://reviews.apache.org/r/14084/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Darren Shepherd
> 
>

Re: Creating an instance with ssh key pair

[Gaurav Aradhye]

Thanks Sangeetha. That was helpful.

Regards,
Gaurav


On Thu, Sep 12, 2013 at 9:25 PM, Sangeetha Hariharan <
sangeetha.hariha...@citrix.com> wrote:

> To deploy Vm using ssh key pairs  you will need to use a template that has
> SSH Key Gen Scripts in it.
> Only then you will be able to  ssh into the instance using ssh key.
>
> -Thanks
> Sangeetha
>
>
> -Original Message-
> From: Gaurav Aradhye [mailto:gaurav.arad...@clogeny.com]
> Sent: Thursday, September 12, 2013 5:00 AM
> To: dev@cloudstack.apache.org
> Subject: Creating an instance with ssh key pair
>
> Hello all,
>
> If I create an instance providing ssh key pair while creation, and using a
> "normal template" from the cloudstack setup, then will the SSH to vm using
> the keyPairFlieLocation always work?
>
> Or the template which I am using for creating the instance has to be
> supporting SSH keys? as explained in 5.2.1 section at
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.2/html/Installation_Guide/using-sshkeys.html
>
> In short, Is the SSH using keyPairFileLocation -  template dependent or
> will it always work if I provide ssh key pair while creating instance and
> use normal template?
>
> Regards,
> Gaurav
>

Re: Q's about UserAuthenticators and getName()

[Darren Shepherd]

On 09/13/2013 03:48 AM, Abhinandan Prateek wrote:

The code already has the name set to ³LDAP² in 4.2. What branch are you on
?
Will also prefer if we can use getClass().getSimpleName() to get the
classname, but we should check the possibility of the adapter classnames
getting enhanced by underlying framework.



I'm on master but that doesn't matter, its actually broke in 4.2 also. 
I originally stated that the DefaultUserAuthenticator masks _name in 
ComponentLifecycleBase so even though the XML is setting the property to 
LDAP it doesn't work.  That was sort of my original question, why was it 
done like that?


I can clean up all the authenticators and submit a patch if we want.

Darren

Re: createVPCOffering (Was:RE: Marvin tests for VPC - why create VPC offering?)

[Alena Prokharchyk]

On 9/12/13 11:39 PM, "Sowmya Krishnan"  wrote:

>But we don't have an option to choose service providers with
>createVPCOffering. It's always VPC VR for all services. If let's say, I
>want to create a VPC Offering with LB as Netscaler and say, the following
>services only: DNS, DHCP and SourceNat - it isn¹t possible from the API..
>However this mapping *is* being done internally as can be seen from
>vpc_offering_service_map table.
>So providing flexibility to create a VPC with chosen set to services but
>without the ability to choose providers is confusing and perhaps limiting
>in a way?

Sounds like an api bug to me. We should allow having NS and internal LB as
a provider. Please file it.

>
>On the other hand, I am wondering what is the use case for exposing
>createVPCOffering at all? Can we not stick to the default offerings of
>VPC already provided?

The original intent for introducing VPC offering was - push all the
services/providers from network offerings of the tiers to the VPC
offering, and make it serve the services for VPC just like network
offering does for network.
Due to lack of time, it was easier back then to proxy services for VPC
tiers via network offering of the tier using existing implementation of
NetworkAsAService. In the future all services/providers should be defined
on the VPC level instead of network level. By then, createVPCOffering
functionality shouldn't be exposed in the UI.


>
>> -Original Message-
>> From: Alena Prokharchyk
>> Sent: Thursday, September 12, 2013 10:54 PM
>> To: dev@cloudstack.apache.org; Sowmya Krishnan
>> Cc: Venkata SwamyBabu Budumuru
>> Subject: Re: Marvin tests for VPC - why create VPC offering?
>> 
>> 
>> On 9/12/13 10:12 AM, "Rajesh Battala"  wrote:
>> 
>> >My observations are
>> >1. VPC offering is to tell what are all the services can be available
>> >if you create tiers in the vpc.
>> 
>> Correct
>> 
>> >2. There should be some default providers for each service.(but
>> >currently its only VpcVR). Or set of providers for each service it can
>>provider.
>> >When vpc_network_offering is created, when this network is getting
>> >implemented inside this vpc and those services/service providers are
>> >validated against what are the services/providers can be provided.
>> 
>> 
>> Only VPC VR/NS/Internal LB vm are supported as VPC providers
>> 
>> 
>> >
>> >I feel while creating "VPC_Offering" flexibility should be provided  at
>> >VPC level  such that what are the services provided and possible
>> >service providers.
>> >But currently there only only 3 possible providers one is VPcVR and
>> >Netscaler(only for External LB) and internalLB Provider.
>> >
>> >As there are fixed set of providers and the possible combination of VPC
>> >services offerings are created by default we should be using them to
>> >create a VPC.
>> >
>> >If user wants to create a new VPC offering it will become a copy of the
>> >existing VPC offering because possible VPC offerings are created by
>> >VPCManager.
>> 
>> Only Admin can create a VPC offering. And this offering doesn't become
>>a copy.
>> >
>> >Thanks
>> >Rajesh Battala
>> >
>> >-Original Message-
>> >From: Sowmya Krishnan
>> >Sent: Thursday, September 12, 2013 8:13 PM
>> >To: dev@cloudstack.apache.org
>> >Cc: Rajesh Battala; Venkata SwamyBabu Budumuru
>> >Subject: RE: Marvin tests for VPC - why create VPC offering?
>> >
>> >
>> >> -Original Message-
>> >> From: Prasanna Santhanam [mailto:t...@apache.org]
>> >> Sent: Thursday, September 12, 2013 11:55 AM
>> >> To: dev@cloudstack.apache.org
>> >> Cc: Rajesh Battala; Venkata SwamyBabu Budumuru
>> >> Subject: Re: Marvin tests for VPC - why create VPC offering?
>> >>
>> >> See inline, there seems to be a bug in the design.
>> >>
>> >> On Thu, Sep 12, 2013 at 05:53:45AM +, Sowmya Krishnan wrote:
>> >> > > -Original Message-
>> >> > > From: Prasanna Santhanam [mailto:t...@apache.org]
>> >> > > Sent: Thursday, September 12, 2013 11:07 AM
>> >> > > To: dev@cloudstack.apache.org
>> >> > > Subject: Re: Marvin tests for VPC - why create VPC offering?
>> >> > >
>> >> > > On Thu, Sep 12, 2013 at 05:15:16AM +, Sowmya Krishnan wrote:
>> >> > > > I find for most of the VPC tests we create a new VPC Offering
>> >> > > > which provides almost the same set of services as the "Default
>> >> > > > VPC
>> >> Offering"
>> >> > > > already available by default. We also have a separate function
>> >> > > > to create this offering, enabling it and then create a VPC
>> >> > > > using this offering. I wonder why do we have to create vpc
>> >> > > > offerings for each test suite. Also, we don't expose create VPC
>> >> > > > offering in
>> >>the UI.
>> >> > > > We do have an API for that, but I think we should just stick to
>> >> > > > the default ones available and then create network offerings as
>> >> > > > required for the test.
>> >> > > >
>> >> > >
>> >> > > Personally, I don't see the harm in that since any offering is
>> >> > > lightweight. I prefer every

RE: run cloustack have a exeception

[Alex Huang]

This is a known error on windows.  CloudStack tries to generate a key store but 
on windows, it is not possible.  For windows, before launching CloudStack, I 
always have to manually change the developer to false in order to have it run.  
You'll still see this error but it would be meaningless.

UPDATE cloud.configuration set value='false' where name='developer';

If you forgot to do that and started cloudstack, you have to reset the database.

--Alex

> -Original Message-
> From: 黑洞 [mailto:heids...@sina.com]
> Sent: Thursday, September 12, 2013 11:18 PM
> To: dev
> Subject: run cloustack have a exeception
> 
> 
> 
> 
> 
> 
> INFO  [utils.component.ComponentContext] (Timer-2:) Configuring
> com.cloud.server.ConfigurationServerImpl_EnhancerByCloudStack_e2a1f0b
> 0
> INFO  [cloud.server.ConfigurationServerImpl] (Timer-2:) Processing
> updateSSLKeyStore INFO  [cloud.server.ConfigurationServerImpl] (Timer-2:)
> SSL keystore located at D:\clouddevelop\cloudstack-repo-
> debug\cloudstack\client\target\cloud-client-ui-4.2.0-SNAPSHOT\WEB-
> INF\classes/cloud.keystore
> WARN  [utils.script.Script] (Timer-2:) Exception: sudo keytool -genkey -
> keystore D:\clouddevelop\cloudstack-repo-
> debug\cloudstack\client\target\cloud-client-ui-4.2.0-SNAPSHOT\WEB-
> INF\classes/cloud.keystore -storepass vmops.com -keypass vmops.com -
> keyalg RSA -validity 3650 -dname cn="Cloudstack User",ou="TYX-
> 020",o="TYX-020",c="Unknown"
> java.io.IOException: Cannot run program "sudo": CreateProcess
> error=2, ?
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:460)
> at com.cloud.utils.script.Script.execute(Script.java:183)
> at com.cloud.utils.script.Script.execute(Script.java:161)
> at
> com.cloud.server.ConfigurationServerImpl.generateDefaultKeystore(Config
> urationServerImpl.java:487)
> at
> com.cloud.server.ConfigurationServerImpl.updateSSLKeystore(Configuratio
> nServerImpl.java:510)
> at
> com.cloud.server.ConfigurationServerImpl.persistDefaultValues(Configurati
> onServerImpl.java:272)
> at
> com.cloud.utils.component.ComponentInstantiationPostProcessor$Intercep
> torDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
> at
> com.cloud.server.ConfigurationServerImpl.configure(ConfigurationServerIm
> pl.java:148)
> at
> com.cloud.utils.component.ComponentContext.initComponentsLifeCycle(Co
> mponentContext.java:111)
> at
> com.cloud.servlet.CloudStartupServlet$1.run(CloudStartupServlet.java:50)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> Caused by: java.io.IOException: CreateProcess error=2, ?
> at java.lang.ProcessImpl.create(Native Method)
> at java.lang.ProcessImpl.(ProcessImpl.java:81)
> at java.lang.ProcessImpl.start(ProcessImpl.java:30)
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)
> ... 15 more
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 云计算基础架构师
> Github:https://github.com/heidsoftWeibo: http://weibo.com/liuganbin
> 研究方向：云计算（云安全）、大数据（数据处理分析）
> 主要学习: Linux / C / C++ / JAVA
> Email:heids...@sina.com
> Tell:18601706743
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 某云计算公司
> 
> 
> 
> 
> 
> Jake.liu@heidsoft黑洞
> 
> 
> 
> 
> 云计算系统架构师
> 
> 
> 
> 
> 
> 
> 
> 
>840608792
> 
> 
> 
> 
> 
> heidso...@gmail.com
> 
> 
> 
> 
> 
>  weibo.com/liuganbin
> 
> 
> 
> 
> 
>  上海 徐汇区
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 名片二维码
> 
> 
> 
> 
> 
> 
> 

test - please ignore

[Donal Lafferty]

Problems replying to this newsgroup... testing that I can post :(

Re: run cloustack have a exeception

[Punith s]

hey don't use fullsandbox mode in devcloud2, its recommended to use
devcloud as only host(hypervisor)
switching to this might solve your problem .

regards,
punith s


On Fri, Sep 13, 2013 at 11:48 AM, 黑洞  wrote:

>
>
>
>
>
> INFO  [utils.component.ComponentContext] (Timer-2:) Configuring
> com.cloud.server.ConfigurationServerImpl_EnhancerByCloudStack_e2a1f0b0
> INFO  [cloud.server.ConfigurationServerImpl] (Timer-2:) Processing
> updateSSLKeyStore
> INFO  [cloud.server.ConfigurationServerImpl] (Timer-2:) SSL keystore
> located at
> D:\clouddevelop\cloudstack-repo-debug\cloudstack\client\target\cloud-client-ui-4.2.0-SNAPSHOT\WEB-INF\classes/cloud.keystore
> WARN  [utils.script.Script] (Timer-2:) Exception: sudo keytool -genkey
> -keystore
> D:\clouddevelop\cloudstack-repo-debug\cloudstack\client\target\cloud-client-ui-4.2.0-SNAPSHOT\WEB-INF\classes/cloud.keystore
> -storepass vmops.com -keypass vmops.com -keyalg RSA -validity 3650 -dname
> cn="Cloudstack User",ou="TYX-020",o="TYX-020",c="Unknown"
> java.io.IOException: Cannot run program "sudo": CreateProcess error=2,
> ?
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:460)
> at com.cloud.utils.script.Script.execute(Script.java:183)
> at com.cloud.utils.script.Script.execute(Script.java:161)
> at
> com.cloud.server.ConfigurationServerImpl.generateDefaultKeystore(ConfigurationServerImpl.java:487)
> at
> com.cloud.server.ConfigurationServerImpl.updateSSLKeystore(ConfigurationServerImpl.java:510)
> at
> com.cloud.server.ConfigurationServerImpl.persistDefaultValues(ConfigurationServerImpl.java:272)
> at
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
> at
> com.cloud.server.ConfigurationServerImpl.configure(ConfigurationServerImpl.java:148)
> at
> com.cloud.utils.component.ComponentContext.initComponentsLifeCycle(ComponentContext.java:111)
> at
> com.cloud.servlet.CloudStartupServlet$1.run(CloudStartupServlet.java:50)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> Caused by: java.io.IOException: CreateProcess error=2, ?
> at java.lang.ProcessImpl.create(Native Method)
> at java.lang.ProcessImpl.(ProcessImpl.java:81)
> at java.lang.ProcessImpl.start(ProcessImpl.java:30)
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)
> ... 15 more
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> 云计算基础架构师
> Github:https://github.com/heidsoftWeibo: http://weibo.com/liuganbin
> 研究方向：云计算（云安全）、大数据（数据处理分析）
> 主要学习: Linux / C / C++ / JAVA
> Email:heids...@sina.com
> Tell:18601706743
>
>
>
>
>
>
>
>
>
>
>
> 某云计算公司
>
>
>
>
>
> Jake.liu@heidsoft黑洞
>
>
>
>
> 云计算系统架构师
>
>
>
>
>
>
>
>
>840608792
>
>
>
>
>
> heidso...@gmail.com
>
>
>
>
>
>  weibo.com/liuganbin
>
>
>
>
>
>  上海 徐汇区
>
>
>
>
>
>
>
>
>
>
>
>
> 名片二维码
>
>
>
>
>
>
>
>
>

[Proposal] Userdata Support for Hyper-V with KVP Data Exchange

[Donal Lafferty]

IIRC, OpenStack puts userdata for Hyper-V guest VMs on a separate volume.  The 
guest can mount the volume and extract the data.

However, I suggest we use Hyper-V's KVP Data Exchange mechanism instead.  Doing 
so keeps volume management and passing userdata cleanly separated.

Feature Spec at 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Userdata+Support+for+Hyper-V+with+KVP+Data+Exchange

RE: what wrong? start cloudstack

[Alex Huang]

Are you still getting this error?  This is because niciria plugin was not 
compile somehow.  How did you compile your cloudstack?

--Alex

> -Original Message-
> From: 黑洞 [mailto:heids...@sina.com]
> Sent: Thursday, September 12, 2013 10:48 PM
> To: dev
> Subject: what wrong? start cloudstack
> 
> when I execut "mvn -pl :cloud-client-ui jetty:run"
> hava follow exception:
> 
> 
>  ERROR [web.context.ContextLoader] (main:) Context initialization failed
> org.springframework.beans.factory.BeanCreationException: Error creating
> bean with name 'niciraNvpDaoImpl' defined in class path resource
> [componentContext.xml]: BeanPostProcessor before instantiation of bean
> failed; nested exception is net.sf.cglib.core.CodeGenerationException:
> java.lang.reflect.InvocationTargetException-->null
> at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanF
> actory.createBean(AbstractAutowireCapableBeanFactory.java:452)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory$1.getObje
> ct(AbstractBeanFactory.java:294)
> at
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.g
> etSingleton(DefaultSingletonBeanRegistry.java:225)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBea
> n(AbstractBeanFactory.java:291)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(A
> bstractBeanFactory.java:193)
> at
> org.springframework.beans.factory.support.DefaultListableBeanFactory.preI
> nstantiateSingletons(DefaultListableBeanFactory.java:609)
> at
> org.springframework.context.support.AbstractApplicationContext.finishBea
> nFactoryInitialization(AbstractApplicationContext.java:918)
> at
> org.springframework.context.support.AbstractApplicationContext.refresh(A
> bstractApplicationContext.java:469)
> at
> org.springframework.web.context.ContextLoader.configureAndRefreshWeb
> ApplicationContext(ContextLoader.java:383)
> at
> org.springframework.web.context.ContextLoader.initWebApplicationContex
> t(ContextLoader.java:283)
> at
> org.springframework.web.context.ContextLoaderListener.contextInitialized(
> ContextLoaderListener.java:111)
> at
> org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.jav
> a:549)
> 
> 
> 
> 
> what Wrong?
> 
> 
> Thanks
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 云计算基础架构师
> Github:https://github.com/heidsoftWeibo: http://weibo.com/liuganbin
> 研究方向：云计算（云安全）、大数据（数据处理分析）
> 主要学习: Linux / C / C++ / JAVA
> Email:heids...@sina.com
> Tell:18601706743
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 某云计算公司
> 
> 
> 
> 
> 
> Jake.liu@heidsoft黑洞
> 
> 
> 
> 
> 云计算系统架构师
> 
> 
> 
> 
> 
> 
> 
> 
>840608792
> 
> 
> 
> 
> 
> heidso...@gmail.com
> 
> 
> 
> 
> 
>  weibo.com/liuganbin
> 
> 
> 
> 
> 
>  上海 徐汇区
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 名片二维码
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> - 原始邮件 -
> 发件人：Mike Tutkowski 
> 收件人："dev@cloudstack.apache.org" 
> 抄送人：Amit Das 
> 主题：Re: Which DevCloud2 Usage Mode is good for Development and
> Debugging 
> 日期：2013年09月13日 07点33分
> 

Re: Q's about UserAuthenticators and getName()

[Ian Duffy]

Great. Applied it.

You can mark it as submitted.


On 13 September 2013 16:10, Darren Shepherd wrote:

> On 09/12/2013 10:56 PM, Ian Duffy wrote:
>
>> So my problem is that LDAP currently has a null name on getName().  So
>>>
>> which should I do?  Add
>>
>> Go ahead and add it. I missed that override in error.
>>
>>  Okay I created 
>> https://reviews.apache.org/r/**14126/
>
> Darren
>

Re: [Proposal] Userdata Support for Hyper-V with KVP Data Exchange

[Darren Shepherd]

On 09/13/2013 08:51 AM, Donal Lafferty wrote:

IIRC, OpenStack puts userdata for Hyper-V guest VMs on a separate volume.  The 
guest can mount the volume and extract the data.

However, I suggest we use Hyper-V's KVP Data Exchange mechanism instead.  Doing 
so keeps volume management and passing userdata cleanly separated.

Feature Spec at 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Userdata+Support+for+Hyper-V+with+KVP+Data+Exchange



Why does Hyper-V need something specific?  Is userdata really hypervisor 
specific?  I though we just put the userdata on the VR?


Darren

Review Request 14126: Return name for getName() on LdapAuthenticator

[Darren Shepherd]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14126/
---

Review request for cloudstack and Donal Lafferty.


Repository: cloudstack-git


Description
---

Currently getName() returns null, this patch just follows the style of the 
other authenticators in how they set and return their name.


Diffs
-

  
plugins/user-authenticators/ldap/src/org/apache/cloudstack/ldap/LdapAuthenticator.java
 559a979 

Diff: https://reviews.apache.org/r/14126/diff/


Testing
---


Thanks,

Darren Shepherd

Re: Review Request 14126: Return name for getName() on LdapAuthenticator

[Ian Duffy]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14126/#review26081
---

Ship it!


Ship It!

- Ian Duffy


On Sept. 13, 2013, 3:06 p.m., Darren Shepherd wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14126/
> ---
> 
> (Updated Sept. 13, 2013, 3:06 p.m.)
> 
> 
> Review request for cloudstack and Donal Lafferty.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Currently getName() returns null, this patch just follows the style of the 
> other authenticators in how they set and return their name.
> 
> 
> Diffs
> -
> 
>   
> plugins/user-authenticators/ldap/src/org/apache/cloudstack/ldap/LdapAuthenticator.java
>  559a979 
> 
> Diff: https://reviews.apache.org/r/14126/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Darren Shepherd
> 
>

RE: [Proposal] Userdata Support for Hyper-V with KVP Data Exchange

[Rajesh Battala]

Hi Darren, 

To bring up the system vm's on the hyperv host we need to pass the boot args 
from host to the systemvm's.
To pass the data from hyperv host to systemvm guest we need this method.

Thanks
Rajesh Battala

-Original Message-
From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com] 
Sent: Friday, September 13, 2013 10:10 PM
To: dev@cloudstack.apache.org
Subject: Re: [Proposal] Userdata Support for Hyper-V with KVP Data Exchange

On 09/13/2013 08:51 AM, Donal Lafferty wrote:
> IIRC, OpenStack puts userdata for Hyper-V guest VMs on a separate volume.  
> The guest can mount the volume and extract the data.
>
> However, I suggest we use Hyper-V's KVP Data Exchange mechanism instead.  
> Doing so keeps volume management and passing userdata cleanly separated.
>
> Feature Spec at 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Userdata+Suppor
> t+for+Hyper-V+with+KVP+Data+Exchange
>

Why does Hyper-V need something specific?  Is userdata really hypervisor 
specific?  I though we just put the userdata on the VR?

Darren

Re: Problem with cloud.storage_pool's used_bytes

[Mike Tutkowski]

Thanks, Wei

I assume this is also present in 4.2? If not, it seems like a serious
problem.


On Fri, Sep 13, 2013 at 12:45 AM, Wei ZHOU  wrote:

> sorry, the url is
>
> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=5c141a46fc3f684fd633d8b1b18f708bcff4
>
>
> 2013/9/13 Wei ZHOU 
>
> > Mike,
> > it is  already fixed in master and 4.2-forward branch.
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=7bff499bd3625f8a75a1c93cb9e3e2c90955df5e
> >
> >
> > 2013/9/13 Mike Tutkowski 
> >
> >> Hi,
> >>
> >> I just set up a single zone with one KVM host using master.
> >>
> >> My CPVM and SSVM are up and running nicely.
> >>
> >> When I look at the storage_pool table, however, I'm concerned with what
> I
> >> see for the used_bytes field: 18,218,356,736 (below). This seems way too
> >> large (almost consuming all of the local space on my KVM host). I wonder
> >> if
> >> this isn't instead available_bytes. I believe available_bytes was
> changed
> >> to used_bytes in 4.2 and it looks like this may not be working properly
> in
> >> this scenario.
> >>
> >> Thoughts?
> >>
> >> Thanks!
> >>
> >> 1 ubuntu Local Storage a4f6428e-8cfd-41f8-b755-b177ad0315f3 Filesystem 0
> >> 1 1
> >> 1 18218356736 20332810240 192.168.233.10 /var/lib/libvirt/images
> >> 2013-09-13
> >> 00:47:39 Up DefaultPrimary HOST 0
> >>
> >>
> >>
> >> --
> >> *Mike Tutkowski*
> >> *Senior CloudStack Developer, SolidFire Inc.*
> >> e: mike.tutkow...@solidfire.com
> >> o: 303.746.7302
> >> Advancing the way the world uses the
> >> cloud
> >> *™*
> >>
> >
> >
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*

Re: [Proposal] Userdata Support for Hyper-V with KVP Data Exchange

[Darren Shepherd]

On 09/13/2013 10:25 AM, Rajesh Battala wrote:


To bring up the system vm's on the hyperv host we need to pass the boot args 
from host to the systemvm's.
To pass the data from hyperv host to systemvm guest we need this method.



Oh maybe I'm getting terminology mixed up.  When you say userdata I 
think of the userdata a user can set on VM deploy.  What you are talking 
about is boot args, right?  Like in the systemvm on xenserver they show 
up in /proc/cmdline.


So which are we talking about?

Darren

Re: Creating an instance with ssh key pair

[Harikrishna Patnala]

SSH script pulls only the ssh public key that is associated with the vm 
instance.
There is an API to reset the SSH key pair associated to the VM. This is will 
associate new ssh key pair to the vm and on reboot of vm this ssh script gets 
the new ssh public key into the VM.
If you can modify the ssh script in the vm to append the new ssh public key to 
the authorised_keys file we can use both old and new ssh key pair.

-Harikrishna

On 12-Sep-2013, at 9:35 PM, Travis Graham  wrote:

> Will this only pull down one key pair or can it pull down many? We have a 
> need to pull in our keys as well as all of our customers keys.
> 
> If the script can only pull down one, we can make it work, but would be nice 
> to pull down all keys from the project an instance is associated with.
> 
> Travis
> 
> On Sep 12, 2013, at 11:55 AM, Sangeetha Hariharan 
>  wrote:
> 
>> To deploy Vm using ssh key pairs  you will need to use a template that has 
>> SSH Key Gen Scripts in it.
>> Only then you will be able to  ssh into the instance using ssh key.
>> 
>> -Thanks
>> Sangeetha
>> 
>> 
>> -Original Message-
>> From: Gaurav Aradhye [mailto:gaurav.arad...@clogeny.com] 
>> Sent: Thursday, September 12, 2013 5:00 AM
>> To: dev@cloudstack.apache.org
>> Subject: Creating an instance with ssh key pair
>> 
>> Hello all,
>> 
>> If I create an instance providing ssh key pair while creation, and using a 
>> "normal template" from the cloudstack setup, then will the SSH to vm using 
>> the keyPairFlieLocation always work?
>> 
>> Or the template which I am using for creating the instance has to be 
>> supporting SSH keys? as explained in 5.2.1 section at 
>> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.2/html/Installation_Guide/using-sshkeys.html
>> 
>> In short, Is the SSH using keyPairFileLocation -  template dependent or will 
>> it always work if I provide ssh key pair while creating instance and use 
>> normal template?
>> 
>> Regards,
>> Gaurav
> 

RE: win7+cygwin+cloudstack having a problem

[Donal Lafferty]

Build problem?

Let me explain:

Bean definitions cross reference .class files, e.g.

Administrator@cc-svr10 ~/github/cifs
$ grep -R iciraNvpDaoImpl * --include=*.xml.in
cloudstack/client/tomcatconf/componentContext.xml.in:  
cloudstack/client/tomcatconf/nonossComponentContext.xml.in:  


Notice I’m using .xml.in above.   The build copies these files and changes 
their extension to .xml

Next, check that the bean’s class has been deployed to the folder that Jetty 
will use, e.g.

Administrator@cc-svr10 ~/github/cifs
$ grep -R "iciraNvpDaoImpl\.class" *
Binary file 
cloudstack/client/target/cloud-client-ui-4.3.0-SNAPSHOT/WEB-INF/lib/cloud-plugin-network-nvp-4.3.0-SNAPSHOT.jar
 matches
Binary file cloudstack/client/target/cloud-client-ui-4.3.0-SNAPSHOT.war matches
Binary file 
cloudstack/plugins/network-elements/nicira-nvp/target/cloud-plugin-network-nvp-4.3.0-SNAPSHOT.jar
 matches


If you don’t see any matches, then the command you used to build may be for an 
older version of CloudStack. :(

This happens whenever we improve the build, because build updates are not 
backwards compatible.

If you are using the Windows Development instructions 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Setting+up+a+CloudStack+dev+environment+on+Windows
 , take a look at the update just I made to “Step 13) Build”.

If you have similar problems in the future, take a look at the most up to date 
build instructions, which are at 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack

DL





From: 黑洞 [mailto:heids...@sina.com]
Sent: 13 September 2013 02:38
To: dev
Subject: win7+cygwin+cloudstack having a problem

I am according to the github cloudstack source code for INSTANL.md
1、cygwin is goode
2、database is goode
3、mvn -pl :cloud-client-ui jetty:run
exception detail:
lassPostProcessor$ImportAwareBeanPostProcessor#0]; root of factory hierarchy
ERROR [web.context.ContextLoader] (main:) Context initialization failed
org.springframework.beans.factory.BeanCreationException: Error creating bean 
with name 'niciraNvpDaoImpl' defined in class path resource 
[componentContext.xml]: BeanPostProcessor before instantiation of bean failed; 
nested exception is net.sf.cglib.core.CodeGenerationException: 
java.lang.reflect.InvocationTargetException-->null
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:452)
at 
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at 
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at 
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at 
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at 
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:609)
at 
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:918)

what wrong?

Thanks

云计算基础架构师
Github:https://github.com/heidsoft
Weibo: http://weibo.com/liuganbin
研究方向：云计算（云安全）、大数据（数据处理分析）
主要学习: Linux / C / C++ / JAVA /Python
Email:heids...@sina.com
Tell:18601706743

Re: www.cloudstack.org not resolving

[Marty Sweet]

Hi Guys,

Those nameservers are GoDaddy's, have we moved away from them? They are
responding with SERVFAIL for any cloudstack.org lookup.

Marty


On Fri, Sep 13, 2013 at 6:02 PM, Tracy Phillips wrote:

> Matt,
>
> Probably the contact listed in the whois
>
> Domain ID:D150572512-LROR
> Domain Name:CLOUDSTACK.ORG
> Created On:07-Jan-2008 15:12:00 UTC
> Last Updated On:12-Sep-2013 11:24:54 UTC
> Expiration Date:07-Jan-2018 15:12:00 UTC
> Sponsoring Registrar:Domain.com, LLC (R1915-LROR)
> Status:TRANSFER PROHIBITED
> Status:TRANSFERPERIOD
> Registrant ID:tu7wMGD9wRRhInik
> Registrant Name:Sheng Liang
> Registrant Street1:PO Box 1644
> Registrant Street2:
> Registrant Street3:
> Registrant City:Mountain View
> Registrant State/Province:California
> Registrant Postal Code:94042
> Registrant Country:US
> Registrant Phone:+1.6503945612
> Registrant Phone Ext.:
> Registrant FAX:
> Registrant FAX Ext.:
> Registrant Email:shengli...@gmail.com
> Admin ID:tuwTxVMRjkR6lNM7
> Admin Name:Sheng Liang
> Admin Street1:PO Box 1644
> Admin Street2:
> Admin Street3:
> Admin City:Mountain View
> Admin State/Province:California
> Admin Postal Code:94042
> Admin Country:US
> Admin Phone:+1.6503945612
> Admin Phone Ext.:
> Admin FAX:
> Admin FAX Ext.:
> Admin Email:shengli...@gmail.com
> Tech ID:tuvYURg6jpeMiajb
> Tech Name:Sheng Liang
> Tech Street1:PO Box 1644
> Tech Street2:
> Tech Street3:
> Tech City:Mountain View
> Tech State/Province:California
> Tech Postal Code:94042
> Tech Country:US
> Tech Phone:+1.6503945612
> Tech Phone Ext.:
> Tech FAX:
> Tech FAX Ext.:
> Tech Email:shengli...@gmail.com
> Name Server:NS71.DOMAINCONTROL.COM
> Name Server:NS72.DOMAINCONTROL.COM
>
>
>
>
> On Fri, Sep 13, 2013 at 10:04 AM, Mathias Mullins <
> mathias.mull...@citrix.com> wrote:
>
> > David,
> >
> > Who do we need to reach out too? We are in day 3 of outage now?
> >
> > Matt
> >
> >
> > On 9/11/13 9:58 PM, "David Nalley"  wrote:
> >
> > >The ASF has taken charge of the domains, but I suspect DNS is lagging a
> > >bit.
> > >
> > >--David
> > >
> > >On Wed, Sep 11, 2013 at 9:03 PM, Mathias Mullins
> > > wrote:
> > >> Cloudstack.org isn't resolving.
> > >>
> > >> Cloudstack.apache.org is up and running.
> > >>
> > >> Do we need to get a hold of infrastructure?
> > >>
> > >> Matt Mullins
> > >> Cloud Platforms Implementation Engineer
> > >> Worldwide Cloud Services ­ Citrix System, Inc.
> > >> +1 (407) 920-1107 ­ Office/Cell Phone
> > >> matt.mull...@citrix.com
> > >>
> >
> >
>

Re: Review Request 13559: Automation: Portable IP test cases

[Gaurav Aradhye]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/13559/
---

(Updated Sept. 13, 2013, 4:12 p.m.)


Review request for cloudstack, Murali Reddy, venkata swamy babu  budumuru, and 
Prasanna Santhanam.


Changes
---

Last patch couldn't apply. Putting new patch as requested.


Repository: cloudstack-git


Description
---

Adding new test cases for feature Portable IP


Diffs (updated)
-

  test/integration/component/test_portable_ip.py PRE-CREATION 
  tools/marvin/marvin/integration/lib/base.py 3016ee4 
  tools/marvin/marvin/integration/lib/common.py 7e8d92d 

Diff: https://reviews.apache.org/r/13559/diff/


Testing
---


Thanks,

Gaurav Aradhye

Re: Security Groups

[Lynch, Gerard]

By default XenServer (6.x) disables iptable/arptable checking over bridges
in /etc/sysctl.conf
- you'll need to ensure those are enabled.

net.bridge.bridge-nf-call-iptables = 1
net.bridge.bridge-nf-call-ip6tables = 0
net.bridge.bridge-nf-call-arptables = 1



On 13/09/2013 04:55, "Jijun"  wrote:

>hi , i encounter the same problem,
>
>as i know, XenServer 6.2 need not  the CSP.
>
>but the ingress not be blocked by default. i can ping all the Vms in
>that security group.
>
>i don't know why?
>
>Thanks.
>
>On 09/13/2013 02:02 AM, Michael Phillips wrote:
>> So that is definitely going to be the issue. I missed that in the 8.2.7
>>section of the install guide.
>>
>>> From: sangeetha.hariha...@citrix.com
>>> To: dev@cloudstack.apache.org
>>> Subject: RE: Security Groups
>>> Date: Thu, 12 Sep 2013 17:19:16 +
>>>
>>> If you are using Xenserver hosts , can you make sure you have the CSP
>>>packages installed?
>>>
>>> -Thanks
>>> Sangeetha
>>>
>>> -Original Message-
>>> From: Michael Phillips [mailto:mphilli7...@hotmail.com]
>>> Sent: Thursday, September 12, 2013 9:33 AM
>>> To: dev@cloudstack.apache.org
>>> Subject: Security Groups
>>>
>>> I posed this question in the user list, but I figured I would throw it
>>>out here as well...So If I have created a zone with the
>>>"DefaultSharedNetworkOfferingWithSGService" network offering, then
>>>created a VM using the default security group, which has 0 ingress
>>>rules, I should NOT be able to do things like PING that VM correct? The
>>>answer to the above question was answered "correct"...My next question
>>>is, in that case what are some things I could look at to see why it's
>>>not behaving as expected.
>>> 
>>  
>
>
>-- 
>Thanks,
>Jijun
>
>


Information in this email including any attachments may be privileged, 
confidential and is intended exclusively for the addressee. The views expressed 
may not be official policy, but the personal views of the originator. If you 
have received it in error, please notify the sender by return e-mail and delete 
it from your system. You should not reproduce, distribute, store, retransmit, 
use or disclose its contents to anyone. Please note we reserve the right to 
monitor all e-mail communication through our internal and external networks. 
SKY and the SKY marks are trademarks of British Sky Broadcasting Group plc and 
Sky International AG and are used under licence. British Sky Broadcasting 
Limited (Registration No. 2906991), Sky-In-Home Service Limited (Registration 
No. 2067075) and Sky Subscribers Services Limited (Registration No. 2340150) 
are direct or indirect subsidiaries of British Sky Broadcasting Group plc 
(Registration No. 2247735). All of the companies mentioned in this paragraph 
are incorporated in England and Wales and share the same registered office at 
Grant Way, Isleworth, Middlesex TW7 5QD.

Re: Review Request 13559: Automation: Portable IP test cases

[Gaurav Aradhye]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/13559/
---

(Updated Sept. 13, 2013, 4:52 p.m.)


Review request for cloudstack, Murali Reddy, venkata swamy babu  budumuru, and 
Prasanna Santhanam.


Changes
---

Patch against 4.2-forward.


Repository: cloudstack-git


Description
---

Adding new test cases for feature Portable IP


Diffs (updated)
-

  test/integration/component/test_portable_ip.py PRE-CREATION 
  tools/marvin/marvin/integration/lib/base.py fa4cc82 
  tools/marvin/marvin/integration/lib/common.py 6ffe951 

Diff: https://reviews.apache.org/r/13559/diff/


Testing
---


Thanks,

Gaurav Aradhye

Re: Q's about UserAuthenticators and getName()

[Abhinandan Prateek]

The code already has the name set to ³LDAP² in 4.2. What branch are you on
?
Will also prefer if we can use getClass().getSimpleName() to get the
classname, but we should check the possibility of the adapter classnames
getting enhanced by underlying framework.



On 13/09/13 4:41 am, "Darren Shepherd"  wrote:

>DefaultUserAuthenticator masks the _name variable in
>ComponentLifecycleBase effectively making it so that no
>UserAuthenticator gets the default name of getClass().getSimpleName().
>
>Then each authenticator, except LDAP, does something like
>
>if (name == null) {
>   name = "MD5";
>}
>
>So instead of the default MD5UserAuthenticator it comes up with MD5 as
>its name.
>
>So my problem is that LDAP currently has a null name on getName().  So
>which should I do?  Add
>
>if (name == null) {
>   name = "LDAP";
>}
>
>Or remove the masked variable in DefaultUserAuthenticator such that all
>authenticators names will become the classname.  I just need it to be
>consistent for what I'm doing at the moment.  I'd personally prefer that
>they all just get the default name of getSimpleName().  But I don't know
>if there was some reason it was done this way.
>
>Darren

Re: Build server was down?

[Marty Sweet]

Hi,

This is due to DNS issues with cloudstack.org. We will continue to discuss
this matter in the subject 'www.cloudstack.org not resolving'.

Thanks,
Marty



On Fri, Sep 13, 2013 at 6:03 PM, Chip Childers wrote:

> Use Jenkins.buildacloud.org
>
> Sent from my iPhone
>
> On Sep 13, 2013, at 12:08 PM, Gavin Lee  wrote:
>
> > Seems http://jenkins.cloudstack.org/ could not be accessed all day.
> > Will someone look on this?
> >
> > --
> > Gavin
>

Re: Which DevCloud2 Usage Mode is good for Development and Debugging ????

[Mike Tutkowski]

Yeah, remote debugging in Eclipse - whether the process I connect to is in
a different VM, same VM, or on a different physical machine - usually
works. Not sure what was going on yesterday and I haven't tried it yet
today.


On Fri, Sep 13, 2013 at 4:32 AM, Punith s  wrote:

> hi guys ,
>
> thanks a lot for the info , you guys are right , now i'm using #*3.host
> only mode *in devcloud2 , and i'm able to debug the MS from
> eclipse seamlessly in my localhost.
> and mike if you have such problems then you can try *full sandbox mode *in
> devcloud2 and connect to it remotely from eclipse by giving the ip of the
> MS (192.168.56.10) , but again it's pretty uncomfortable having everything
> inside devcloud  but anyway its good to try new ways if things work , like
> how i switched from fullsandbox to host only mode. thanks again
>
> regards,
> punith s
> cloudbyte
>
>
> On Fri, Sep 13, 2013 at 5:03 AM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
> > Here is a relevant link:
> >
> > https://cwiki.apache.org/CLOUDSTACK/using-eclipse-with-cloudstack.html
> >
> > The part at the bottom:
> >
> > Remote Debugging
> >
> > You can use Eclipse to attach to the Management Server and debug
> > CloudStack. You setup a Remote Debug Session (Run > Debug Configuration),
> > connect to Port 8787. Typically you would use the project you want to
> debug
> > as the target and include other projects that you need to debug, e.g.
> > cloud-agent, cloud-api, cloud-core and cloud-server.
> >
> > **
> >
> > Currently I am having trouble in 4.3 with remote debugging. I'm not sure
> > why.
> >
> > I have my Remote Java Application configured and running. It connects to
> > the CloudStack Management Server.
> >
> > I set a breakpoint and execute some logic on the front end that should
> hit
> > this breakpoint on the back end, but it doesn't break.
> >
> >
> >
> > On Thu, Sep 12, 2013 at 12:41 PM, Mike Tutkowski <
> > mike.tutkow...@solidfire.com> wrote:
> >
> > > I should have been a bit more specific.
> > >
> > > Once you do what I wrote in my previous e-mail, then run your
> management
> > > server.
> > >
> > > Then run your Remote Java Application and set breakpoints.
> > >
> > >
> > > On Thu, Sep 12, 2013 at 12:27 PM, Mike Tutkowski <
> > > mike.tutkow...@solidfire.com> wrote:
> > >
> > >> If you want to debug remotely, run the CloudStack Management Server
> with
> > >> an environment variable such as the following:
> > >>
> > >> MAVEN_OPTS=-XX:MaxPermSize=512m -Xmx1024m -Xdebug
> > >> -Xrunjdwp:transport=dt_socket,address=8787,server=y,suspend=n
> > >>
> > >> Then in Eclipse, go to Debug Configurations and create a new Remote
> Java
> > >> Application.
> > >>
> > >> Browse and select cloud-server for the Project field.
> > >>
> > >> Enter you IP address for the Host field.
> > >>
> > >> Assuming you used 8787 in MAVEN_OPTS, use 8787 for the Port field.
> > >>
> > >> You may now run your management server and set breakpoints as need be.
> > >>
> > >>
> > >> On Thu, Sep 12, 2013 at 12:19 PM, Mike Tutkowski <
> > >> mike.tutkow...@solidfire.com> wrote:
> > >>
> > >>> I prefer #3, as well.
> > >>>
> > >>>
> > >>> On Thu, Sep 12, 2013 at 10:09 AM, Chiradeep Vittal <
> > >>> chiradeep.vit...@citrix.com> wrote:
> > >>>
> >  #3 works best, I think
> > 
> >  On 9/12/13 2:19 AM, "Punith s"  wrote:
> > 
> >  >hi folks,
> >  >
> >  >i'm using Devcloud2 to build cloudstack 4.2 , currently i'm using
> > *full
> >  >sandbox mode* ,
> >  >
> >  >devcloud allows following modes ,
> >  >*1.full sandbox mode - *build and deploy inside devcloud
> >  >*2.deployment mode - *build code in localhost and deploying in
> > devcloud
> >  >*3.host only mode - *using devcloud only as host
> >  >
> >  >
> >  >which mode do you think its feasible for development and
>  interactive
> >  >debugging ?
> >  >can you elaborate more on setting up remote debugging in Devcloud2
> >  >(fullsandbox mode) using eclipse ??
> >  >
> >  >thanks,
> >  >punith s
> > 
> > 
> > >>>
> > >>>
> > >>> --
> > >>> *Mike Tutkowski*
> > >>> *Senior CloudStack Developer, SolidFire Inc.*
> > >>> e: mike.tutkow...@solidfire.com
> > >>> o: 303.746.7302
> > >>> Advancing the way the world uses the cloud<
> > http://solidfire.com/solution/overview/?video=play>
> > >>> *™*
> > >>>
> > >>
> > >>
> > >>
> > >> --
> > >> *Mike Tutkowski*
> > >> *Senior CloudStack Developer, SolidFire Inc.*
> > >> e: mike.tutkow...@solidfire.com
> > >> o: 303.746.7302
> > >> Advancing the way the world uses the cloud<
> > http://solidfire.com/solution/overview/?video=play>
> > >> *™*
> > >>
> > >
> > >
> > >
> > > --
> > > *Mike Tutkowski*
> > > *Senior CloudStack Developer, SolidFire Inc.*
> > > e: mike.tutkow...@solidfire.com
> > > o: 303.746.7302
> > > Advancing the way the world uses the cloud<
> > http://solidfire.com/solution/overview/?video=play>
> > > *™*
> > >
> >
> >
> >
> > --
> > *Mike Tu

Re: Review Request 14084: Updates to @ActionEvent to be compatible with Spring AOP

[Darren Shepherd]

> On Sept. 13, 2013, 6:17 p.m., Kelven Yang wrote:
> >

Was this actually committed?


- Darren


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14084/#review26086
---


On Sept. 11, 2013, 5:07 p.m., Darren Shepherd wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14084/
> ---
> 
> (Updated Sept. 11, 2013, 5:07 p.m.)
> 
> 
> Review request for cloudstack, Kelven Yang and Kishan Kavala.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Two fields were added to CallContext to allow call to dynamically change
> the event type and description.  Additionally a @ActionEvents annotation
> was added to allow a method to specify multiple events
> 
> Spring AOP will not intercept calls to "this" so @ActionEvent needs to be
> put on public methods that are externally invoked
> 
> Annotations that needed to be changed were identified by doing byte code 
> analysis using objectweb asm.  Code for that is at 
> https://github.com/ibuildthecloud/cloudstack-findbadactionevents and there
> are instructions to run it there.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/event/ActionEvents.java PRE-CREATION 
>   api/src/org/apache/cloudstack/context/CallContext.java 
> e3c1bf2a7b97573cdeb4f530d0afe74cb7e3e834 
>   engine/components-api/src/com/cloud/configuration/ConfigurationManager.java 
> 6e76b6ffb91c200127589831893d9d79970aafdb 
>   engine/components-api/src/com/cloud/network/rules/FirewallManager.java 
> fa12cd804a67138740f9d9042709938871dc8629 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 
> fb727a1705487416b7069fc2aca5086fd726e700 
>   server/src/com/cloud/event/ActionEventInterceptor.java 
> ba7e270af90f7bc191b570a7cc131319f446e2f6 
>   server/src/com/cloud/event/ActionEventUtils.java 
> 60f5633fc3c53dac960247308de12b60b492de59 
>   server/src/com/cloud/network/firewall/FirewallManagerImpl.java 
> cd83c4e52f85adc9c9d9c7997c28838f2c15b323 
>   server/src/com/cloud/server/ManagementServerImpl.java 
> a3efd2129ce082023d79e55872e8134d1b6bd85c 
>   server/src/com/cloud/user/AccountManagerImpl.java 
> 0602514fcf429b09a62edf65f4b0dc0e87d80b94 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 
> c3a718ac55be05f123b062a627c2de042c4321ab 
>   server/test/com/cloud/network/MockFirewallManagerImpl.java 
> c50459e98737eaf5662bb44c6e9a12fad54b4175 
>   server/test/com/cloud/vpc/MockConfigurationManagerImpl.java 
> 3ec146b953726c9480b1e15848a67e4746dd65a6 
> 
> Diff: https://reviews.apache.org/r/14084/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Darren Shepherd
> 
>

Advanced Networking Public Network Service Providers

[Soheil Eizadi]

In the Advanced Networking use cases you have two physical networks (Public and 
Guest Networks). What is the reason for the GUI not providing Network Service 
Provider configuration for the Public Network?
Thanks,
-Soheil

RE: DhcpServiceProvider

[Soheil Eizadi]

Posting my questions again... -Soheil

From: Soheil Eizadi [seiz...@infoblox.com]
Sent: Friday, September 06, 2013 3:13 PM
To: dev@cloudstack.apache.org
Subject: DhcpServiceProvider

I had not looked at the DhcpServiceProvider NetworkElement before, but after 
recent problem, I got a chance to look at it in more detail. I am new to 
CloudStack and don't have a lot of the history and had some questions.

Is there a link to documentation for the DhcpServiceProvider work?

I assume the main use case for DhcpServiceProvider is to support DHCP Daemon 
like DNSMasq, are there other use cases?

The interface is simple enough:


public interface DhcpServiceProvider extends NetworkElement {

boolean addDhcpEntry(...) ...;

boolean configDhcpSupportForSubnet(...) ...;

boolean  removeDhcpSupportForSubnet(...) ...;

}


Is there a reason why the companion entry to addDhcpEntry() e.g. 
removeDhcpEntry() is missing?


What is the motivation in adding this code to the NetworkManager versus contain 
it inside the NetworkElement providing the DHCP? (The logic I see in 
NetworkManager does not seem to be adding any value. Also it is adding a 
specific network function DHCP to the NetworkManager, where we are moving 
functions e.g. IP Address Allocation out.)

Re: Review Request 14084: Updates to @ActionEvent to be compatible with Spring AOP

[Kelven Yang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14084/#review26086
---

Ship it!


- Kelven Yang


On Sept. 11, 2013, 5:07 p.m., Darren Shepherd wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14084/
> ---
> 
> (Updated Sept. 11, 2013, 5:07 p.m.)
> 
> 
> Review request for cloudstack, Kelven Yang and Kishan Kavala.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Two fields were added to CallContext to allow call to dynamically change
> the event type and description.  Additionally a @ActionEvents annotation
> was added to allow a method to specify multiple events
> 
> Spring AOP will not intercept calls to "this" so @ActionEvent needs to be
> put on public methods that are externally invoked
> 
> Annotations that needed to be changed were identified by doing byte code 
> analysis using objectweb asm.  Code for that is at 
> https://github.com/ibuildthecloud/cloudstack-findbadactionevents and there
> are instructions to run it there.
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/event/ActionEvents.java PRE-CREATION 
>   api/src/org/apache/cloudstack/context/CallContext.java 
> e3c1bf2a7b97573cdeb4f530d0afe74cb7e3e834 
>   engine/components-api/src/com/cloud/configuration/ConfigurationManager.java 
> 6e76b6ffb91c200127589831893d9d79970aafdb 
>   engine/components-api/src/com/cloud/network/rules/FirewallManager.java 
> fa12cd804a67138740f9d9042709938871dc8629 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 
> fb727a1705487416b7069fc2aca5086fd726e700 
>   server/src/com/cloud/event/ActionEventInterceptor.java 
> ba7e270af90f7bc191b570a7cc131319f446e2f6 
>   server/src/com/cloud/event/ActionEventUtils.java 
> 60f5633fc3c53dac960247308de12b60b492de59 
>   server/src/com/cloud/network/firewall/FirewallManagerImpl.java 
> cd83c4e52f85adc9c9d9c7997c28838f2c15b323 
>   server/src/com/cloud/server/ManagementServerImpl.java 
> a3efd2129ce082023d79e55872e8134d1b6bd85c 
>   server/src/com/cloud/user/AccountManagerImpl.java 
> 0602514fcf429b09a62edf65f4b0dc0e87d80b94 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 
> c3a718ac55be05f123b062a627c2de042c4321ab 
>   server/test/com/cloud/network/MockFirewallManagerImpl.java 
> c50459e98737eaf5662bb44c6e9a12fad54b4175 
>   server/test/com/cloud/vpc/MockConfigurationManagerImpl.java 
> 3ec146b953726c9480b1e15848a67e4746dd65a6 
> 
> Diff: https://reviews.apache.org/r/14084/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Darren Shepherd
> 
>

Re: www.cloudstack.org not resolving

[Tracy Phillips]

Matt,

Probably the contact listed in the whois

Domain ID:D150572512-LROR
Domain Name:CLOUDSTACK.ORG
Created On:07-Jan-2008 15:12:00 UTC
Last Updated On:12-Sep-2013 11:24:54 UTC
Expiration Date:07-Jan-2018 15:12:00 UTC
Sponsoring Registrar:Domain.com, LLC (R1915-LROR)
Status:TRANSFER PROHIBITED
Status:TRANSFERPERIOD
Registrant ID:tu7wMGD9wRRhInik
Registrant Name:Sheng Liang
Registrant Street1:PO Box 1644
Registrant Street2:
Registrant Street3:
Registrant City:Mountain View
Registrant State/Province:California
Registrant Postal Code:94042
Registrant Country:US
Registrant Phone:+1.6503945612
Registrant Phone Ext.:
Registrant FAX:
Registrant FAX Ext.:
Registrant Email:shengli...@gmail.com
Admin ID:tuwTxVMRjkR6lNM7
Admin Name:Sheng Liang
Admin Street1:PO Box 1644
Admin Street2:
Admin Street3:
Admin City:Mountain View
Admin State/Province:California
Admin Postal Code:94042
Admin Country:US
Admin Phone:+1.6503945612
Admin Phone Ext.:
Admin FAX:
Admin FAX Ext.:
Admin Email:shengli...@gmail.com
Tech ID:tuvYURg6jpeMiajb
Tech Name:Sheng Liang
Tech Street1:PO Box 1644
Tech Street2:
Tech Street3:
Tech City:Mountain View
Tech State/Province:California
Tech Postal Code:94042
Tech Country:US
Tech Phone:+1.6503945612
Tech Phone Ext.:
Tech FAX:
Tech FAX Ext.:
Tech Email:shengli...@gmail.com
Name Server:NS71.DOMAINCONTROL.COM
Name Server:NS72.DOMAINCONTROL.COM




On Fri, Sep 13, 2013 at 10:04 AM, Mathias Mullins <
mathias.mull...@citrix.com> wrote:

> David,
>
> Who do we need to reach out too? We are in day 3 of outage now?
>
> Matt
>
>
> On 9/11/13 9:58 PM, "David Nalley"  wrote:
>
> >The ASF has taken charge of the domains, but I suspect DNS is lagging a
> >bit.
> >
> >--David
> >
> >On Wed, Sep 11, 2013 at 9:03 PM, Mathias Mullins
> > wrote:
> >> Cloudstack.org isn't resolving.
> >>
> >> Cloudstack.apache.org is up and running.
> >>
> >> Do we need to get a hold of infrastructure?
> >>
> >> Matt Mullins
> >> Cloud Platforms Implementation Engineer
> >> Worldwide Cloud Services ­ Citrix System, Inc.
> >> +1 (407) 920-1107 ­ Office/Cell Phone
> >> matt.mull...@citrix.com
> >>
>
>

RE: [Proposal] Userdata Support for Hyper-V with KVP Data Exchange

[Donal Lafferty]

> -Original Message-
> From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com]
> Sent: 13 September 2013 17:40
> To: dev@cloudstack.apache.org
> Subject: Re: [Proposal] Userdata Support for Hyper-V with KVP Data
> Exchange
> 
> On 09/13/2013 08:51 AM, Donal Lafferty wrote:
> > IIRC, OpenStack puts userdata for Hyper-V guest VMs on a separate
> volume.  The guest can mount the volume and extract the data.
> >
> > However, I suggest we use Hyper-V's KVP Data Exchange mechanism
> instead.  Doing so keeps volume management and passing userdata cleanly
> separated.
> >
> > Feature Spec at
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Userdata+Suppo
> r
> > t+for+Hyper-V+with+KVP+Data+Exchange
> >
> 
> Why does Hyper-V need something specific?  Is userdata really hypervisor
> specific?  I though we just put the userdata on the VR?
> 
> Darren

The system VM gets its config before the network stack is initialised.  This 
prevents the data coming from the VR.  

There is no specific approach to passing user data.  In the case of Xen, the 
data is passed through pv_args.  KVM used to attach a disk, but AFAIK it has 
changed to a KVP mechanism.

Re: Build server was down?

[Chip Childers]

Use Jenkins.buildacloud.org

Sent from my iPhone

On Sep 13, 2013, at 12:08 PM, Gavin Lee  wrote:

> Seems http://jenkins.cloudstack.org/ could not be accessed all day.
> Will someone look on this?
>
> --
> Gavin

Re: run cloustack have a exeception

[Wei ZHOU]

你的运行环境是什么？

VirtualRouter MAC address NULL

[Soheil Eizadi]

I have not come across this when testing Basic Networking on 4.2, but on 
4.3/master with Advanced Networking I have a call to create the Virtual Router 
with Mac Address is NULL on call to prepare(). Is this normal?
-Soheil

2013-09-13 11:14:22,684 INFO  [o.a.c.n.e.InfobloxElement] 
(Job-Executor-9:ctx-288d1882) InfobloxDeviceElement called to prepare Host Name 
r-9-VM with DNS Domain acme.com Gateway 192.168.11.1 Netmask 192.168.11.0/24 
with MAC null with IPv4 192.168.11.1

Re: [Proposal] Userdata Support for Hyper-V with KVP Data Exchange

[Darren Shepherd]

On 09/13/2013 11:56 AM, Donal Lafferty wrote:


Ah, okay, so you're talking about this:  
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Admin_Guide/user-data-and-meta-data.html



Okay, that leads me back to my original question.  Why is that 
hypervisor specific?  That data comes from the VR right?  I know 
bootstrapping the VR with the boot args is hypervisor specific, but why 
user/metadata?


Darren

Re: www.cloudstack.org not resolving

[Mathias Mullins]

David, 

Who do we need to reach out too? We are in day 3 of outage now?

Matt 


On 9/11/13 9:58 PM, "David Nalley"  wrote:

>The ASF has taken charge of the domains, but I suspect DNS is lagging a
>bit.
>
>--David
>
>On Wed, Sep 11, 2013 at 9:03 PM, Mathias Mullins
> wrote:
>> Cloudstack.org isn't resolving.
>>
>> Cloudstack.apache.org is up and running.
>>
>> Do we need to get a hold of infrastructure?
>>
>> Matt Mullins
>> Cloud Platforms Implementation Engineer
>> Worldwide Cloud Services ­ Citrix System, Inc.
>> +1 (407) 920-1107 ­ Office/Cell Phone
>> matt.mull...@citrix.com
>>

RE: [Proposal] Userdata Support for Hyper-V with KVP Data Exchange

[Donal Lafferty]

> -Original Message-
> From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com]
> Sent: 13 September 2013 18:35
> To: dev@cloudstack.apache.org
> Subject: Re: [Proposal] Userdata Support for Hyper-V with KVP Data
> Exchange
> 
> On 09/13/2013 10:25 AM, Rajesh Battala wrote:
> >
> > To bring up the system vm's on the hyperv host we need to pass the boot
> args from host to the systemvm's.
> > To pass the data from hyperv host to systemvm guest we need this
> method.
> >
> 
> Oh maybe I'm getting terminology mixed up.  When you say userdata I think
> of the userdata a user can set on VM deploy.  What you are talking about is
> boot args, right?  Like in the systemvm on xenserver they show up in
> /proc/cmdline.
> 
> So which are we talking about?
> 
> Darren

Ah, okay, so you're talking about this:  
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Admin_Guide/user-data-and-meta-data.html

I'll have to clean up terminology in the proposal to clearly distinguish the 
data I'm talking about.

Thanks for the feedback!

DL

Build server was down?

[Gavin Lee]

Seems http://jenkins.cloudstack.org/ could not be accessed all day.
Will someone look on this?

-- 
Gavin

ConfigDepot initialization

[Darren Shepherd]

ConfigDepot(Admin) really needs to be initialized fully before anything 
else really.  I can move things around to get that to work almost.  The 
problem is with populateConfigurations().  That gets called twice.  Once 
in ConfigurationServerImpl.configure() and 
ConfigurationServerImpl.persistDefaultValues().


So the way the code is written it seems to specifically want to run 
populateConfigurations() after ConfigurationServerImpl does its thing. 
I need to reverse that.  I need populateConfiguration() to run first (or 
really completely independent of ConfigurationServerImpl).  Is there 
some problem with this?  I haven't actually tried it yet.


Darren

RE: ConfigDepot and null values and defaults

[Alex Huang]

> -Original Message-
> From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com]
> Sent: Friday, September 13, 2013 1:10 AM
> To: dev@cloudstack.apache.org; Alex Huang
> Subject: ConfigDepot and null values and defaults
> 
> If you have a configuration that the value is null and not dynamic, it still 
> hits
> the database on every read.  I'm thinking that's really not intentional.

I'll have to look at that when I come back from vacation.  I see a check in the 
code for dynamic before rereading from the dao.  Not sure why it's hitting the 
db on every read.

> 
> Additionally, if I have a key that is default value is 5, then I later change 
> the
> default to 10.  If the user never changed or set the value, I still get 5.  
> So this
> is where I kind of disagree with the implementation.

That's intentional.  Think of an user who already deployed CloudStack and then 
he upgrades.  The default has changed in the next version but it doesn't make 
sense for us to automatically adjust the value that the user was using before.  
It can significantly change their system's behavior.  I've talked about this in 
the wiki.  We do update the default value but not the value but we change the 
update column with a timestamp.  They can use that to figure out whether a 
config parameter's default value has changed from the value that they were 
using before.

Now, there's a difference in changing default values and a feature really need 
the value to be changed to the new default value in order for it to be useful.  
If a feature really needs the value to be now set to the new standard or else 
it has problems, that's an upgrade problem and should be handled in the upgrade 
portion of the feature. 

> 
> What I'd ideally like to see is that only when a value is explicitly changed 
> do
> we ever persist an entry to the configuration table.  Now I know that doesn't
> work with the current code as everything just hits the ConfigurationDao, but
> ideally I'd like to see it that way.  With the current implementation we have
> no way of really knowing of the field which were changed by somebody.

I think persisting everything to the configuration table does have its 
advantages.  For one thing, it becomes a central place for everyone to look for 
config parameters.  To achieve what you want, you can persist the row but 
always leave the value field empty to mean it was not edited by the sysadmin.  
Of course, I generally don't believe that should be the case due to what I said 
above.  I think someone using a previous version can get a rude awakening if 
they just update and suddenly things changed on them.

> 
> What I'd like to get to is that we can have a config page sort of like
> about:config in firefox.  In firefox there is a "status" column that is 
> "default"
> or "user set".  So as a user I know all the crap I changed, and easily I can
> revert to the defaults.
> 
> So if we stick with the current implementation where we throw everything in
> the DB (which I assume we will), then maybe we should have a column for
> "user set."
> 
> And also randomly, why is updated column == null mean that its obsolete?
>   I don't see any code to handle that, just the column description.
This is documented as one of the todos.  The code hasn't been added yet.

--Alex

Re: Advanced Networking Public Network Service Providers

[Chiradeep Vittal]

What services would you provide on the public network?
I see a similar discussion here:
http://goo.gl/eESveL

On 9/13/13 11:35 AM, "Soheil Eizadi"  wrote:

>In the Advanced Networking use cases you have two physical networks
>(Public and Guest Networks). What is the reason for the GUI not providing
>Network Service Provider configuration for the Public Network?
>Thanks,
>-Soheil

security around api.log

[Darren Shepherd]

I just noticed api.log which seems to log all the API access in a form like

2013-09-13 00:02:09,451 INFO  [a.c.c.a.ApiServer] 
(2011638958@qtp-657397168-0:ctx-81b1e088 ctx-174e4a62) (userId=2 
accountId=2 sessionId=7asvmtwoesbc6ia3e4kxtzrl) 127.0.0.1 -- GET 
command=listZones&response=json&sessionkey=ec6h46Om8a1y3d%2BhrdIpQ85cAfc%3D&_=1379055729422 
200 { "listzonesresponse" : { "count":1 ,"zone" : [ 
{"id":"cdaf82f1-3b57-4aa4-b3ce-b60173ed45f2","name":"zone1","dns1":"8.8.8.8","dns2":"8.8.4.4","internaldns1":"8.8.4.4","networktype":"Basic","securitygroupsenabled":true,"allocationstate":"Enabled","zonetoken":"6dce94e8-e8dc-3077-bfde-c6e8594bd449","dhcpprovider":"VirtualRouter","localstorageenabled":false} 
] } }


The sessionId and sessionKey is logged in the file.  I haven't tried it 
yet, but can't I use that info to hijack the session?  That introduces a 
security issue in that any server operator can now hijack anybody's 
session.  So that api.log file really needs to be protected in the same 
way a file with a password in it would be.


I would suggest that we just don't log the sessionId or sessionKey.

Darren

Re: [Proposal] Userdata Support for Hyper-V with KVP Data Exchange

[Chiradeep Vittal]

I believe DL is actually referring to boot args, not user/metadata

On 9/13/13 12:41 PM, "Darren Shepherd"  wrote:

>On 09/13/2013 11:56 AM, Donal Lafferty wrote:
>
>> Ah, okay, so you're talking about this:
>>http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Admi
>>n_Guide/user-data-and-meta-data.html
>>
>
>Okay, that leads me back to my original question.  Why is that
>hypervisor specific?  That data comes from the VR right?  I know
>bootstrapping the VR with the boot args is hypervisor specific, but why
>user/metadata?
>
>Darren
>

RE: win7+cygwin+cloudstack having a problem

[Donal Lafferty]

(Apologies if this was sent twice, I am having trouble responding to the 
message)... 

I sense a build problem, Let me explain:

Bean definitions cross reference .class files, e.g.

Administrator@cc-svr10 ~/github/cifs
$ grep -R iciraNvpDaoImpl * --include=*.xml.in
cloudstack/client/tomcatconf/componentContext.xml.in:  
cloudstack/client/tomcatconf/nonossComponentContext.xml.in:  


Notice I’m using .xml.in above.   The build copies these files and changes 
their extension to .xml

Next, check that the bean’s class has been deployed to the folder that Jetty 
will use, e.g. 

Administrator@cc-svr10 ~/github/cifs
$ grep -R "iciraNvpDaoImpl\.class" *
Binary file 
cloudstack/client/target/cloud-client-ui-4.3.0-SNAPSHOT/WEB-INF/lib/cloud-plugin-network-nvp-4.3.0-SNAPSHOT.jar
 matches
Binary file cloudstack/client/target/cloud-client-ui-4.3.0-SNAPSHOT.war matches
Binary file 
cloudstack/plugins/network-elements/nicira-nvp/target/cloud-plugin-network-nvp-4.3.0-SNAPSHOT.jar
 matches


If you don’t see any matches, then the command you used to build may be for an 
older version of CloudStack. ☹

This happens whenever we improve the build, because build updates are not 
backwards compatible.

If you are using the Windows Development instructions 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Setting+up+a+CloudStack+dev+environment+on+Windows
 , take a look at the update just I made to “Step 13) Build”.

If you have similar problems in the future, take a look at the most up to date 
build instructions, which are at 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack

DL

> From: [mailto:heids...@sina.com] 
> Sent: 13 September 2013 02:38
> To: dev
> Subject: win7+cygwin+cloudstack having a problem
>
> I am according to the github cloudstack source code for INSTANL.md 
> 1、cygwin is goode
> 2、database is goode
> 3、mvn -pl :cloud-client-ui jetty:run  
> exception detail:
> lassPostProcessor$ImportAwareBeanPostProcessor#0]; root of factory hierarchy
> ERROR [web.context.ContextLoader] (main:) Context initialization failed
> org.springframework.beans.factory.BeanCreationException: Error creating bean 
> with name 'niciraNvpDaoImpl' defined in class path resource 
> [componentContext.xml]: BeanPostProcessor before instantiation of bean 
> failed; nested exception is net.sf.cglib.core.CodeGenerationException: 
> java.lang.reflect.InvocationTargetException-->null
>        at 
>org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:452)
>        at 
>org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
>        at 
>org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
>        at 
>org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
>        at 
>org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
>        at 
>org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:609)
>        at 
>org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:918)
>
> what wrong?
>
> Thanks
> 
> Github:https://github.com/heidsoft
> Weibo: http://weibo.com/liuganbin
> Email:heids...@sina.com
> Tell:18601706743

Re: DhcpServiceProvider

[Chiradeep Vittal]

Soheil, agree that it needs to moved to NetworkElement and also needs
complementary remove()
It seems half-thought-out.

On 9/13/13 11:31 AM, "Soheil Eizadi"  wrote:

>Posting my questions again... -Soheil
>
>From: Soheil Eizadi [seiz...@infoblox.com]
>Sent: Friday, September 06, 2013 3:13 PM
>To: dev@cloudstack.apache.org
>Subject: DhcpServiceProvider
>
>I had not looked at the DhcpServiceProvider NetworkElement before, but
>after recent problem, I got a chance to look at it in more detail. I am
>new to CloudStack and don't have a lot of the history and had some
>questions.
>
>Is there a link to documentation for the DhcpServiceProvider work?
>
>I assume the main use case for DhcpServiceProvider is to support DHCP
>Daemon like DNSMasq, are there other use cases?
>
>The interface is simple enough:
>
>
>public interface DhcpServiceProvider extends NetworkElement {
>
>boolean addDhcpEntry(...) ...;
>
>boolean configDhcpSupportForSubnet(...) ...;
>
>boolean  removeDhcpSupportForSubnet(...) ...;
>
>}
>
>
>Is there a reason why the companion entry to addDhcpEntry() e.g.
>removeDhcpEntry() is missing?
>
>
>What is the motivation in adding this code to the NetworkManager versus
>contain it inside the NetworkElement providing the DHCP? (The logic I see
>in NetworkManager does not seem to be adding any value. Also it is adding
>a specific network function DHCP to the NetworkManager, where we are
>moving functions e.g. IP Address Allocation out.)

RE: what wrong? start cloudstack

[Donal Lafferty]

(Apologies if this was sent twice, I am having trouble responding to the 
message)... 

I sense a build problem, Let me explain:

Bean definitions cross reference .class files, e.g.

Administrator@cc-svr10 ~/github/cifs
$ grep -R iciraNvpDaoImpl * --include=*.xml.in
cloudstack/client/tomcatconf/componentContext.xml.in:  
cloudstack/client/tomcatconf/nonossComponentContext.xml.in:  


Notice I’m using .xml.in above.   The build copies these files and changes 
their extension to .xml

Next, check that the bean’s class has been deployed to the folder that Jetty 
will use, e.g. 

Administrator@cc-svr10 ~/github/cifs
$ grep -R "iciraNvpDaoImpl\.class" *
Binary file 
cloudstack/client/target/cloud-client-ui-4.3.0-SNAPSHOT/WEB-INF/lib/cloud-plugin-network-nvp-4.3.0-SNAPSHOT.jar
 matches Binary file 
cloudstack/client/target/cloud-client-ui-4.3.0-SNAPSHOT.war matches Binary file 
cloudstack/plugins/network-elements/nicira-nvp/target/cloud-plugin-network-nvp-4.3.0-SNAPSHOT.jar
 matches


If you don’t see any matches, then the command you used to build may be for an 
older version of CloudStack. ☹

This happens whenever we improve the build, because build updates are not 
backwards compatible.

If you are using the Windows Development instructions 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Setting+up+a+CloudStack+dev+environment+on+Windows
 , take a look at the update just I made to “Step 13) Build”.

If you have similar problems in the future, take a look at the most up to date 
build instructions, which are at 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack

DL


> -Original Message-
> From: 黑洞 [mailto:heids...@sina.com]
> Sent: 13 September 2013 06:48
> To: dev
> Subject: what wrong? start cloudstack
> 
> when I execut "mvn -pl :cloud-client-ui jetty:run"
> hava follow exception:
> 
> 
>  ERROR [web.context.ContextLoader] (main:) Context initialization failed
> org.springframework.beans.factory.BeanCreationException: Error creating
> bean with name 'niciraNvpDaoImpl' defined in class path resource
> [componentContext.xml]: BeanPostProcessor before instantiation of bean
> failed; nested exception is net.sf.cglib.core.CodeGenerationException:
> java.lang.reflect.InvocationTargetException-->null
> at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanF
> actory.createBean(AbstractAutowireCapableBeanFactory.java:452)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory$1.getObje
> ct(AbstractBeanFactory.java:294)
> at
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.g
> etSingleton(DefaultSingletonBeanRegistry.java:225)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBea
> n(AbstractBeanFactory.java:291)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(A
> bstractBeanFactory.java:193)
> at
> org.springframework.beans.factory.support.DefaultListableBeanFactory.preI
> nstantiateSingletons(DefaultListableBeanFactory.java:609)
> at
> org.springframework.context.support.AbstractApplicationContext.finishBea
> nFactoryInitialization(AbstractApplicationContext.java:918)
> at
> org.springframework.context.support.AbstractApplicationContext.refresh(A
> bstractApplicationContext.java:469)
> at
> org.springframework.web.context.ContextLoader.configureAndRefreshWeb
> ApplicationContext(ContextLoader.java:383)
> at
> org.springframework.web.context.ContextLoader.initWebApplicationContex
> t(ContextLoader.java:283)
> at
> org.springframework.web.context.ContextLoaderListener.contextInitialized(
> ContextLoaderListener.java:111)
> at
> org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.jav
> a:549)
> 
> 
> 
> 
> what Wrong?
> 
> 
> Thanks
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 云计算基础架构师
> Github:https://github.com/heidsoftWeibo: http://weibo.com/liuganbin
> 研究方向：云计算（云安全）、大数据（数据处理分析）
> 主要学习: Linux / C / C++ / JAVA
> Email:heids...@sina.com
> Tell:18601706743
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 某云计算公司
> 
> 
> 
> 
> 
> Jake.liu@heidsoft黑洞
> 
> 
> 
> 
> 云计算系统架构师
> 
> 
> 
> 
> 
> 
> 
> 
>840608792
> 
> 
> 
> 
> 
> heidso...@gmail.com
> 
> 
> 
> 
> 
>  weibo.com/liuganbin
> 
> 
> 
> 
> 
>  上海 徐汇区
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 名片二维码
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> - 原始邮件 -
> 发件人：Mike Tutkowski 
> 收件人："dev@cloudstack.apache.org" 
> 抄送人：Amit Das 
> 主题：Re: Which DevCloud2 Usage Mode is good for Development and
> Debugging 
> 日期：2013年09月13日 07点33分
> 

Re: Q's about UserAuthenticators and getName()

[Darren Shepherd]

On 09/12/2013 10:56 PM, Ian Duffy wrote:

So my problem is that LDAP currently has a null name on getName().  So

which should I do?  Add

Go ahead and add it. I missed that override in error.


Okay I created https://reviews.apache.org/r/14126/

Darren

Error in start MS in master

[Min Chen]

Hi there,

Did anybody experience any issues in starting MS in latest master? I ran into 
the following issue:

org.springframework.beans.factory.BeanCreationException: Could not autowire 
field: org.apache.cloudstack.framework.config.dao.ConfigurationDao 
org.apache.cloudstack.framework.config.impl.ConfigDepotImpl._configDao; nested 
exception is org.springframework.beans.factory.CannotLoadBeanClassException: 
Cannot find class [com.cloud.ha.VmwareFencer] for bean with name 'VmwareFencer' 
defined in class path resource [nonossComponentContext.xml]; nested exception 
is java.lang.ClassNotFoundException: com.cloud.ha.VmwareFencer
at 
org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:287)
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1106)
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:517)


Thanks
-min

Re: win7+cygwin+cloudstack having a problem

[Punith s]

are you using a devcloud or a production evironment ??

regards,
punith s
cloudbyte


On Fri, Sep 13, 2013 at 7:08 AM, 黑洞  wrote:

> I am according to the github cloudstack source code for INSTANL.md
>  1、cygwin is goode
> 2、database is goode
> 3、mvn -pl :cloud-client-ui jetty:run
> exception detail:
>  lassPostProcessor$ImportAwareBeanPostProcessor#0]; root of factory
> hierarchy
> ERROR [web.context.ContextLoader] (main:) Context initialization failed
> org.springframework.beans.factory.BeanCreationException: Error creating
> bean with name 'niciraNvpDaoImpl' defined in class path resource
> [componentContext.xml]: BeanPostProcessor before instantiation of bean
> failed; nested exception is net.sf.cglib.core.CodeGenerationException:
> java.lang.reflect.InvocationTargetException-->null
> at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:452)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
> at
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
> at
> org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:609)
> at
> org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:918)
>
> what wrong?
>
> Thanks
>
> 云计算基础架构师
> Github:https://github.com/heidsoft
> Weibo: http://weibo.com/liuganbin
> 研究方向：云计算（云安全）、大数据（数据处理分析）
> 主要学习: Linux / C / C++ / JAVA /Python
> Email:heids...@sina.com
> Tell:18601706743
>

Re: security around api.log

[Ian Duffy]

>  I haven't tried it yet, but can't I use that info to hijack the session?

You can...

Create a cookie: (please excuse the full stops as spaces, didn't trust it
to render correctly)

Key... Value
JSESSIONID  7asvmtwoesbc6ia3e4kxtzrl
sessionKey ... ec6h46Om8a1y3d%252BhrdIpQ85cAfc%25**3D

and pass all requests with a parameter of:
sessionkey = ec6h46Om8a1y3d%2BhrdIpQ85cAfc%**3D

>  So that api.log file really needs to be protected in the same way a file
with a password in it would be

I don't have the manager deployed anywhere to test this but I would hope
the log file is read/write only to the owner user.

> I would suggest that we just don't log the sessionId or sessionKey.

+1 to that.


On 13 September 2013 21:40, Darren Shepherd wrote:

> I just noticed api.log which seems to log all the API access in a form like
>
> 2013-09-13 00:02:09,451 INFO  [a.c.c.a.ApiServer] (2011638958@qtp-
> 657397168-0:ctx-81b1e088 ctx-174e4a62) (userId=2 accountId=2 
> sessionId=**7asvmtwoesbc6ia3e4kxtzrl)
> 127.0.0.1 -- GET command=listZones&response=**json&sessionkey=**
> ec6h46Om8a1y3d%2BhrdIpQ85cAfc%**3D&_=1379055729422 200 {
> "listzonesresponse" : { "count":1 ,"zone" : [ {"id":"cdaf82f1-3b57-4aa4-**
> b3ce-b60173ed45f2","name":"**zone1","dns1":"8.8.8.8","dns2"**
> :"8.8.4.4","internaldns1":"8.**8.4.4","networktype":"Basic","**
> securitygroupsenabled":true,"**allocationstate":"Enabled","**
> zonetoken":"6dce94e8-e8dc-**3077-bfde-c6e8594bd449","**
> dhcpprovider":"VirtualRouter",**"localstorageenabled":false} ] } }
>
> The sessionId and sessionKey is logged in the file.  I haven't tried it
> yet, but can't I use that info to hijack the session?  That introduces a
> security issue in that any server operator can now hijack anybody's
> session.  So that api.log file really needs to be protected in the same way
> a file with a password in it would be.
>
> I would suggest that we just don't log the sessionId or sessionKey.
>
> Darren
>

RE: Advanced Networking Public Network Service Providers

[Soheil Eizadi]

The main use case is providing DNS for the Public Network, but could also 
provide DHCP and IP Address Management once we work out the Interface for 
making External IPAM authoritative for CloudStack.

Yes agree, much of the discussion on the thread you attached applies here also, 
is it more complicated than enabling the UI to prompt for a service offering to 
be bound to the public network and GUI to configure providers?
-Soheil 

From: Chiradeep Vittal [chiradeep.vit...@citrix.com]
Sent: Friday, September 13, 2013 1:26 PM
To: dev@cloudstack.apache.org
Subject: Re: Advanced Networking Public Network Service Providers

What services would you provide on the public network?
I see a similar discussion here:
http://goo.gl/eESveL

On 9/13/13 11:35 AM, "Soheil Eizadi"  wrote:

>In the Advanced Networking use cases you have two physical networks
>(Public and Guest Networks). What is the reason for the GUI not providing
>Network Service Provider configuration for the Public Network?
>Thanks,
>-Soheil

RE: [Proposal] Userdata Support for Hyper-V with KVP Data Exchange

[Donal Lafferty]

Yep.  I'll recirculate the proposal next week.

DL

> -Original Message-
> From: Chiradeep Vittal [mailto:chiradeep.vit...@citrix.com]
> Sent: 13 September 2013 21:16
> To: dev@cloudstack.apache.org
> Subject: Re: [Proposal] Userdata Support for Hyper-V with KVP Data
> Exchange
> 
> I believe DL is actually referring to boot args, not user/metadata
> 
> On 9/13/13 12:41 PM, "Darren Shepherd" 
> wrote:
> 
> >On 09/13/2013 11:56 AM, Donal Lafferty wrote:
> >
> >> Ah, okay, so you're talking about this:
> >>http://cloudstack.apache.org/docs/en-
> US/Apache_CloudStack/4.1.1/html/A
> >>dmi
> >>n_Guide/user-data-and-meta-data.html
> >>
> >
> >Okay, that leads me back to my original question.  Why is that
> >hypervisor specific?  That data comes from the VR right?  I know
> >bootstrapping the VR with the boot args is hypervisor specific, but why
> >user/metadata?
> >
> >Darren
> >

[VOTE] Apache CloudStack CloudMonkey 5.0.0 (first round)

[Chip Childers]

I've created a 5.0.0 release of cloudmonkey, with the following artifacts
up for a
vote:

Git Branch and Commit SH:
https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=shortlog;h=refs/heads/5.0
Commit: 767bfbe084e24d441f1ad73ace183c09f26a276b

List of changes:
https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=blob;f=CHANGES;h=54f2e32357b0a726dc6f202e4897ed4af531f8ab;hb=refs/heads/5.0

Source release (checksums and signatures are available at the same
location):
https://dist.apache.org/repos/dist/dev/cloudstack/cloudmonkey-5.0.0/

PGP release keys (signed using 94BE0D7C):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

I have not created testing instructions for this release artifact, but
would appreciate help documenting it as people to it.

Vote will be open for at least 72 hours.

For sanity in tallying the vote, can PMC members please be sure to indicate
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Thanks,

-chip

Adding Domain name to the .header style

[al bell]

Is there a list of variables that can be added to the .header style ? As we
have a deployment with multiple domains and subdomains, it will be very
useful to add this in the header, to the left of the user name.

Thanks

Managed storage with KVM

[Mike Tutkowski]

Hi,

As you may remember, during the 4.2 release I developed a SolidFire
(storage) plug-in for CloudStack.

This plug-in was invoked by the storage framework at the necessary times so
that I could dynamically create and delete volumes on the SolidFire SAN
(among other activities).

This is necessary so I can establish a 1:1 mapping between a CloudStack
volume and a SolidFire volume for QoS.

In the past, CloudStack always expected the admin to create large volumes
ahead of time and those volumes would likely house many root and data disks
(which is not QoS friendly).

To make this 1:1 mapping scheme work, I needed to modify logic in the
XenServer and VMware plug-ins so they could create/delete storage
repositories/datastores as needed.

For 4.3 I want to make this happen with KVM.

I'm coming up to speed with how this might work on KVM, but I'm still
pretty new to KVM.

Does anyone familiar with KVM know how I will need to interact with the
iSCSI target? For example, will I have to expect Open iSCSI will be
installed on the KVM host and use it for this to work?

Thanks for any suggestions,
Mike

-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*

Apache CloudStack 4.2.0 (fifth round)

[Animesh Chaturvedi]

I've created a 4.2.0 release, with the following artifacts up for a vote:

Git Branch and Commit SH:
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.2
Commit: c1e24ff89f6d14d6ae74d12dbca108c35449030f
  
List of changes:
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blob_plain;f=CHANGES;hb=4.2

Source release (checksums and signatures are available at the same
location):
https://dist.apache.org/repos/dist/dev/cloudstack/4.2.0/

PGP release keys (signed using 94BE0D7C):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

Testing instructions are here:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Release+test+procedure

Vote will be open for 72 hours (Wednesday 9/18 End of Day PST).

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Re: DhcpServiceProvider

[Sheng Yang]

In the original implementation, the new dhcp entry would automatically
override the old one, so the old entry hasn't been removed explicitly.

But still, it would be better to get it done explicitly of course.

--Sheng


On Fri, Sep 13, 2013 at 1:20 PM, Chiradeep Vittal <
chiradeep.vit...@citrix.com> wrote:

> Soheil, agree that it needs to moved to NetworkElement and also needs
> complementary remove()
> It seems half-thought-out.
>
> On 9/13/13 11:31 AM, "Soheil Eizadi"  wrote:
>
> >Posting my questions again... -Soheil
> >
> >From: Soheil Eizadi [seiz...@infoblox.com]
> >Sent: Friday, September 06, 2013 3:13 PM
> >To: dev@cloudstack.apache.org
> >Subject: DhcpServiceProvider
> >
> >I had not looked at the DhcpServiceProvider NetworkElement before, but
> >after recent problem, I got a chance to look at it in more detail. I am
> >new to CloudStack and don't have a lot of the history and had some
> >questions.
> >
> >Is there a link to documentation for the DhcpServiceProvider work?
> >
> >I assume the main use case for DhcpServiceProvider is to support DHCP
> >Daemon like DNSMasq, are there other use cases?
> >
> >The interface is simple enough:
> >
> >
> >public interface DhcpServiceProvider extends NetworkElement {
> >
> >boolean addDhcpEntry(...) ...;
> >
> >boolean configDhcpSupportForSubnet(...) ...;
> >
> >boolean  removeDhcpSupportForSubnet(...) ...;
> >
> >}
> >
> >
> >Is there a reason why the companion entry to addDhcpEntry() e.g.
> >removeDhcpEntry() is missing?
> >
> >
> >What is the motivation in adding this code to the NetworkManager versus
> >contain it inside the NetworkElement providing the DHCP? (The logic I see
> >in NetworkManager does not seem to be adding any value. Also it is adding
> >a specific network function DHCP to the NetworkManager, where we are
> >moving functions e.g. IP Address Allocation out.)
>
>

Re: Managed storage with KVM

[Marcus Sorensen]

Yes, my guess is that you will need the iscsi initiator utilities
installed. There should be standard packages for any distro. Then you'd
call an agent storage adaptor to do the initiator login. See the info I
sent previously about LibvirtStorageAdaptor.java and libvirt iscsi storage
type to see if that fits your need.
On Sep 13, 2013 4:55 PM, "Mike Tutkowski" 
wrote:

> Hi,
>
> As you may remember, during the 4.2 release I developed a SolidFire
> (storage) plug-in for CloudStack.
>
> This plug-in was invoked by the storage framework at the necessary times
> so that I could dynamically create and delete volumes on the SolidFire SAN
> (among other activities).
>
> This is necessary so I can establish a 1:1 mapping between a CloudStack
> volume and a SolidFire volume for QoS.
>
> In the past, CloudStack always expected the admin to create large volumes
> ahead of time and those volumes would likely house many root and data disks
> (which is not QoS friendly).
>
> To make this 1:1 mapping scheme work, I needed to modify logic in the
> XenServer and VMware plug-ins so they could create/delete storage
> repositories/datastores as needed.
>
> For 4.3 I want to make this happen with KVM.
>
> I'm coming up to speed with how this might work on KVM, but I'm still
> pretty new to KVM.
>
> Does anyone familiar with KVM know how I will need to interact with the
> iSCSI target? For example, will I have to expect Open iSCSI will be
> installed on the KVM host and use it for this to work?
>
> Thanks for any suggestions,
> Mike
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the 
> cloud
> *™*
>

Re: Apache CloudStack 4.2.0 (fifth round)

[Sheng Yang]

+1.

--Sheng


On Fri, Sep 13, 2013 at 4:12 PM, Animesh Chaturvedi <
animesh.chaturv...@citrix.com> wrote:

>
> I've created a 4.2.0 release, with the following artifacts up for a vote:
>
> Git Branch and Commit SH:
>
> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.2
> Commit: c1e24ff89f6d14d6ae74d12dbca108c35449030f
>
> List of changes:
>
> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blob_plain;f=CHANGES;hb=4.2
>
> Source release (checksums and signatures are available at the same
> location):
> https://dist.apache.org/repos/dist/dev/cloudstack/4.2.0/
>
> PGP release keys (signed using 94BE0D7C):
> https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>
> Testing instructions are here:
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Release+test+procedure
>
> Vote will be open for 72 hours (Wednesday 9/18 End of Day PST).
>
> For sanity in tallying the vote, can PMC members please be sure to
> indicate "(binding)" with their vote?
>
> [ ] +1  approve
> [ ] +0  no opinion
> [ ] -1  disapprove (and reason why)
>
>

Re: Managed storage with KVM

[Mike Tutkowski]

OK, thanks, Marcus

I am currently looking through some of the classes you pointed out last
week or so.


On Fri, Sep 13, 2013 at 5:26 PM, Marcus Sorensen wrote:

> Yes, my guess is that you will need the iscsi initiator utilities
> installed. There should be standard packages for any distro. Then you'd
> call an agent storage adaptor to do the initiator login. See the info I
> sent previously about LibvirtStorageAdaptor.java and libvirt iscsi storage
> type to see if that fits your need.
> On Sep 13, 2013 4:55 PM, "Mike Tutkowski" 
> wrote:
>
>> Hi,
>>
>> As you may remember, during the 4.2 release I developed a SolidFire
>> (storage) plug-in for CloudStack.
>>
>> This plug-in was invoked by the storage framework at the necessary times
>> so that I could dynamically create and delete volumes on the SolidFire SAN
>> (among other activities).
>>
>> This is necessary so I can establish a 1:1 mapping between a CloudStack
>> volume and a SolidFire volume for QoS.
>>
>> In the past, CloudStack always expected the admin to create large volumes
>> ahead of time and those volumes would likely house many root and data disks
>> (which is not QoS friendly).
>>
>> To make this 1:1 mapping scheme work, I needed to modify logic in the
>> XenServer and VMware plug-ins so they could create/delete storage
>> repositories/datastores as needed.
>>
>> For 4.3 I want to make this happen with KVM.
>>
>> I'm coming up to speed with how this might work on KVM, but I'm still
>> pretty new to KVM.
>>
>> Does anyone familiar with KVM know how I will need to interact with the
>> iSCSI target? For example, will I have to expect Open iSCSI will be
>> installed on the KVM host and use it for this to work?
>>
>> Thanks for any suggestions,
>> Mike
>>
>> --
>> *Mike Tutkowski*
>> *Senior CloudStack Developer, SolidFire Inc.*
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the 
>> cloud
>> *™*
>>
>


-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*

Re: Managed storage with KVM

[Mike Tutkowski]

So, Marcus, I need to investigate libvirt more, but you figure it supports
connecting to/disconnecting from iSCSI targets, right?


On Fri, Sep 13, 2013 at 5:29 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> OK, thanks, Marcus
>
> I am currently looking through some of the classes you pointed out last
> week or so.
>
>
> On Fri, Sep 13, 2013 at 5:26 PM, Marcus Sorensen wrote:
>
>> Yes, my guess is that you will need the iscsi initiator utilities
>> installed. There should be standard packages for any distro. Then you'd
>> call an agent storage adaptor to do the initiator login. See the info I
>> sent previously about LibvirtStorageAdaptor.java and libvirt iscsi storage
>> type to see if that fits your need.
>>  On Sep 13, 2013 4:55 PM, "Mike Tutkowski" 
>> wrote:
>>
>>> Hi,
>>>
>>> As you may remember, during the 4.2 release I developed a SolidFire
>>> (storage) plug-in for CloudStack.
>>>
>>> This plug-in was invoked by the storage framework at the necessary times
>>> so that I could dynamically create and delete volumes on the SolidFire SAN
>>> (among other activities).
>>>
>>> This is necessary so I can establish a 1:1 mapping between a CloudStack
>>> volume and a SolidFire volume for QoS.
>>>
>>> In the past, CloudStack always expected the admin to create large
>>> volumes ahead of time and those volumes would likely house many root and
>>> data disks (which is not QoS friendly).
>>>
>>> To make this 1:1 mapping scheme work, I needed to modify logic in the
>>> XenServer and VMware plug-ins so they could create/delete storage
>>> repositories/datastores as needed.
>>>
>>> For 4.3 I want to make this happen with KVM.
>>>
>>> I'm coming up to speed with how this might work on KVM, but I'm still
>>> pretty new to KVM.
>>>
>>> Does anyone familiar with KVM know how I will need to interact with the
>>> iSCSI target? For example, will I have to expect Open iSCSI will be
>>> installed on the KVM host and use it for this to work?
>>>
>>> Thanks for any suggestions,
>>> Mike
>>>
>>> --
>>> *Mike Tutkowski*
>>> *Senior CloudStack Developer, SolidFire Inc.*
>>> e: mike.tutkow...@solidfire.com
>>> o: 303.746.7302
>>> Advancing the way the world uses the 
>>> cloud
>>> *™*
>>>
>>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the 
> cloud
> *™*
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*

Re: Managed storage with KVM

[Marcus Sorensen]

Take a look at this:

http://libvirt.org/storage.html#StorageBackendISCSI

"Volumes must be pre-allocated on the iSCSI server, and cannot be
created via the libvirt APIs.", which I believe your plugin will take
care of. Libvirt just does the work of logging in and hooking it up to
the VM (I believe the Xen api does that work in the Xen stuff).

What I'm not sure about is whether this provides a 1:1 mapping, or if
it just allows you to register 1 iscsi device as a pool. You may need
to write some test code or read up a bit more about this. Let us know.
If it doesn't, you may just have to write your own storage adaptor
rather than changing LibvirtStorageAdaptor.java.  We can cross that
bridge when we get there.

As far as interfacing with libvirt, see the java bindings doc.
http://libvirt.org/sources/java/javadoc/  Normally, you'll see a
connection object be made, then calls made to that 'conn' object. You
can look at the LibvirtStorageAdaptor to see how that is done for
other pool types, and maybe write some test java code to see if you
can interface with libvirt and register iscsi storage pools before you
get started.

On Fri, Sep 13, 2013 at 5:31 PM, Mike Tutkowski
 wrote:
> So, Marcus, I need to investigate libvirt more, but you figure it supports
> connecting to/disconnecting from iSCSI targets, right?
>
>
> On Fri, Sep 13, 2013 at 5:29 PM, Mike Tutkowski
>  wrote:
>>
>> OK, thanks, Marcus
>>
>> I am currently looking through some of the classes you pointed out last
>> week or so.
>>
>>
>> On Fri, Sep 13, 2013 at 5:26 PM, Marcus Sorensen 
>> wrote:
>>>
>>> Yes, my guess is that you will need the iscsi initiator utilities
>>> installed. There should be standard packages for any distro. Then you'd call
>>> an agent storage adaptor to do the initiator login. See the info I sent
>>> previously about LibvirtStorageAdaptor.java and libvirt iscsi storage type
>>> to see if that fits your need.
>>>
>>> On Sep 13, 2013 4:55 PM, "Mike Tutkowski" 
>>> wrote:

 Hi,

 As you may remember, during the 4.2 release I developed a SolidFire
 (storage) plug-in for CloudStack.

 This plug-in was invoked by the storage framework at the necessary times
 so that I could dynamically create and delete volumes on the SolidFire SAN
 (among other activities).

 This is necessary so I can establish a 1:1 mapping between a CloudStack
 volume and a SolidFire volume for QoS.

 In the past, CloudStack always expected the admin to create large
 volumes ahead of time and those volumes would likely house many root and
 data disks (which is not QoS friendly).

 To make this 1:1 mapping scheme work, I needed to modify logic in the
 XenServer and VMware plug-ins so they could create/delete storage
 repositories/datastores as needed.

 For 4.3 I want to make this happen with KVM.

 I'm coming up to speed with how this might work on KVM, but I'm still
 pretty new to KVM.

 Does anyone familiar with KVM know how I will need to interact with the
 iSCSI target? For example, will I have to expect Open iSCSI will be
 installed on the KVM host and use it for this to work?

 Thanks for any suggestions,
 Mike

 --
 Mike Tutkowski
 Senior CloudStack Developer, SolidFire Inc.
 e: mike.tutkow...@solidfire.com
 o: 303.746.7302
 Advancing the way the world uses the cloud™
>>
>>
>>
>>
>> --
>> Mike Tutkowski
>> Senior CloudStack Developer, SolidFire Inc.
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the cloud™
>
>
>
>
> --
> Mike Tutkowski
> Senior CloudStack Developer, SolidFire Inc.
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the cloud™

RE: Apache CloudStack 4.2.0 (fifth round)

[Vijayendra Bhamidipati]

+1


-Original Message-
From: Animesh Chaturvedi [mailto:animesh.chaturv...@citrix.com] 
Sent: Friday, September 13, 2013 4:13 PM
To: dev@cloudstack.apache.org
Subject: Apache CloudStack 4.2.0 (fifth round)


I've created a 4.2.0 release, with the following artifacts up for a vote:

Git Branch and Commit SH:
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.2
Commit: c1e24ff89f6d14d6ae74d12dbca108c35449030f
  
List of changes:
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blob_plain;f=CHANGES;hb=4.2

Source release (checksums and signatures are available at the same
location):
https://dist.apache.org/repos/dist/dev/cloudstack/4.2.0/

PGP release keys (signed using 94BE0D7C):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

Testing instructions are here:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Release+test+procedure

Vote will be open for 72 hours (Wednesday 9/18 End of Day PST).

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Re: ConfigDepot and null values and defaults

[Darren Shepherd]

Alex,

Here's my general problem.  I like to make just about everything configurable, 
but the reality is that only about 5% of setting will ever matter to people.  
So these are really internal flags to tweak things.  So for stuff like that I 
don't want the first ever default I chose to be saved forever.  Or even the 
persisted to the DB really.  So it's like the difference between the 
preferences dialog in Firefox and about:config.  Where can I put my "this may 
void your warranty" settings?

Darren

On Sep 13, 2013, at 1:04 PM, Alex  Huang  wrote:

> 
> 
>> -Original Message-
>> From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com]
>> Sent: Friday, September 13, 2013 1:10 AM
>> To: dev@cloudstack.apache.org; Alex Huang
>> Subject: ConfigDepot and null values and defaults
>> 
>> If you have a configuration that the value is null and not dynamic, it still 
>> hits
>> the database on every read.  I'm thinking that's really not intentional.
> 
> I'll have to look at that when I come back from vacation.  I see a check in 
> the code for dynamic before rereading from the dao.  Not sure why it's 
> hitting the db on every read.
> 
>> 
>> Additionally, if I have a key that is default value is 5, then I later 
>> change the
>> default to 10.  If the user never changed or set the value, I still get 5.  
>> So this
>> is where I kind of disagree with the implementation.
> 
> That's intentional.  Think of an user who already deployed CloudStack and 
> then he upgrades.  The default has changed in the next version but it doesn't 
> make sense for us to automatically adjust the value that the user was using 
> before.  It can significantly change their system's behavior.  I've talked 
> about this in the wiki.  We do update the default value but not the value but 
> we change the update column with a timestamp.  They can use that to figure 
> out whether a config parameter's default value has changed from the value 
> that they were using before.
> 
> Now, there's a difference in changing default values and a feature really 
> need the value to be changed to the new default value in order for it to be 
> useful.  If a feature really needs the value to be now set to the new 
> standard or else it has problems, that's an upgrade problem and should be 
> handled in the upgrade portion of the feature. 
> 
>> 
>> What I'd ideally like to see is that only when a value is explicitly changed 
>> do
>> we ever persist an entry to the configuration table.  Now I know that doesn't
>> work with the current code as everything just hits the ConfigurationDao, but
>> ideally I'd like to see it that way.  With the current implementation we have
>> no way of really knowing of the field which were changed by somebody.
> 
> I think persisting everything to the configuration table does have its 
> advantages.  For one thing, it becomes a central place for everyone to look 
> for config parameters.  To achieve what you want, you can persist the row but 
> always leave the value field empty to mean it was not edited by the sysadmin. 
>  Of course, I generally don't believe that should be the case due to what I 
> said above.  I think someone using a previous version can get a rude 
> awakening if they just update and suddenly things changed on them.
> 
>> 
>> What I'd like to get to is that we can have a config page sort of like
>> about:config in firefox.  In firefox there is a "status" column that is 
>> "default"
>> or "user set".  So as a user I know all the crap I changed, and easily I can
>> revert to the defaults.
>> 
>> So if we stick with the current implementation where we throw everything in
>> the DB (which I assume we will), then maybe we should have a column for
>> "user set."
>> 
>> And also randomly, why is updated column == null mean that its obsolete?
>>  I don't see any code to handle that, just the column description.
> This is documented as one of the todos.  The code hasn't been added yet.
> 
> --Alex

Re: Apache CloudStack 4.2.0 (fifth round)

[Hugo Trippaers]

+1 (binding)

Tested:
Nicira NVP plugin with XenServer
Nicira NVP plugin with VMWare
VPC with other service providers (NiciraNVP)

Cheers,

Hugo

Sent from my iPhone

On 14 sep. 2013, at 08:17, Vijayendra Bhamidipati 
 wrote:

> +1
> 
> 
> -Original Message-
> From: Animesh Chaturvedi [mailto:animesh.chaturv...@citrix.com] 
> Sent: Friday, September 13, 2013 4:13 PM
> To: dev@cloudstack.apache.org
> Subject: Apache CloudStack 4.2.0 (fifth round)
> 
> 
> I've created a 4.2.0 release, with the following artifacts up for a vote:
> 
> Git Branch and Commit SH:
> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.2
> Commit: c1e24ff89f6d14d6ae74d12dbca108c35449030f
> 
> List of changes:
> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blob_plain;f=CHANGES;hb=4.2
> 
> Source release (checksums and signatures are available at the same
> location):
> https://dist.apache.org/repos/dist/dev/cloudstack/4.2.0/
> 
> PGP release keys (signed using 94BE0D7C):
> https://dist.apache.org/repos/dist/release/cloudstack/KEYS
> 
> Testing instructions are here:
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Release+test+procedure
> 
> Vote will be open for 72 hours (Wednesday 9/18 End of Day PST).
> 
> For sanity in tallying the vote, can PMC members please be sure to indicate 
> "(binding)" with their vote?
> 
> [ ] +1  approve
> [ ] +0  no opinion
> [ ] -1  disapprove (and reason why)
> 

Re: ConfigDepot and null values and defaults

[Darren Shepherd]

Honestly, doesn't really matter that much.  Just as long as I understand the 
intended behavior.

Darren

On Sep 13, 2013, at 5:41 PM, Darren Shepherd  
wrote:

> Alex,
> 
> Here's my general problem.  I like to make just about everything 
> configurable, but the reality is that only about 5% of setting will ever 
> matter to people.  So these are really internal flags to tweak things.  So 
> for stuff like that I don't want the first ever default I chose to be saved 
> forever.  Or even the persisted to the DB really.  So it's like the 
> difference between the preferences dialog in Firefox and about:config.  Where 
> can I put my "this may void your warranty" settings?
> 
> Darren
> 
> On Sep 13, 2013, at 1:04 PM, Alex  Huang  wrote:
> 
>> 
>> 
>>> -Original Message-
>>> From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com]
>>> Sent: Friday, September 13, 2013 1:10 AM
>>> To: dev@cloudstack.apache.org; Alex Huang
>>> Subject: ConfigDepot and null values and defaults
>>> 
>>> If you have a configuration that the value is null and not dynamic, it 
>>> still hits
>>> the database on every read.  I'm thinking that's really not intentional.
>> 
>> I'll have to look at that when I come back from vacation.  I see a check in 
>> the code for dynamic before rereading from the dao.  Not sure why it's 
>> hitting the db on every read.
>> 
>>> 
>>> Additionally, if I have a key that is default value is 5, then I later 
>>> change the
>>> default to 10.  If the user never changed or set the value, I still get 5.  
>>> So this
>>> is where I kind of disagree with the implementation.
>> 
>> That's intentional.  Think of an user who already deployed CloudStack and 
>> then he upgrades.  The default has changed in the next version but it 
>> doesn't make sense for us to automatically adjust the value that the user 
>> was using before.  It can significantly change their system's behavior.  
>> I've talked about this in the wiki.  We do update the default value but not 
>> the value but we change the update column with a timestamp.  They can use 
>> that to figure out whether a config parameter's default value has changed 
>> from the value that they were using before.
>> 
>> Now, there's a difference in changing default values and a feature really 
>> need the value to be changed to the new default value in order for it to be 
>> useful.  If a feature really needs the value to be now set to the new 
>> standard or else it has problems, that's an upgrade problem and should be 
>> handled in the upgrade portion of the feature. 
>> 
>>> 
>>> What I'd ideally like to see is that only when a value is explicitly 
>>> changed do
>>> we ever persist an entry to the configuration table.  Now I know that 
>>> doesn't
>>> work with the current code as everything just hits the ConfigurationDao, but
>>> ideally I'd like to see it that way.  With the current implementation we 
>>> have
>>> no way of really knowing of the field which were changed by somebody.
>> 
>> I think persisting everything to the configuration table does have its 
>> advantages.  For one thing, it becomes a central place for everyone to look 
>> for config parameters.  To achieve what you want, you can persist the row 
>> but always leave the value field empty to mean it was not edited by the 
>> sysadmin.  Of course, I generally don't believe that should be the case due 
>> to what I said above.  I think someone using a previous version can get a 
>> rude awakening if they just update and suddenly things changed on them.
>> 
>>> 
>>> What I'd like to get to is that we can have a config page sort of like
>>> about:config in firefox.  In firefox there is a "status" column that is 
>>> "default"
>>> or "user set".  So as a user I know all the crap I changed, and easily I can
>>> revert to the defaults.
>>> 
>>> So if we stick with the current implementation where we throw everything in
>>> the DB (which I assume we will), then maybe we should have a column for
>>> "user set."
>>> 
>>> And also randomly, why is updated column == null mean that its obsolete?
>>> I don't see any code to handle that, just the column description.
>> This is documented as one of the todos.  The code hasn't been added yet.
>> 
>> --Alex

Re: Managed storage with KVM

[Mike Tutkowski]

Hey Marcus,

I wonder if the iSCSI storage pool type for libvirt won't work when you
take into consideration hypervisor snapshots?

On XenServer, when you take a hypervisor snapshot, the VDI for the snapshot
is placed on the same storage repository as the volume is on.

Same idea for VMware, I believe.

So, what would happen in my case (let's say for XenServer and VMware for
4.3 because I don't support hypervisor snapshots in 4.2) is I'd make an
iSCSI target that is larger than what the user requested for the CloudStack
volume (which is fine because our SAN thinly provisions volumes, so the
space is not actually used unless it needs to be). The CloudStack volume
would be the only "object" on the SAN volume until a hypervisor snapshot is
taken. This snapshot would also reside on the SAN volume.

If this is also how KVM behaves and there is no creation of LUNs within an
iSCSI target from libvirt (which, even if there were support for this, our
SAN currently only allows one LUN per iSCSI target), then I don't see how
using this model will work.

Perhaps I will have to go enhance the current way this works with DIR?

What do you think?

Thanks



On Fri, Sep 13, 2013 at 6:28 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> That appears to be the way it's used for iSCSI access today.
>
> I suppose I could go that route, too, but I might as well leverage what
> libvirt has for iSCSI instead.
>
>
> On Fri, Sep 13, 2013 at 6:26 PM, Marcus Sorensen wrote:
>
>> To your question about SharedMountPoint, I believe it just acts like a
>> 'DIR' storage type or something similar to that. The end-user is
>> responsible for mounting a file system that all KVM hosts can access,
>> and CloudStack is oblivious to what is providing the storage. It could
>> be NFS, or OCFS2, or some other clustered filesystem, cloudstack just
>> knows that the provided directory path has VM images.
>>
>> On Fri, Sep 13, 2013 at 6:23 PM, Marcus Sorensen 
>> wrote:
>> > Oh yes, you can use NFS, LVM, and iSCSI all at the same time.
>> > Multiples, in fact.
>> >
>> > On Fri, Sep 13, 2013 at 6:19 PM, Mike Tutkowski
>> >  wrote:
>> >> Looks like you can have multiple storage pools:
>> >>
>> >> mtutkowski@ubuntu:~$ virsh pool-list
>> >> Name State  Autostart
>> >> -
>> >> default  active yes
>> >> iSCSIactive no
>> >>
>> >>
>> >> On Fri, Sep 13, 2013 at 6:12 PM, Mike Tutkowski
>> >>  wrote:
>> >>>
>> >>> Reading through the docs you pointed out.
>> >>>
>> >>> I see what you're saying now.
>> >>>
>> >>> You can create an iSCSI (libvirt) storage pool based on an iSCSI
>> target.
>> >>>
>> >>> In my case, the iSCSI target would only have one LUN, so there would
>> only
>> >>> be one iSCSI (libvirt) storage volume in the (libvirt) storage pool.
>> >>>
>> >>> As you say, my plug-in creates and destroys iSCSI targets/LUNs on the
>> >>> SolidFire SAN, so it is not a problem that libvirt does not support
>> >>> creating/deleting iSCSI targets/LUNs.
>> >>>
>> >>> It looks like I need to test this a bit to see if libvirt supports
>> >>> multiple iSCSI storage pools (as you mentioned, since each one of its
>> >>> storage pools would map to one of my iSCSI targets/LUNs).
>> >>>
>> >>>
>> >>> On Fri, Sep 13, 2013 at 5:58 PM, Mike Tutkowski
>> >>>  wrote:
>> 
>>  LibvirtStoragePoolDef has this type:
>> 
>>  public enum poolType {
>> 
>>  ISCSI("iscsi"), NETFS("netfs"), LOGICAL("logical"),
>> DIR("dir"),
>>  RBD("rbd");
>> 
>>  String _poolType;
>> 
>>  poolType(String poolType) {
>> 
>>  _poolType = poolType;
>> 
>>  }
>> 
>>  @Override
>> 
>>  public String toString() {
>> 
>>  return _poolType;
>> 
>>  }
>> 
>>  }
>> 
>> 
>>  It doesn't look like the iSCSI type is currently being used, but I'm
>>  understanding more what you were getting at.
>> 
>> 
>>  Can you tell me for today (say, 4.2), when someone selects the
>>  SharedMountPoint option and uses it with iSCSI, is that the "netfs"
>> option
>>  above or is that just for NFS?
>> 
>> 
>>  Thanks!
>> 
>> 
>> 
>>  On Fri, Sep 13, 2013 at 5:50 PM, Marcus Sorensen <
>> shadow...@gmail.com>
>>  wrote:
>> >
>> > Take a look at this:
>> >
>> > http://libvirt.org/storage.html#StorageBackendISCSI
>> >
>> > "Volumes must be pre-allocated on the iSCSI server, and cannot be
>> > created via the libvirt APIs.", which I believe your plugin will
>> take
>> > care of. Libvirt just does the work of logging in and hooking it up
>> to
>> > the VM (I believe the Xen api does that work in the Xen stuff).
>> >
>> > What I'm not sure about is whether this provides a 1:1 mapping, or
>> if
>> > it just allows you to register 1 iscs

Re: Build server was down?

[Gavin Lee]

Thanks both!


On Sat, Sep 14, 2013 at 1:11 AM, Marty Sweet  wrote:

> Hi,
>
> This is due to DNS issues with cloudstack.org. We will continue to discuss
> this matter in the subject 'www.cloudstack.org not resolving'.
>
> Thanks,
> Marty
>
>
>
> On Fri, Sep 13, 2013 at 6:03 PM, Chip Childers  >wrote:
>
> > Use Jenkins.buildacloud.org
> >
> > Sent from my iPhone
> >
> > On Sep 13, 2013, at 12:08 PM, Gavin Lee  wrote:
> >
> > > Seems http://jenkins.cloudstack.org/ could not be accessed all day.
> > > Will someone look on this?
> > >
> > > --
> > > Gavin
> >
>



-- 
Gavin

Re: Managed storage with KVM

[Marcus Sorensen]

Ideally volume snapshots can be handled by the SAN back end, if the SAN
supports it. The cloudstack mgmt server could call your plugin for volume
snapshot and it would be hypervisor agnostic. As far as space, that would
depend on how your SAN handles it. With ours, we carve out luns from a
pool, and the snapshot spave comes from the pool and is independent of the
LUN size the host sees.
On Sep 13, 2013 7:10 PM, "Mike Tutkowski" 
wrote:

> Hey Marcus,
>
> I wonder if the iSCSI storage pool type for libvirt won't work when you
> take into consideration hypervisor snapshots?
>
> On XenServer, when you take a hypervisor snapshot, the VDI for the
> snapshot is placed on the same storage repository as the volume is on.
>
> Same idea for VMware, I believe.
>
> So, what would happen in my case (let's say for XenServer and VMware for
> 4.3 because I don't support hypervisor snapshots in 4.2) is I'd make an
> iSCSI target that is larger than what the user requested for the CloudStack
> volume (which is fine because our SAN thinly provisions volumes, so the
> space is not actually used unless it needs to be). The CloudStack volume
> would be the only "object" on the SAN volume until a hypervisor snapshot is
> taken. This snapshot would also reside on the SAN volume.
>
> If this is also how KVM behaves and there is no creation of LUNs within an
> iSCSI target from libvirt (which, even if there were support for this, our
> SAN currently only allows one LUN per iSCSI target), then I don't see how
> using this model will work.
>
> Perhaps I will have to go enhance the current way this works with DIR?
>
> What do you think?
>
> Thanks
>
>
>
> On Fri, Sep 13, 2013 at 6:28 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> That appears to be the way it's used for iSCSI access today.
>>
>> I suppose I could go that route, too, but I might as well leverage what
>> libvirt has for iSCSI instead.
>>
>>
>> On Fri, Sep 13, 2013 at 6:26 PM, Marcus Sorensen wrote:
>>
>>> To your question about SharedMountPoint, I believe it just acts like a
>>> 'DIR' storage type or something similar to that. The end-user is
>>> responsible for mounting a file system that all KVM hosts can access,
>>> and CloudStack is oblivious to what is providing the storage. It could
>>> be NFS, or OCFS2, or some other clustered filesystem, cloudstack just
>>> knows that the provided directory path has VM images.
>>>
>>> On Fri, Sep 13, 2013 at 6:23 PM, Marcus Sorensen 
>>> wrote:
>>> > Oh yes, you can use NFS, LVM, and iSCSI all at the same time.
>>> > Multiples, in fact.
>>> >
>>> > On Fri, Sep 13, 2013 at 6:19 PM, Mike Tutkowski
>>> >  wrote:
>>> >> Looks like you can have multiple storage pools:
>>> >>
>>> >> mtutkowski@ubuntu:~$ virsh pool-list
>>> >> Name State  Autostart
>>> >> -
>>> >> default  active yes
>>> >> iSCSIactive no
>>> >>
>>> >>
>>> >> On Fri, Sep 13, 2013 at 6:12 PM, Mike Tutkowski
>>> >>  wrote:
>>> >>>
>>> >>> Reading through the docs you pointed out.
>>> >>>
>>> >>> I see what you're saying now.
>>> >>>
>>> >>> You can create an iSCSI (libvirt) storage pool based on an iSCSI
>>> target.
>>> >>>
>>> >>> In my case, the iSCSI target would only have one LUN, so there would
>>> only
>>> >>> be one iSCSI (libvirt) storage volume in the (libvirt) storage pool.
>>> >>>
>>> >>> As you say, my plug-in creates and destroys iSCSI targets/LUNs on the
>>> >>> SolidFire SAN, so it is not a problem that libvirt does not support
>>> >>> creating/deleting iSCSI targets/LUNs.
>>> >>>
>>> >>> It looks like I need to test this a bit to see if libvirt supports
>>> >>> multiple iSCSI storage pools (as you mentioned, since each one of its
>>> >>> storage pools would map to one of my iSCSI targets/LUNs).
>>> >>>
>>> >>>
>>> >>> On Fri, Sep 13, 2013 at 5:58 PM, Mike Tutkowski
>>> >>>  wrote:
>>> 
>>>  LibvirtStoragePoolDef has this type:
>>> 
>>>  public enum poolType {
>>> 
>>>  ISCSI("iscsi"), NETFS("netfs"), LOGICAL("logical"),
>>> DIR("dir"),
>>>  RBD("rbd");
>>> 
>>>  String _poolType;
>>> 
>>>  poolType(String poolType) {
>>> 
>>>  _poolType = poolType;
>>> 
>>>  }
>>> 
>>>  @Override
>>> 
>>>  public String toString() {
>>> 
>>>  return _poolType;
>>> 
>>>  }
>>> 
>>>  }
>>> 
>>> 
>>>  It doesn't look like the iSCSI type is currently being used, but I'm
>>>  understanding more what you were getting at.
>>> 
>>> 
>>>  Can you tell me for today (say, 4.2), when someone selects the
>>>  SharedMountPoint option and uses it with iSCSI, is that the "netfs"
>>> option
>>>  above or is that just for NFS?
>>> 
>>> 
>>>  Thanks!
>>> 
>>> 
>>> 
>>>  On Fri, Sep 13, 2013 at 5:50 PM, Marcus Sorensen <
>>> shadow.

Re: Managed storage with KVM

[Marcus Sorensen]

Let me back up and say I don't think you'd use a vdi style on an iscsi lun.
I think you'd want to treat it as a RAW format. Otherwise you're putting a
filesystem on your lun, mounting it, creating a QCOW2 disk image, and that
seems unnecessary and a performance killer.

So probably attaching the raw iscsi lun as a disk to the VM, and handling
snapshots on the San side via the storage plugin is best. My impression
from the storage plugin refactor was that there was a snapshot service that
would allow the San to handle snapshots.
On Sep 13, 2013 7:15 PM, "Marcus Sorensen"  wrote:

> Ideally volume snapshots can be handled by the SAN back end, if the SAN
> supports it. The cloudstack mgmt server could call your plugin for volume
> snapshot and it would be hypervisor agnostic. As far as space, that would
> depend on how your SAN handles it. With ours, we carve out luns from a
> pool, and the snapshot spave comes from the pool and is independent of the
> LUN size the host sees.
> On Sep 13, 2013 7:10 PM, "Mike Tutkowski" 
> wrote:
>
>> Hey Marcus,
>>
>> I wonder if the iSCSI storage pool type for libvirt won't work when you
>> take into consideration hypervisor snapshots?
>>
>> On XenServer, when you take a hypervisor snapshot, the VDI for the
>> snapshot is placed on the same storage repository as the volume is on.
>>
>> Same idea for VMware, I believe.
>>
>> So, what would happen in my case (let's say for XenServer and VMware for
>> 4.3 because I don't support hypervisor snapshots in 4.2) is I'd make an
>> iSCSI target that is larger than what the user requested for the CloudStack
>> volume (which is fine because our SAN thinly provisions volumes, so the
>> space is not actually used unless it needs to be). The CloudStack volume
>> would be the only "object" on the SAN volume until a hypervisor snapshot is
>> taken. This snapshot would also reside on the SAN volume.
>>
>> If this is also how KVM behaves and there is no creation of LUNs within
>> an iSCSI target from libvirt (which, even if there were support for this,
>> our SAN currently only allows one LUN per iSCSI target), then I don't see
>> how using this model will work.
>>
>> Perhaps I will have to go enhance the current way this works with DIR?
>>
>> What do you think?
>>
>> Thanks
>>
>>
>>
>> On Fri, Sep 13, 2013 at 6:28 PM, Mike Tutkowski <
>> mike.tutkow...@solidfire.com> wrote:
>>
>>> That appears to be the way it's used for iSCSI access today.
>>>
>>> I suppose I could go that route, too, but I might as well leverage what
>>> libvirt has for iSCSI instead.
>>>
>>>
>>> On Fri, Sep 13, 2013 at 6:26 PM, Marcus Sorensen wrote:
>>>
 To your question about SharedMountPoint, I believe it just acts like a
 'DIR' storage type or something similar to that. The end-user is
 responsible for mounting a file system that all KVM hosts can access,
 and CloudStack is oblivious to what is providing the storage. It could
 be NFS, or OCFS2, or some other clustered filesystem, cloudstack just
 knows that the provided directory path has VM images.

 On Fri, Sep 13, 2013 at 6:23 PM, Marcus Sorensen 
 wrote:
 > Oh yes, you can use NFS, LVM, and iSCSI all at the same time.
 > Multiples, in fact.
 >
 > On Fri, Sep 13, 2013 at 6:19 PM, Mike Tutkowski
 >  wrote:
 >> Looks like you can have multiple storage pools:
 >>
 >> mtutkowski@ubuntu:~$ virsh pool-list
 >> Name State  Autostart
 >> -
 >> default  active yes
 >> iSCSIactive no
 >>
 >>
 >> On Fri, Sep 13, 2013 at 6:12 PM, Mike Tutkowski
 >>  wrote:
 >>>
 >>> Reading through the docs you pointed out.
 >>>
 >>> I see what you're saying now.
 >>>
 >>> You can create an iSCSI (libvirt) storage pool based on an iSCSI
 target.
 >>>
 >>> In my case, the iSCSI target would only have one LUN, so there
 would only
 >>> be one iSCSI (libvirt) storage volume in the (libvirt) storage pool.
 >>>
 >>> As you say, my plug-in creates and destroys iSCSI targets/LUNs on
 the
 >>> SolidFire SAN, so it is not a problem that libvirt does not support
 >>> creating/deleting iSCSI targets/LUNs.
 >>>
 >>> It looks like I need to test this a bit to see if libvirt supports
 >>> multiple iSCSI storage pools (as you mentioned, since each one of
 its
 >>> storage pools would map to one of my iSCSI targets/LUNs).
 >>>
 >>>
 >>> On Fri, Sep 13, 2013 at 5:58 PM, Mike Tutkowski
 >>>  wrote:
 
  LibvirtStoragePoolDef has this type:
 
  public enum poolType {
 
  ISCSI("iscsi"), NETFS("netfs"), LOGICAL("logical"),
 DIR("dir"),
  RBD("rbd");
 
  String _poolType;
 
  poolType(String poolType) {
 
  _poolType = poolType;
>

Re: Managed storage with KVM

[Marcus Sorensen]

Oh, hypervisor snapshots are a bit different. I need to catch up on the
work done in KVM, but this is basically just disk snapshots + memory dump.
I still think disk snapshots would preferably be handled by the SAN, and
then memory dumps can go to secondary storage or something else. This is
relatively new ground with CS and KVM, so we will want to see how others
are planning theirs.
On Sep 13, 2013 7:20 PM, "Marcus Sorensen"  wrote:

> Let me back up and say I don't think you'd use a vdi style on an iscsi
> lun. I think you'd want to treat it as a RAW format. Otherwise you're
> putting a filesystem on your lun, mounting it, creating a QCOW2 disk image,
> and that seems unnecessary and a performance killer.
>
> So probably attaching the raw iscsi lun as a disk to the VM, and handling
> snapshots on the San side via the storage plugin is best. My impression
> from the storage plugin refactor was that there was a snapshot service that
> would allow the San to handle snapshots.
> On Sep 13, 2013 7:15 PM, "Marcus Sorensen"  wrote:
>
>> Ideally volume snapshots can be handled by the SAN back end, if the SAN
>> supports it. The cloudstack mgmt server could call your plugin for volume
>> snapshot and it would be hypervisor agnostic. As far as space, that would
>> depend on how your SAN handles it. With ours, we carve out luns from a
>> pool, and the snapshot spave comes from the pool and is independent of the
>> LUN size the host sees.
>> On Sep 13, 2013 7:10 PM, "Mike Tutkowski" 
>> wrote:
>>
>>> Hey Marcus,
>>>
>>> I wonder if the iSCSI storage pool type for libvirt won't work when you
>>> take into consideration hypervisor snapshots?
>>>
>>> On XenServer, when you take a hypervisor snapshot, the VDI for the
>>> snapshot is placed on the same storage repository as the volume is on.
>>>
>>> Same idea for VMware, I believe.
>>>
>>> So, what would happen in my case (let's say for XenServer and VMware for
>>> 4.3 because I don't support hypervisor snapshots in 4.2) is I'd make an
>>> iSCSI target that is larger than what the user requested for the CloudStack
>>> volume (which is fine because our SAN thinly provisions volumes, so the
>>> space is not actually used unless it needs to be). The CloudStack volume
>>> would be the only "object" on the SAN volume until a hypervisor snapshot is
>>> taken. This snapshot would also reside on the SAN volume.
>>>
>>> If this is also how KVM behaves and there is no creation of LUNs within
>>> an iSCSI target from libvirt (which, even if there were support for this,
>>> our SAN currently only allows one LUN per iSCSI target), then I don't see
>>> how using this model will work.
>>>
>>> Perhaps I will have to go enhance the current way this works with DIR?
>>>
>>> What do you think?
>>>
>>> Thanks
>>>
>>>
>>>
>>> On Fri, Sep 13, 2013 at 6:28 PM, Mike Tutkowski <
>>> mike.tutkow...@solidfire.com> wrote:
>>>
 That appears to be the way it's used for iSCSI access today.

 I suppose I could go that route, too, but I might as well leverage what
 libvirt has for iSCSI instead.


 On Fri, Sep 13, 2013 at 6:26 PM, Marcus Sorensen 
 wrote:

> To your question about SharedMountPoint, I believe it just acts like a
> 'DIR' storage type or something similar to that. The end-user is
> responsible for mounting a file system that all KVM hosts can access,
> and CloudStack is oblivious to what is providing the storage. It could
> be NFS, or OCFS2, or some other clustered filesystem, cloudstack just
> knows that the provided directory path has VM images.
>
> On Fri, Sep 13, 2013 at 6:23 PM, Marcus Sorensen 
> wrote:
> > Oh yes, you can use NFS, LVM, and iSCSI all at the same time.
> > Multiples, in fact.
> >
> > On Fri, Sep 13, 2013 at 6:19 PM, Mike Tutkowski
> >  wrote:
> >> Looks like you can have multiple storage pools:
> >>
> >> mtutkowski@ubuntu:~$ virsh pool-list
> >> Name State  Autostart
> >> -
> >> default  active yes
> >> iSCSIactive no
> >>
> >>
> >> On Fri, Sep 13, 2013 at 6:12 PM, Mike Tutkowski
> >>  wrote:
> >>>
> >>> Reading through the docs you pointed out.
> >>>
> >>> I see what you're saying now.
> >>>
> >>> You can create an iSCSI (libvirt) storage pool based on an iSCSI
> target.
> >>>
> >>> In my case, the iSCSI target would only have one LUN, so there
> would only
> >>> be one iSCSI (libvirt) storage volume in the (libvirt) storage
> pool.
> >>>
> >>> As you say, my plug-in creates and destroys iSCSI targets/LUNs on
> the
> >>> SolidFire SAN, so it is not a problem that libvirt does not support
> >>> creating/deleting iSCSI targets/LUNs.
> >>>
> >>> It looks like I need to test this a bit to see if libvirt supports
> >>> multiple iSCSI storage pools (as you mentioned, 

Re: Managed storage with KVM

[Mike Tutkowski]

Ah, OK, I didn't know that was such new ground in KVM with CS.

So, the way people use our SAN with KVM and CS today is by selecting
SharedMountPoint and specifying the location of the share.

They can set up their share using Open iSCSI by discovering their iSCSI
target, logging in to it, then mounting it somewhere on their file system.

Would it make sense for me to just do that discovery, logging in, and
mounting behind the scenes for them and letting the current code manage the
rest as it currently does?


On Fri, Sep 13, 2013 at 7:27 PM, Marcus Sorensen wrote:

> Oh, hypervisor snapshots are a bit different. I need to catch up on the
> work done in KVM, but this is basically just disk snapshots + memory dump.
> I still think disk snapshots would preferably be handled by the SAN, and
> then memory dumps can go to secondary storage or something else. This is
> relatively new ground with CS and KVM, so we will want to see how others
> are planning theirs.
> On Sep 13, 2013 7:20 PM, "Marcus Sorensen"  wrote:
>
>> Let me back up and say I don't think you'd use a vdi style on an iscsi
>> lun. I think you'd want to treat it as a RAW format. Otherwise you're
>> putting a filesystem on your lun, mounting it, creating a QCOW2 disk image,
>> and that seems unnecessary and a performance killer.
>>
>> So probably attaching the raw iscsi lun as a disk to the VM, and handling
>> snapshots on the San side via the storage plugin is best. My impression
>> from the storage plugin refactor was that there was a snapshot service that
>> would allow the San to handle snapshots.
>> On Sep 13, 2013 7:15 PM, "Marcus Sorensen"  wrote:
>>
>>> Ideally volume snapshots can be handled by the SAN back end, if the SAN
>>> supports it. The cloudstack mgmt server could call your plugin for volume
>>> snapshot and it would be hypervisor agnostic. As far as space, that would
>>> depend on how your SAN handles it. With ours, we carve out luns from a
>>> pool, and the snapshot spave comes from the pool and is independent of the
>>> LUN size the host sees.
>>> On Sep 13, 2013 7:10 PM, "Mike Tutkowski" 
>>> wrote:
>>>
 Hey Marcus,

 I wonder if the iSCSI storage pool type for libvirt won't work when you
 take into consideration hypervisor snapshots?

 On XenServer, when you take a hypervisor snapshot, the VDI for the
 snapshot is placed on the same storage repository as the volume is on.

 Same idea for VMware, I believe.

 So, what would happen in my case (let's say for XenServer and VMware
 for 4.3 because I don't support hypervisor snapshots in 4.2) is I'd make an
 iSCSI target that is larger than what the user requested for the CloudStack
 volume (which is fine because our SAN thinly provisions volumes, so the
 space is not actually used unless it needs to be). The CloudStack volume
 would be the only "object" on the SAN volume until a hypervisor snapshot is
 taken. This snapshot would also reside on the SAN volume.

 If this is also how KVM behaves and there is no creation of LUNs within
 an iSCSI target from libvirt (which, even if there were support for this,
 our SAN currently only allows one LUN per iSCSI target), then I don't see
 how using this model will work.

 Perhaps I will have to go enhance the current way this works with DIR?

 What do you think?

 Thanks



 On Fri, Sep 13, 2013 at 6:28 PM, Mike Tutkowski <
 mike.tutkow...@solidfire.com> wrote:

> That appears to be the way it's used for iSCSI access today.
>
> I suppose I could go that route, too, but I might as well leverage
> what libvirt has for iSCSI instead.
>
>
> On Fri, Sep 13, 2013 at 6:26 PM, Marcus Sorensen 
> wrote:
>
>> To your question about SharedMountPoint, I believe it just acts like a
>> 'DIR' storage type or something similar to that. The end-user is
>> responsible for mounting a file system that all KVM hosts can access,
>> and CloudStack is oblivious to what is providing the storage. It could
>> be NFS, or OCFS2, or some other clustered filesystem, cloudstack just
>> knows that the provided directory path has VM images.
>>
>> On Fri, Sep 13, 2013 at 6:23 PM, Marcus Sorensen 
>> wrote:
>> > Oh yes, you can use NFS, LVM, and iSCSI all at the same time.
>> > Multiples, in fact.
>> >
>> > On Fri, Sep 13, 2013 at 6:19 PM, Mike Tutkowski
>> >  wrote:
>> >> Looks like you can have multiple storage pools:
>> >>
>> >> mtutkowski@ubuntu:~$ virsh pool-list
>> >> Name State  Autostart
>> >> -
>> >> default  active yes
>> >> iSCSIactive no
>> >>
>> >>
>> >> On Fri, Sep 13, 2013 at 6:12 PM, Mike Tutkowski
>> >>  wrote:
>> >>>
>> >>> Reading through the docs you pointed out.
>> >>>
>> >>> I

Re: Managed storage with KVM

[Marcus Sorensen]

This would require that they put a clustered filesystem on the lun, right?
Seems like it would be better for them to use CLVM and make a volume group
from the luns, I'll bet some of your customers are doing that unless they
are explicitly instructed otherwise, that's how others are doing iscsi or
fibrechannel storage.
On Sep 13, 2013 7:33 PM, "Mike Tutkowski" 
wrote:

> Ah, OK, I didn't know that was such new ground in KVM with CS.
>
> So, the way people use our SAN with KVM and CS today is by selecting
> SharedMountPoint and specifying the location of the share.
>
> They can set up their share using Open iSCSI by discovering their iSCSI
> target, logging in to it, then mounting it somewhere on their file system.
>
> Would it make sense for me to just do that discovery, logging in, and
> mounting behind the scenes for them and letting the current code manage the
> rest as it currently does?
>
>
> On Fri, Sep 13, 2013 at 7:27 PM, Marcus Sorensen wrote:
>
>> Oh, hypervisor snapshots are a bit different. I need to catch up on the
>> work done in KVM, but this is basically just disk snapshots + memory dump.
>> I still think disk snapshots would preferably be handled by the SAN, and
>> then memory dumps can go to secondary storage or something else. This is
>> relatively new ground with CS and KVM, so we will want to see how others
>> are planning theirs.
>>  On Sep 13, 2013 7:20 PM, "Marcus Sorensen"  wrote:
>>
>>> Let me back up and say I don't think you'd use a vdi style on an iscsi
>>> lun. I think you'd want to treat it as a RAW format. Otherwise you're
>>> putting a filesystem on your lun, mounting it, creating a QCOW2 disk image,
>>> and that seems unnecessary and a performance killer.
>>>
>>> So probably attaching the raw iscsi lun as a disk to the VM, and
>>> handling snapshots on the San side via the storage plugin is best. My
>>> impression from the storage plugin refactor was that there was a snapshot
>>> service that would allow the San to handle snapshots.
>>> On Sep 13, 2013 7:15 PM, "Marcus Sorensen"  wrote:
>>>
 Ideally volume snapshots can be handled by the SAN back end, if the SAN
 supports it. The cloudstack mgmt server could call your plugin for volume
 snapshot and it would be hypervisor agnostic. As far as space, that would
 depend on how your SAN handles it. With ours, we carve out luns from a
 pool, and the snapshot spave comes from the pool and is independent of the
 LUN size the host sees.
 On Sep 13, 2013 7:10 PM, "Mike Tutkowski" 
 wrote:

> Hey Marcus,
>
> I wonder if the iSCSI storage pool type for libvirt won't work when
> you take into consideration hypervisor snapshots?
>
> On XenServer, when you take a hypervisor snapshot, the VDI for the
> snapshot is placed on the same storage repository as the volume is on.
>
> Same idea for VMware, I believe.
>
> So, what would happen in my case (let's say for XenServer and VMware
> for 4.3 because I don't support hypervisor snapshots in 4.2) is I'd make 
> an
> iSCSI target that is larger than what the user requested for the 
> CloudStack
> volume (which is fine because our SAN thinly provisions volumes, so the
> space is not actually used unless it needs to be). The CloudStack volume
> would be the only "object" on the SAN volume until a hypervisor snapshot 
> is
> taken. This snapshot would also reside on the SAN volume.
>
> If this is also how KVM behaves and there is no creation of LUNs
> within an iSCSI target from libvirt (which, even if there were support for
> this, our SAN currently only allows one LUN per iSCSI target), then I 
> don't
> see how using this model will work.
>
> Perhaps I will have to go enhance the current way this works with DIR?
>
> What do you think?
>
> Thanks
>
>
>
> On Fri, Sep 13, 2013 at 6:28 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> That appears to be the way it's used for iSCSI access today.
>>
>> I suppose I could go that route, too, but I might as well leverage
>> what libvirt has for iSCSI instead.
>>
>>
>> On Fri, Sep 13, 2013 at 6:26 PM, Marcus Sorensen > > wrote:
>>
>>> To your question about SharedMountPoint, I believe it just acts like
>>> a
>>> 'DIR' storage type or something similar to that. The end-user is
>>> responsible for mounting a file system that all KVM hosts can access,
>>> and CloudStack is oblivious to what is providing the storage. It
>>> could
>>> be NFS, or OCFS2, or some other clustered filesystem, cloudstack just
>>> knows that the provided directory path has VM images.
>>>
>>> On Fri, Sep 13, 2013 at 6:23 PM, Marcus Sorensen <
>>> shadow...@gmail.com> wrote:
>>> > Oh yes, you can use NFS, LVM, and iSCSI all at the same time.
>>> > Multiples, in fact.
>>> >
>>> > On Fri, Sep