Build failed in Jenkins: build-master-slowbuild #895

2014-05-21 Thread jenkins
See 

--
[...truncated 18336 lines...]

Tests run: 4, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] <<< cobertura-maven-plugin:2.6:cobertura (default-cli) @ cloud-awsapi <<<
[INFO] 
[INFO] --- cobertura-maven-plugin:2.6:cobertura (default-cli) @ cloud-awsapi ---
[INFO] Cobertura 2.0.3 - GNU GPL License (NO WARRANTY) - See COPYRIGHT file
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/amazon/ec2/AmazonEC2SkeletonInterface.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/amazon/s3/AmazonS3SkeletonInterface.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/model/SAcl.java.  Ensure this class was instrumented, and this 
data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/model/SBucket.java.  Ensure this class was instrumented, and 
this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/model/SHost.java.  Ensure this class was instrumented, and 
this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/BucketPolicyDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackAccountDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackConfigurationDao.java.  Ensure this 
class was instrumented, and this data file contains the instrumentation 
information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackSvcOfferingDao.java.  Ensure this class 
was instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackUserDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MHostDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MHostMountDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MultiPartPartsDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MultiPartUploadsDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MultipartMetaDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does 

Review Request 21763: [Windows]Give Option to install or not MySql Server along with Main Installer on the same server

2014-05-21 Thread Damodar Reddy Talakanti

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21763/
---

Review request for cloudstack, Abhinandan Prateek and Murali Reddy.


Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-6700

https://issues.apache.org/jira/browse/https://issues.apache.org/jira/browse/CLOUDSTACK-6700


Repository: cloudstack-git


Description
---

Currently we are installing mysql server on the same host where management 
server was getting installed. And there is  no choice to install the database 
server on the other machine. 

We are enabling an option to choose, whether mysql server to be installed 
locally to management server or not.


Diffs
-

  client/pom.xml b3d857d 
  scripts/installer/windows/acs.wxs 411d026 
  scripts/installer/windows/dependencies.wxs 56ea2a4 

Diff: https://reviews.apache.org/r/21763/diff/


Testing
---

Tested on windows 2012 R2 server


Thanks,

Damodar Reddy Talakanti



Review Request 20623: Added version check, fixed data corruption, fixed regression issues

2014-05-21 Thread Santhosh Edukulla

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20623/
---

Review request for cloudstack, daan Hoogland and Jayapal Reddy.


Bugs: CLOUDSTACK-6736
https://issues.apache.org/jira/browse/CLOUDSTACK-6736


Repository: cloudstack-git


Description
---

1. ParsedConfig is getting corrupted when used in tests. Fixed now.
2. setup.py does not have minimal version requirements for various packages. 
Added that.
3. Fixed few misc script issues and removed print statements.
4. Added bug information to failed cases.


Diffs
-

  test/integration/smoke/test_deploy_vm.py db26980 
  test/integration/smoke/test_guest_vlan_range.py bfef4a8 
  test/integration/smoke/test_hosts.py 7798c8e 
  test/integration/smoke/test_vm_life_cycle.py 85033c5 
  tools/marvin/marvin/cloudstackTestClient.py 86b0a4b 
  tools/marvin/setup.py 4c775ad 

Diff: https://reviews.apache.org/r/20623/diff/


Testing
---

Ran changes against simulator


Thanks,

Santhosh Edukulla



VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Erik Weber
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/vpn.html#site-to-site-vpnstates:


   - *CIDR list*: The guest CIDR list of the remote subnets. Enter a CIDR
   or a comma-separated list of CIDRs. Ensure that a guest CIDR list is not
   overlapped with the VPC’s CIDR, or another guest CIDR. The CIDR must be
   RFC1918-compliant.


I'm not a network guy, so excuse the question if it's obvious, but if a
customer only has public ip's on their end, why is rfc1918 required?


-- 
Erik Weber


RE: VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Alex Hitchins
Erik,

I can't answer your question however though as you raise it I'd let you know; 
I'm working on an issue with the comma separated list. Currently it is failing 
as it's incorrectly validating the string.

https://issues.apache.org/jira/browse/CLOUDSTACK-6667


Alex Hitchins | 07788 423 969 | 01892 523 587

-Original Message-
From: Erik Weber [mailto:terbol...@gmail.com] 
Sent: 21 May 2014 11:14
To: dev
Subject: VPC Site to Site VPN CIDR RFC1918

http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/vpn.html#site-to-site-vpnstates:


   - *CIDR list*: The guest CIDR list of the remote subnets. Enter a CIDR
   or a comma-separated list of CIDRs. Ensure that a guest CIDR list is not
   overlapped with the VPC’s CIDR, or another guest CIDR. The CIDR must be
   RFC1918-compliant.


I'm not a network guy, so excuse the question if it's obvious, but if a 
customer only has public ip's on their end, why is rfc1918 required?


--
Erik Weber



Re: Review Request 20623: Added version check, fixed data corruption, fixed regression issues

2014-05-21 Thread Santhosh Edukulla

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20623/
---

(Updated May 21, 2014, 10:55 a.m.)


Review request for cloudstack, daan Hoogland and Jayapal Reddy.


Changes
---

Fixed spaces issue.


Bugs: CLOUDSTACK-6736
https://issues.apache.org/jira/browse/CLOUDSTACK-6736


Repository: cloudstack-git


Description
---

1. ParsedConfig is getting corrupted when used in tests. Fixed now.
2. setup.py does not have minimal version requirements for various packages. 
Added that.
3. Fixed few misc script issues and removed print statements.
4. Added bug information to failed cases.


Diffs (updated)
-

  test/integration/smoke/test_deploy_vm.py db26980 
  test/integration/smoke/test_guest_vlan_range.py bfef4a8 
  test/integration/smoke/test_hosts.py 7798c8e 
  test/integration/smoke/test_vm_life_cycle.py 85033c5 
  tools/marvin/marvin/cloudstackTestClient.py 86b0a4b 
  tools/marvin/setup.py 4c775ad 

Diff: https://reviews.apache.org/r/20623/diff/


Testing
---

Ran changes against simulator


Thanks,

Santhosh Edukulla



Build failed in Jenkins: build-master-slowbuild #896

2014-05-21 Thread jenkins
See 

--
[...truncated 18336 lines...]

Tests run: 4, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] <<< cobertura-maven-plugin:2.6:cobertura (default-cli) @ cloud-awsapi <<<
[INFO] 
[INFO] --- cobertura-maven-plugin:2.6:cobertura (default-cli) @ cloud-awsapi ---
[INFO] Cobertura 2.0.3 - GNU GPL License (NO WARRANTY) - See COPYRIGHT file
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/amazon/ec2/AmazonEC2SkeletonInterface.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/amazon/s3/AmazonS3SkeletonInterface.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/model/SAcl.java.  Ensure this class was instrumented, and this 
data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/model/SBucket.java.  Ensure this class was instrumented, and 
this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/model/SHost.java.  Ensure this class was instrumented, and 
this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/BucketPolicyDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackAccountDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackConfigurationDao.java.  Ensure this 
class was instrumented, and this data file contains the instrumentation 
information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackSvcOfferingDao.java.  Ensure this class 
was instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackUserDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MHostDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MHostMountDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MultiPartPartsDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MultiPartUploadsDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MultipartMetaDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does 

Re: Review Request 20623: Added version check, fixed data corruption, fixed regression issues

2014-05-21 Thread Santhosh Edukulla

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20623/
---

(Updated May 21, 2014, 11:12 a.m.)


Review request for cloudstack, daan Hoogland and Jayapal Reddy.


Bugs: CLOUDSTACK-6736
https://issues.apache.org/jira/browse/CLOUDSTACK-6736


Repository: cloudstack-git


Description
---

1. ParsedConfig is getting corrupted when used in tests. Fixed now.
2. setup.py does not have minimal version requirements for various packages. 
Added that.
3. Fixed few misc script issues and removed print statements.
4. Added bug information to failed cases.


Diffs (updated)
-

  test/integration/smoke/test_deploy_vm.py db26980 
  test/integration/smoke/test_guest_vlan_range.py bfef4a8 
  test/integration/smoke/test_hosts.py 7798c8e 
  test/integration/smoke/test_vm_life_cycle.py 85033c5 
  tools/marvin/marvin/cloudstackTestClient.py 86b0a4b 
  tools/marvin/setup.py 4c775ad 

Diff: https://reviews.apache.org/r/20623/diff/


Testing
---

Ran changes against simulator


Thanks,

Santhosh Edukulla



Re: Review Request 20623: Added version check, fixed data corruption, fixed regression issues

2014-05-21 Thread Jayapal Reddy

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20623/#review43606
---

Ship it!


Ship It!

- Jayapal Reddy


On May 21, 2014, 11:12 a.m., Santhosh Edukulla wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20623/
> ---
> 
> (Updated May 21, 2014, 11:12 a.m.)
> 
> 
> Review request for cloudstack, daan Hoogland and Jayapal Reddy.
> 
> 
> Bugs: CLOUDSTACK-6736
> https://issues.apache.org/jira/browse/CLOUDSTACK-6736
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> 1. ParsedConfig is getting corrupted when used in tests. Fixed now.
> 2. setup.py does not have minimal version requirements for various packages. 
> Added that.
> 3. Fixed few misc script issues and removed print statements.
> 4. Added bug information to failed cases.
> 
> 
> Diffs
> -
> 
>   test/integration/smoke/test_deploy_vm.py db26980 
>   test/integration/smoke/test_guest_vlan_range.py bfef4a8 
>   test/integration/smoke/test_hosts.py 7798c8e 
>   test/integration/smoke/test_vm_life_cycle.py 85033c5 
>   tools/marvin/marvin/cloudstackTestClient.py 86b0a4b 
>   tools/marvin/setup.py 4c775ad 
> 
> Diff: https://reviews.apache.org/r/20623/diff/
> 
> 
> Testing
> ---
> 
> Ran changes against simulator
> 
> 
> Thanks,
> 
> Santhosh Edukulla
> 
>



Review Request 21764: Fixed issues in regression suite project cpu limits

2014-05-21 Thread Gaurav Aradhye

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21764/
---

Review request for cloudstack and Santhosh Edukulla.


Repository: cloudstack-git


Description
---

Vm listing failed because projectid parameter was missing.


Diffs
-

  test/integration/component/test_cpu_project_limits.py b33b9f1 
  tools/marvin/marvin/lib/base.py 7d08e89 

Diff: https://reviews.apache.org/r/21764/diff/


Testing
---

Yes.

test_01_project_counts_start_stop_instance 
(test_cpu_project_limits.TestProjectsCPULimits) ... === TestName: 
test_01_project_counts_start_stop_instance | Status :
SUCCESS ===
ok
test_02_project_counts_migrate_instance 
(test_cpu_project_limits.TestProjectsCPULimits) ... SKIP: skip
test_03_project_counts_delete_instance 
(test_cpu_project_limits.TestProjectsCPULimits) ... SKIP: skip

--
Ran 3 tests in 192.868s

OK (SKIP=2)


Thanks,

Gaurav Aradhye



Re: [ACS4.4] Cherry-pick f748a552e9546e91e18c574b375f3ea6c8d7e043

2014-05-21 Thread Daan Hoogland
On Tue, May 20, 2014 at 11:29 PM, Min Chen  wrote:
> git rm test/integration/smoke/test_vm_iam.py


works. pulled.

-- 
Daan


Re: VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Erik Weber
Great to hear. We're not seeing that as we're only trying to add one cidr
range, but all fixes are appreciated :-)

Hope someone might come up with some more info about the limitation as time
passes.

Regards,

Erik Weber


On Wed, May 21, 2014 at 12:32 PM, Alex Hitchins wrote:

> Erik,
>
> I can't answer your question however though as you raise it I'd let you
> know; I'm working on an issue with the comma separated list. Currently it
> is failing as it's incorrectly validating the string.
>
> https://issues.apache.org/jira/browse/CLOUDSTACK-6667
>
>
> Alex Hitchins | 07788 423 969 | 01892 523 587
>
> -Original Message-
> From: Erik Weber [mailto:terbol...@gmail.com]
> Sent: 21 May 2014 11:14
> To: dev
> Subject: VPC Site to Site VPN CIDR RFC1918
>
>
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/vpn.html#site-to-site-vpnstates
> :
>
>
>- *CIDR list*: The guest CIDR list of the remote subnets. Enter a CIDR
>or a comma-separated list of CIDRs. Ensure that a guest CIDR list is not
>overlapped with the VPC’s CIDR, or another guest CIDR. The CIDR must be
>RFC1918-compliant.
>
>
> I'm not a network guy, so excuse the question if it's obvious, but if a
> customer only has public ip's on their end, why is rfc1918 required?
>
>
> --
> Erik Weber
>
>


Re: VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Daan Hoogland
Erik,

The vpn let's you connect to all the computers in the network on the
other site on their private adresses. This means that you can give the
cidr of the remote network in the definition on vpn connection.

one network has 10.0.1.0/24 and ip 1.2.3.4
the other has 10.0.2.0/24 and ip 4.3.2.1

on the first you define endpoint/gateway 4.3.2.1 with cidr 10.0.1.0/24
and you make it passive
on the second you define the adresses of the first and stat is without
the passive function
now you can ping a machine with address 10.0.1.123 from a machine with
ip 10.0.2.246

Of course you can do this to an external network as well, which makes
far more sense.

On Wed, May 21, 2014 at 12:14 PM, Erik Weber  wrote:
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/vpn.html#site-to-site-vpnstates:
>
>
>- *CIDR list*: The guest CIDR list of the remote subnets. Enter a CIDR
>or a comma-separated list of CIDRs. Ensure that a guest CIDR list is not
>overlapped with the VPC’s CIDR, or another guest CIDR. The CIDR must be
>RFC1918-compliant.
>
>
> I'm not a network guy, so excuse the question if it's obvious, but if a
> customer only has public ip's on their end, why is rfc1918 required?
>
>
> --
> Erik Weber



-- 
Daan


Re: [GitHub] cloudstack-docs-admin pull request: Fixed the formatting of lists ...

2014-05-21 Thread Will Stevens
Ok. Thanks for letting me know. It seems that the tree resyncing guide on
github does not work as expected. I will figure out the rebasing flow.

Thx,

Ws

On Wednesday, May 21, 2014, runseb  wrote:
> Github user runseb commented on the pull request:
>
>
https://github.com/apache/cloudstack-docs-admin/pull/12#issuecomment-43716150
>
> thanks for the patch, its applied.
> I am not a git expert, but you seem to be adding commits to your pull
request. I have already applied some of those, so it ends up being a
conflict.
>
>
> ---
> If your project is set up for it, you can reply to this email and have
your
> reply appear on GitHub as well. If your project does not have this feature
> enabled and wishes so, or if the feature is enabled but not working,
please
> contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
> with INFRA.
> ---
>


Re: VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Erik Weber
I understand that, but what my client wants is to connect public ips
instead of rfc1918 on one of the sides.

e.g. one network has 10.0.1.0/24 and ip 1.2.3.4
the other has 50.0.1.0/24 and ip 50.0.0.1

but cloudstack currently does not let you do that, because it expects cidrs
to be rfc1918. see log excerpt:

2014-05-21 12:30:42,326 WARN  [c.c.u.n.NetUtils]
(API-Job-Executor-7:job-3072 ctx-bf3922b1) cidr 50.0.1.0/24 is not RFC 1918
compliant
2014-05-21 12:30:42,335 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-7:job-3072) Unexpected exception while executing
org.apache.cloudstack.api.command.user.vpn.CreateVpnCustomerGatewayCmd
com.cloud.exception.InvalidParameterValueException: The customer gateway
guest cidr list 50.0.1.0/24 is invalid guest cidr!
at
com.cloud.network.vpn.Site2SiteVpnManagerImpl.createCustomerGateway(Site2SiteVpnManagerImpl.java:176)

I'm wondering if this is a bug/lacking feature, or intended.
As I initially said I'm not a network guy, so there might be perfectly good
reasons this shouldn't be allowed.

But if it's a bug/lacking feature it would be great to know so that I could
file a ticket for it.

-- 
Erik Weber


On Wed, May 21, 2014 at 2:09 PM, Daan Hoogland wrote:

> Erik,
>
> The vpn let's you connect to all the computers in the network on the
> other site on their private adresses. This means that you can give the
> cidr of the remote network in the definition on vpn connection.
>
> one network has 10.0.1.0/24 and ip 1.2.3.4
> the other has 10.0.2.0/24 and ip 4.3.2.1
>
> on the first you define endpoint/gateway 4.3.2.1 with cidr 10.0.1.0/24
> and you make it passive
> on the second you define the adresses of the first and stat is without
> the passive function
> now you can ping a machine with address 10.0.1.123 from a machine with
> ip 10.0.2.246
>
> Of course you can do this to an external network as well, which makes
> far more sense.
>
> On Wed, May 21, 2014 at 12:14 PM, Erik Weber  wrote:
> >
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/vpn.html#site-to-site-vpnstates
> :
> >
> >
> >- *CIDR list*: The guest CIDR list of the remote subnets. Enter a CIDR
> >or a comma-separated list of CIDRs. Ensure that a guest CIDR list is
> not
> >overlapped with the VPC’s CIDR, or another guest CIDR. The CIDR must
> be
> >RFC1918-compliant.
> >
> >
> > I'm not a network guy, so excuse the question if it's obvious, but if a
> > customer only has public ip's on their end, why is rfc1918 required?
> >
> >
> > --
> > Erik Weber
>
>
>
> --
> Daan
>


RE: cannot run integration tests on 4.4-forward

2014-05-21 Thread Santhosh Edukulla
Based upon a working setup, i added few package versions requirement to 
setup.py now.

Santhosh

From: sebgoa [run...@gmail.com]
Sent: Tuesday, May 20, 2014 8:39 AM
To: dev@cloudstack.apache.org
Cc: Rajani Karuturi
Subject: Re: cannot run integration tests on 4.4-forward

On May 20, 2014, at 2:30 PM, Santhosh Edukulla  
wrote:

> 1. The below error in message you pasged shows up the requests package you 
> are using is outdated or does not have verify argument.
>
> 2. On my machine requests version shows up 2.2.1 as below.
 import requests
>
 requests.__version__
> '2.2.1'

thanks, looks like this was it.

That means that marvin setup.py needs to be fixed:

install_requires=[
  "mysql-connector-python",
  "requests",
  "paramiko",
  "nose",
  "ddt >= 0.4.0"

to reflect the need for a higher version of requests...



>
> 3. Install latest requests package to fix this issue.
>
> pip may not work for 4.4-forward as it is not yet pushed to repo.
>
>
> Santhosh
>
>
> 
> From: Rajani Karuturi
> Sent: Tuesday, May 20, 2014 8:23 AM
> To: dev@cloudstack.apache.org
> Cc: Santhosh Edukulla
> Subject: Re: cannot run integration tests on 4.4-forward
>
> installing marvin from the code might help. I am not sure if the pip repo is 
> updated.
>
> $sudo python tools/marvin/setup.py install
>
> ~Rajani
>
>
>
> On 20-May-2014, at 5:41 pm, sebgoa  wrote:
>
>>
>> On May 20, 2014, at 2:03 PM, Santhosh Edukulla 
>>  wrote:
>>
>>> If https flag under cfg is not set, then request package version on this 
>>> machine, or python version could be an issue( > 2.7.x is required) . I just 
>>> tried one more time on simulator after this mail and it worked.
>>>
>>
>> I am on a fresh Ubuntu 12.04, python 2.7.3, requests 0.8.2 (which came from 
>> the pip install for Marvin)
>> Using the cfg that's in the repo in the 4.4-forward (did not change 
>> anything).
>>
>>
>>
>>> Santhosh
>>> 
>>> From: sebgoa [run...@gmail.com]
>>> Sent: Tuesday, May 20, 2014 7:55 AM
>>> To: Santhosh Edukulla
>>> Cc: dev@cloudstack.apache.org
>>> Subject: Re: cannot run integration tests on 4.4-forward
>>>
>>> On May 20, 2014, at 1:53 PM, Santhosh Edukulla 
>>>  wrote:
>>>
 Hi,

 We are running continuously using CI in our environment on 4.4-forward. 
 May be more steps as what followed here would help to check.

 Are we using https\http mode? Check this in advanced.cfg or cfg passed?

>>>
>>> I am using the simulator, everything running on the same machine ubuntu 
>>> 12.04.
>>>
>>> then I configure the DC with:
>>>
>>> python ./tools/marvin/marvin/deployDataCenter.py -i ./setup/dev/advanced.cfg
>>> or
>>> python ./tools/marvin/marvin/deployDataCenter.py -i ./setup/dev/basic.cfg
>>>
>>>
 Santhosh
 
 From: sebgoa [run...@gmail.com]
 Sent: Tuesday, May 20, 2014 7:43 AM
 To: dev@cloudstack.apache.org
 Cc: Santhosh Edukulla
 Subject: cannot run integration tests on 4.4-forward

 Hi,

 I have been trying to run the integration tests on 4.4-forward.
 While setting up the zone with Marvin I get an error:

 # more runinfo.txt
 2014-05-20 13:40:48,985 - DEBUG - Parsing Test data successful
 2014-05-20 13:40:48,987 - DEBUG - Payload: {'account': 'admin', 'command': 
 'listUsers', 'response': 'json'}
 2014-05-20 13:40:48,987 - DEBUG - Sending GET Cmd : 
 listUsers===
 2014-05-20 13:40:48,987 - ERROR - __sendGetReqToCS : Exception Occurred: 
 request() got an unexpected keyword argument 'verify'
 Traceback (most recent call last):
 File 
 "/usr/local/lib/python2.7/dist-packages/marvin/cloudstackConnection.py", 
 line 196, in __sendGetReqToCS
 verify=self.httpsFlag)
 File "/usr/lib/python2.7/dist-packages/requests/api.py", line 78, in get
 return request('get', url, **kwargs)
 TypeError: request() got an unexpected keyword argument 'verify'
 2014-05-20 13:40:48,987 - ERROR - marvinRequest : CmdName: 
  
 Exception: ['Traceback (most recent call last):\n', '  File 
 "/usr/local/lib/python2.7/dist-packages/marvin/cloudstac
 kConnection.py", line 370, in marvinRequest\nraise 
 self.__lastError\n', "TypeError: request() got an unexpected keyword 
 argument 'verify'\n"]
 Traceback (most recent call last):
 File 
 "/usr/local/lib/python2.7/dist-packages/marvin/cloudstackConnection.py", 
 line 370, in marvinRequest
 raise self.__lastError
 TypeError: request() got an unexpected keyword argument 'verify'
 2014-05-20 13:40:48,988 - ERROR -  Exception Occurred Under 
 __createApiClient: ['Traceback (most recent call last):\n', '  File 
 "/usr/local/lib/python2.7/dist-packages/marvin/cloudstackTestClient.py", 
 line 145, in __createApiClient\nlist

Review Request 21767: Preload modules so that some sysctl settings will actually get set during boot and some ftp modules to get pasive ftp to work through iptables

2014-05-21 Thread Joris van Lieshout

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21767/
---

Review request for cloudstack, Abhinandan Prateek, daan Hoogland, edison su, 
and Hugo Trippaers.


Repository: cloudstack-git


Description
---

During the boot of a systemvm sysctl ip_conntrack_max is not set, preloading 
these module will fix that. Also in order to get passive ftp to work through 
iptables we need to load some additional modules.


Diffs
-

  tools/appliance/definitions/systemvm64template/postinstall.sh cc8ead9 
  tools/appliance/definitions/systemvmtemplate/postinstall.sh 23e66dd 

Diff: https://reviews.apache.org/r/21767/diff/


Testing
---

We have been running this for a while now in our own production environment.


Thanks,

Joris van Lieshout



Review Request 21769: blacklisting pcspkr as cosmetic improvement. fixing aesni_intel blacklisting because modprobe.d files have to end with .conf

2014-05-21 Thread Joris van Lieshout

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21769/
---

Review request for cloudstack and daan Hoogland.


Repository: cloudstack-git


Description
---

the blacklisting of aesni_intel was not working. the file has to end with 
.conf. blacklisting pcspkr as cosmetic improvement.


Diffs
-

  systemvm/patches/debian/config/etc/modprobe.d/aesni_intel 1c140f0 
  systemvm/patches/debian/config/etc/modprobe.d/aesni_intel.conf PRE-CREATION 
  systemvm/patches/debian/config/etc/modprobe.d/pcspkr.conf PRE-CREATION 

Diff: https://reviews.apache.org/r/21769/diff/


Testing
---

running in our own production environment on many svms for a while now


Thanks,

Joris van Lieshout



Build failed in Jenkins: build-master-slowbuild #897

2014-05-21 Thread jenkins
See 

--
[...truncated 18336 lines...]

Tests run: 4, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] <<< cobertura-maven-plugin:2.6:cobertura (default-cli) @ cloud-awsapi <<<
[INFO] 
[INFO] --- cobertura-maven-plugin:2.6:cobertura (default-cli) @ cloud-awsapi ---
[INFO] Cobertura 2.0.3 - GNU GPL License (NO WARRANTY) - See COPYRIGHT file
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/amazon/ec2/AmazonEC2SkeletonInterface.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/amazon/s3/AmazonS3SkeletonInterface.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/model/SAcl.java.  Ensure this class was instrumented, and this 
data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/model/SBucket.java.  Ensure this class was instrumented, and 
this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/model/SHost.java.  Ensure this class was instrumented, and 
this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/BucketPolicyDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackAccountDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackConfigurationDao.java.  Ensure this 
class was instrumented, and this data file contains the instrumentation 
information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackSvcOfferingDao.java.  Ensure this class 
was instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/CloudStackUserDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MHostDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MHostMountDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MultiPartPartsDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MultiPartUploadsDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does not contain instrumentation information for the file 
com/cloud/bridge/persist/dao/MultipartMetaDao.java.  Ensure this class was 
instrumented, and this data file contains the instrumentation information.
[cobertura] INFO  [main] net.sourceforge.cobertura.reporting.html.HTMLReport - 
Data file does 

Review Request 21771: Cosmetic fixes in cloud-early-config script

2014-05-21 Thread Joris van Lieshout

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21771/
---

Review request for cloudstack, Chiradeep Vittal, daan Hoogland, Rajesh Battala, 
Hugo Trippaers, and Sheng Yang.


Repository: cloudstack-git


Description
---

1. On start hv_kvp_daemon if it exists. Currently trows an error on the console 
during boot.
2. By adding -f to the rm of boot_up_done it will be silent if it does not 
exist. Currently also trows an error during bootup.
3. Use log_action_msg instead of log_action_begin_msg will make the console 
look cleaner.


Diffs
-

  systemvm/patches/debian/config/etc/init.d/cloud-early-config ffb23ec 

Diff: https://reviews.apache.org/r/21771/diff/


Testing
---

We are running these fixes in our beta and prod env for a while allready


Thanks,

Joris van Lieshout



Re: VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Daan Hoogland
Erik, If it doesn't work it is probably been blocked on purpose but I
don't see why it is. I don't know your use case either and it seems an
unlikely one. But if the 50.0.1 net is out of your control you maybe
should be able to configure this. So I would say it is a bug/lack of
feature. I'll look into the code for the place the error is generated.

in short: file a ticket

On Wed, May 21, 2014 at 2:34 PM, Erik Weber  wrote:
> I understand that, but what my client wants is to connect public ips
> instead of rfc1918 on one of the sides.
>
> e.g. one network has 10.0.1.0/24 and ip 1.2.3.4
> the other has 50.0.1.0/24 and ip 50.0.0.1
>
> but cloudstack currently does not let you do that, because it expects cidrs
> to be rfc1918. see log excerpt:
>
> 2014-05-21 12:30:42,326 WARN  [c.c.u.n.NetUtils]
> (API-Job-Executor-7:job-3072 ctx-bf3922b1) cidr 50.0.1.0/24 is not RFC 1918
> compliant
> 2014-05-21 12:30:42,335 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-7:job-3072) Unexpected exception while executing
> org.apache.cloudstack.api.command.user.vpn.CreateVpnCustomerGatewayCmd
> com.cloud.exception.InvalidParameterValueException: The customer gateway
> guest cidr list 50.0.1.0/24 is invalid guest cidr!
> at
> com.cloud.network.vpn.Site2SiteVpnManagerImpl.createCustomerGateway(Site2SiteVpnManagerImpl.java:176)
>
> I'm wondering if this is a bug/lacking feature, or intended.
> As I initially said I'm not a network guy, so there might be perfectly good
> reasons this shouldn't be allowed.
>
> But if it's a bug/lacking feature it would be great to know so that I could
> file a ticket for it.
>
> --
> Erik Weber
>
>
> On Wed, May 21, 2014 at 2:09 PM, Daan Hoogland wrote:
>
>> Erik,
>>
>> The vpn let's you connect to all the computers in the network on the
>> other site on their private adresses. This means that you can give the
>> cidr of the remote network in the definition on vpn connection.
>>
>> one network has 10.0.1.0/24 and ip 1.2.3.4
>> the other has 10.0.2.0/24 and ip 4.3.2.1
>>
>> on the first you define endpoint/gateway 4.3.2.1 with cidr 10.0.1.0/24
>> and you make it passive
>> on the second you define the adresses of the first and stat is without
>> the passive function
>> now you can ping a machine with address 10.0.1.123 from a machine with
>> ip 10.0.2.246
>>
>> Of course you can do this to an external network as well, which makes
>> far more sense.
>>
>> On Wed, May 21, 2014 at 12:14 PM, Erik Weber  wrote:
>> >
>> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/vpn.html#site-to-site-vpnstates
>> :
>> >
>> >
>> >- *CIDR list*: The guest CIDR list of the remote subnets. Enter a CIDR
>> >or a comma-separated list of CIDRs. Ensure that a guest CIDR list is
>> not
>> >overlapped with the VPC’s CIDR, or another guest CIDR. The CIDR must
>> be
>> >RFC1918-compliant.
>> >
>> >
>> > I'm not a network guy, so excuse the question if it's obvious, but if a
>> > customer only has public ip's on their end, why is rfc1918 required?
>> >
>> >
>> > --
>> > Erik Weber
>>
>>
>>
>> --
>> Daan
>>



-- 
Daan


Review Request 21772: dnsmasq stops logging if logrotate creates the file

2014-05-21 Thread Joris van Lieshout

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21772/
---

Review request for cloudstack, Chiradeep Vittal, daan Hoogland, and Hugo 
Trippaers.


Repository: cloudstack-git


Description
---

If for some reason dnsmasq.log does not exist anymore logrotate will create it 
with nobody as owner. This will prevent dnsmasq deamon from logging to that 
file.

-rw-r-  1 nobody  root  0 May 16 06:25 dnsmasq.log
-rw-r-  1 dnsmasq root   6236 Apr 18 12:17 dnsmasq.log-20140419
-rw-r-  1 dnsmasq root  31673 May 13 22:51 dnsmasq.log-20140514
-rw-r-  1 dnsmasq root  15739 May 14 18:05 dnsmasq.log-20140515
-rw-r-  1 dnsmasq root  16831 May 15 21:11 dnsmasq.log-20140516


Diffs
-

  systemvm/patches/debian/config/etc/logrotate.d/dnsmasq 838415d3 

Diff: https://reviews.apache.org/r/21772/diff/


Testing
---


Thanks,

Joris van Lieshout



Re: VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Daan Hoogland
Are you creating a site to site vpn or connecting to an external network?

On Wed, May 21, 2014 at 5:02 PM, Daan Hoogland  wrote:
> Erik, If it doesn't work it is probably been blocked on purpose but I
> don't see why it is. I don't know your use case either and it seems an
> unlikely one. But if the 50.0.1 net is out of your control you maybe
> should be able to configure this. So I would say it is a bug/lack of
> feature. I'll look into the code for the place the error is generated.
>
> in short: file a ticket
>
> On Wed, May 21, 2014 at 2:34 PM, Erik Weber  wrote:
>> I understand that, but what my client wants is to connect public ips
>> instead of rfc1918 on one of the sides.
>>
>> e.g. one network has 10.0.1.0/24 and ip 1.2.3.4
>> the other has 50.0.1.0/24 and ip 50.0.0.1
>>
>> but cloudstack currently does not let you do that, because it expects cidrs
>> to be rfc1918. see log excerpt:
>>
>> 2014-05-21 12:30:42,326 WARN  [c.c.u.n.NetUtils]
>> (API-Job-Executor-7:job-3072 ctx-bf3922b1) cidr 50.0.1.0/24 is not RFC 1918
>> compliant
>> 2014-05-21 12:30:42,335 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (API-Job-Executor-7:job-3072) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vpn.CreateVpnCustomerGatewayCmd
>> com.cloud.exception.InvalidParameterValueException: The customer gateway
>> guest cidr list 50.0.1.0/24 is invalid guest cidr!
>> at
>> com.cloud.network.vpn.Site2SiteVpnManagerImpl.createCustomerGateway(Site2SiteVpnManagerImpl.java:176)
>>
>> I'm wondering if this is a bug/lacking feature, or intended.
>> As I initially said I'm not a network guy, so there might be perfectly good
>> reasons this shouldn't be allowed.
>>
>> But if it's a bug/lacking feature it would be great to know so that I could
>> file a ticket for it.
>>
>> --
>> Erik Weber
>>
>>
>> On Wed, May 21, 2014 at 2:09 PM, Daan Hoogland 
>> wrote:
>>
>>> Erik,
>>>
>>> The vpn let's you connect to all the computers in the network on the
>>> other site on their private adresses. This means that you can give the
>>> cidr of the remote network in the definition on vpn connection.
>>>
>>> one network has 10.0.1.0/24 and ip 1.2.3.4
>>> the other has 10.0.2.0/24 and ip 4.3.2.1
>>>
>>> on the first you define endpoint/gateway 4.3.2.1 with cidr 10.0.1.0/24
>>> and you make it passive
>>> on the second you define the adresses of the first and stat is without
>>> the passive function
>>> now you can ping a machine with address 10.0.1.123 from a machine with
>>> ip 10.0.2.246
>>>
>>> Of course you can do this to an external network as well, which makes
>>> far more sense.
>>>
>>> On Wed, May 21, 2014 at 12:14 PM, Erik Weber  wrote:
>>> >
>>> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/vpn.html#site-to-site-vpnstates
>>> :
>>> >
>>> >
>>> >- *CIDR list*: The guest CIDR list of the remote subnets. Enter a CIDR
>>> >or a comma-separated list of CIDRs. Ensure that a guest CIDR list is
>>> not
>>> >overlapped with the VPC’s CIDR, or another guest CIDR. The CIDR must
>>> be
>>> >RFC1918-compliant.
>>> >
>>> >
>>> > I'm not a network guy, so excuse the question if it's obvious, but if a
>>> > customer only has public ip's on their end, why is rfc1918 required?
>>> >
>>> >
>>> > --
>>> > Erik Weber
>>>
>>>
>>>
>>> --
>>> Daan
>>>
>
>
>
> --
> Daan



-- 
Daan


Re: Review Request 21673: Missing KVM mappings causes NPE

2014-05-21 Thread Nitin Mehta

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21673/#review43623
---

Ship it!


Ship It!

- Nitin Mehta


On May 20, 2014, 12:11 a.m., Amogh Vasekar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21673/
> ---
> 
> (Updated May 20, 2014, 12:11 a.m.)
> 
> 
> Review request for cloudstack and Nitin Mehta.
> 
> 
> Bugs: CLOUDSTACK-6671
> https://issues.apache.org/jira/browse/CLOUDSTACK-6671
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Fixing NPE when a mapping is missing
> Adding missing KVM mappings
> 
> 
> Diffs
> -
> 
>   plugins/hypervisors/xen/src/com/cloud/hypervisor/XenServerGuru.java 
> 620d7113f411c60729e176f093602dc364be74b9 
>   server/src/com/cloud/hypervisor/KVMGuru.java 
> 4225232064df1081e14f933837d001c1408012cf 
>   setup/db/db/schema-430to440.sql 89db04a2e93e048e3b6fa088a9679d7d4daa29c7 
> 
> Diff: https://reviews.apache.org/r/21673/diff/
> 
> 
> Testing
> ---
> 
> Local testing with removing CentOS mapping and launch a VM. 
> 
> 
> Thanks,
> 
> Amogh Vasekar
> 
>



Review Request 21773: sysctl improvements regarding nf_conntrack_max, panic and nonlocal_bind

2014-05-21 Thread Joris van Lieshout

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21773/
---

Review request for cloudstack, Chiradeep Vittal, daan Hoogland, edison su, Hugo 
Trippaers, and Sheng Yang.


Repository: cloudstack-git


Description
---

net.ipv4.ip_nonlocal_bind = 1
For smooth transition on redundant routers in case of a failover

kernel.panic = 10
kernel.panic_on_oops = 1
vm.panic_on_oom = 1
This way, if the instance oops/ooms, it dies in a way that ACS sees it and can 
act on it

net.nf_conntrack_max = 100
net.netfilter.nf_conntrack_max = 100
also up the limit of nf_conntrack for more performance


Diffs
-

  systemvm/patches/debian/config/etc/sysctl.conf 586d5bd 

Diff: https://reviews.apache.org/r/21773/diff/


Testing
---

we are running these settings in our beta and prod env for months allready, 
with good results.


Thanks,

Joris van Lieshout



Re: Review Request 21629: CLOUDSTACK-4757. Support OVA files containing multiple disks.

2014-05-21 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21629/#review43630
---


Commit 87d87a6f30c45125e5769f04e8d4260074c79f87 in cloudstack's branch 
refs/heads/multiple-disk-ova from Likitha Shetty
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=87d87a6 ]

CLOUDSTACK-4757. Improvements to the marvin test.


- ASF Subversion and Git Services


On May 19, 2014, 11:59 a.m., Likitha Shetty wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21629/
> ---
> 
> (Updated May 19, 2014, 11:59 a.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Bugs: CLOUDSTACK-4757
> https://issues.apache.org/jira/browse/CLOUDSTACK-4757
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> This patch is for 4.5 feature 'Support OVA files containing multiple disks'.
> Functional spec for the feature is available at - 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Support+OVA+files+containing+multiple+disks
>  
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/agent/api/to/DatadiskTO.java PRE-CREATION 
>   api/src/com/cloud/storage/Storage.java cc8d010 
>   api/src/com/cloud/template/VirtualMachineTemplate.java 599212b 
>   api/src/com/cloud/vm/DiskProfile.java a37f7aa 
>   api/src/com/cloud/vm/UserVmService.java af4e1d3 
>   api/src/org/apache/cloudstack/api/ApiConstants.java a3faca7 
>   api/src/org/apache/cloudstack/api/ResponseGenerator.java 10fb6df 
>   
> api/src/org/apache/cloudstack/api/command/user/template/ListTemplatesCmd.java 
> 7a2a158 
>   api/src/org/apache/cloudstack/api/command/user/vm/DeployVMCmd.java 0adc57b 
>   api/src/org/apache/cloudstack/api/response/TemplateResponse.java 3e21043 
>   core/src/com/cloud/agent/api/storage/CreateDatadiskTemplateAnswer.java 
> PRE-CREATION 
>   core/src/com/cloud/agent/api/storage/CreateDatadiskTemplateCommand.java 
> PRE-CREATION 
>   core/src/com/cloud/agent/api/storage/GetDatadisksAnswer.java PRE-CREATION 
>   core/src/com/cloud/agent/api/storage/GetDatadisksCommand.java PRE-CREATION 
>   core/src/com/cloud/storage/template/OVAProcessor.java 0db3bb0 
>   core/src/org/apache/cloudstack/storage/to/TemplateObjectTO.java b201c38 
>   engine/api/src/com/cloud/vm/VirtualMachineManager.java f070210 
>   
> engine/api/src/org/apache/cloudstack/engine/orchestration/service/VolumeOrchestrationService.java
>  df0b5e8 
>   
> engine/api/src/org/apache/cloudstack/engine/service/api/OrchestrationService.java
>  93f969f 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/EndPointSelector.java
>  4657316 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/TemplateService.java
>  88ce932 
>   
> engine/api/src/org/apache/cloudstack/storage/image/datastore/ImageStoreEntity.java
>  43a0f75 
>   engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java 
> e15d287 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/orchestration/CloudOrchestrator.java
>  2b49954 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/orchestration/VolumeOrchestrator.java
>  6256e25 
>   engine/schema/src/com/cloud/storage/VMTemplateVO.java 9a77cbf 
>   engine/schema/src/com/cloud/storage/dao/VMTemplateDao.java 2b815d8 
>   engine/schema/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 401a4a2 
>   
> engine/storage/image/src/org/apache/cloudstack/storage/image/TemplateServiceImpl.java
>  4e6ab6b 
>   
> engine/storage/image/src/org/apache/cloudstack/storage/image/store/ImageStoreImpl.java
>  8da7eb7 
>   
> engine/storage/image/src/org/apache/cloudstack/storage/image/store/TemplateObject.java
>  7288d45 
>   
> engine/storage/src/org/apache/cloudstack/storage/endpoint/DefaultEndPointSelector.java
>  304f959 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/BaseImageStoreDriverImpl.java
>  7ed11ec 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/ImageStoreDriver.java 
> fa7ea37 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/TemplateEntityImpl.java
>  c1aa8c2 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManager.java
>  f78f370 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManagerImpl.java
>  c1b907e 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/resource/VmwareResource.java
>  0024b44 
>   
> plugins/hypervisors/vmware/src/com/cloud/storage/resource/VmwareSecondaryStorageResourceHandler.java
>  f633774 
>   
> plugins/hypervisors/vmware/src/com/cloud/storage/resource/VmwareStorageProcessor.java
>  ff893b2 
>   plugins/hypervisors/xen/src/com/cloud/hypervisor/XenServerGuru.java 89e4ab5 
>   server/src/com/cloud/api/ApiResponseHelper.java 250f5a9

Re: Review Request 21629: CLOUDSTACK-4757. Support OVA files containing multiple disks.

2014-05-21 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21629/#review43629
---


Commit 30b8eba92342d391abef9bb3efa1c6efcf588875 in cloudstack's branch 
refs/heads/multiple-disk-ova from Likitha Shetty
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=30b8eba ]

CLOUDSTACK-4757. Cleanup datadisk templates that have already been created in 
case creation of one of the datadisk template fails


- ASF Subversion and Git Services


On May 19, 2014, 11:59 a.m., Likitha Shetty wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21629/
> ---
> 
> (Updated May 19, 2014, 11:59 a.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Bugs: CLOUDSTACK-4757
> https://issues.apache.org/jira/browse/CLOUDSTACK-4757
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> This patch is for 4.5 feature 'Support OVA files containing multiple disks'.
> Functional spec for the feature is available at - 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Support+OVA+files+containing+multiple+disks
>  
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/agent/api/to/DatadiskTO.java PRE-CREATION 
>   api/src/com/cloud/storage/Storage.java cc8d010 
>   api/src/com/cloud/template/VirtualMachineTemplate.java 599212b 
>   api/src/com/cloud/vm/DiskProfile.java a37f7aa 
>   api/src/com/cloud/vm/UserVmService.java af4e1d3 
>   api/src/org/apache/cloudstack/api/ApiConstants.java a3faca7 
>   api/src/org/apache/cloudstack/api/ResponseGenerator.java 10fb6df 
>   
> api/src/org/apache/cloudstack/api/command/user/template/ListTemplatesCmd.java 
> 7a2a158 
>   api/src/org/apache/cloudstack/api/command/user/vm/DeployVMCmd.java 0adc57b 
>   api/src/org/apache/cloudstack/api/response/TemplateResponse.java 3e21043 
>   core/src/com/cloud/agent/api/storage/CreateDatadiskTemplateAnswer.java 
> PRE-CREATION 
>   core/src/com/cloud/agent/api/storage/CreateDatadiskTemplateCommand.java 
> PRE-CREATION 
>   core/src/com/cloud/agent/api/storage/GetDatadisksAnswer.java PRE-CREATION 
>   core/src/com/cloud/agent/api/storage/GetDatadisksCommand.java PRE-CREATION 
>   core/src/com/cloud/storage/template/OVAProcessor.java 0db3bb0 
>   core/src/org/apache/cloudstack/storage/to/TemplateObjectTO.java b201c38 
>   engine/api/src/com/cloud/vm/VirtualMachineManager.java f070210 
>   
> engine/api/src/org/apache/cloudstack/engine/orchestration/service/VolumeOrchestrationService.java
>  df0b5e8 
>   
> engine/api/src/org/apache/cloudstack/engine/service/api/OrchestrationService.java
>  93f969f 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/EndPointSelector.java
>  4657316 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/TemplateService.java
>  88ce932 
>   
> engine/api/src/org/apache/cloudstack/storage/image/datastore/ImageStoreEntity.java
>  43a0f75 
>   engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java 
> e15d287 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/orchestration/CloudOrchestrator.java
>  2b49954 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/orchestration/VolumeOrchestrator.java
>  6256e25 
>   engine/schema/src/com/cloud/storage/VMTemplateVO.java 9a77cbf 
>   engine/schema/src/com/cloud/storage/dao/VMTemplateDao.java 2b815d8 
>   engine/schema/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 401a4a2 
>   
> engine/storage/image/src/org/apache/cloudstack/storage/image/TemplateServiceImpl.java
>  4e6ab6b 
>   
> engine/storage/image/src/org/apache/cloudstack/storage/image/store/ImageStoreImpl.java
>  8da7eb7 
>   
> engine/storage/image/src/org/apache/cloudstack/storage/image/store/TemplateObject.java
>  7288d45 
>   
> engine/storage/src/org/apache/cloudstack/storage/endpoint/DefaultEndPointSelector.java
>  304f959 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/BaseImageStoreDriverImpl.java
>  7ed11ec 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/ImageStoreDriver.java 
> fa7ea37 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/TemplateEntityImpl.java
>  c1aa8c2 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManager.java
>  f78f370 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManagerImpl.java
>  c1b907e 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/resource/VmwareResource.java
>  0024b44 
>   
> plugins/hypervisors/vmware/src/com/cloud/storage/resource/VmwareSecondaryStorageResourceHandler.java
>  f633774 
>   
> plugins/hypervisors/vmware/src/com/cloud/storage/resource/VmwareStorageProcessor.java
>  ff893b2 
>   plugins/hypervisors/xen/src/com/cloud/hypervisor/XenSer

Re: Review Request 21629: CLOUDSTACK-4757. Support OVA files containing multiple disks.

2014-05-21 Thread Likitha Shetty

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21629/
---

(Updated May 21, 2014, 4:10 p.m.)


Review request for cloudstack.


Bugs: CLOUDSTACK-4757
https://issues.apache.org/jira/browse/CLOUDSTACK-4757


Repository: cloudstack-git


Description
---

This patch is for 4.5 feature 'Support OVA files containing multiple disks'.
Functional spec for the feature is available at - 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Support+OVA+files+containing+multiple+disks
 


Diffs (updated)
-

  api/src/com/cloud/agent/api/to/DatadiskTO.java PRE-CREATION 
  api/src/com/cloud/storage/Storage.java cc8d010 
  api/src/com/cloud/template/VirtualMachineTemplate.java 599212b 
  api/src/com/cloud/vm/DiskProfile.java a37f7aa 
  api/src/com/cloud/vm/UserVmService.java af4e1d3 
  api/src/org/apache/cloudstack/api/ApiConstants.java a3faca7 
  api/src/org/apache/cloudstack/api/ResponseGenerator.java 10fb6df 
  api/src/org/apache/cloudstack/api/command/user/template/ListTemplatesCmd.java 
7a2a158 
  api/src/org/apache/cloudstack/api/command/user/vm/DeployVMCmd.java 0adc57b 
  api/src/org/apache/cloudstack/api/response/TemplateResponse.java 3e21043 
  core/src/com/cloud/agent/api/storage/CreateDatadiskTemplateAnswer.java 
PRE-CREATION 
  core/src/com/cloud/agent/api/storage/CreateDatadiskTemplateCommand.java 
PRE-CREATION 
  core/src/com/cloud/agent/api/storage/GetDatadisksAnswer.java PRE-CREATION 
  core/src/com/cloud/agent/api/storage/GetDatadisksCommand.java PRE-CREATION 
  core/src/com/cloud/storage/template/OVAProcessor.java 0db3bb0 
  core/src/org/apache/cloudstack/storage/to/TemplateObjectTO.java b201c38 
  engine/api/src/com/cloud/vm/VirtualMachineManager.java f070210 
  
engine/api/src/org/apache/cloudstack/engine/orchestration/service/VolumeOrchestrationService.java
 df0b5e8 
  
engine/api/src/org/apache/cloudstack/engine/service/api/OrchestrationService.java
 93f969f 
  
engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/EndPointSelector.java
 4657316 
  
engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/TemplateService.java
 88ce932 
  
engine/api/src/org/apache/cloudstack/storage/image/datastore/ImageStoreEntity.java
 43a0f75 
  engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java e15d287 
  
engine/orchestration/src/org/apache/cloudstack/engine/orchestration/CloudOrchestrator.java
 2b49954 
  
engine/orchestration/src/org/apache/cloudstack/engine/orchestration/VolumeOrchestrator.java
 6256e25 
  engine/schema/src/com/cloud/storage/VMTemplateVO.java 9a77cbf 
  engine/schema/src/com/cloud/storage/dao/VMTemplateDao.java 2b815d8 
  engine/schema/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 401a4a2 
  
engine/storage/image/src/org/apache/cloudstack/storage/image/TemplateServiceImpl.java
 4e6ab6b 
  
engine/storage/image/src/org/apache/cloudstack/storage/image/store/ImageStoreImpl.java
 8da7eb7 
  
engine/storage/image/src/org/apache/cloudstack/storage/image/store/TemplateObject.java
 7288d45 
  
engine/storage/src/org/apache/cloudstack/storage/endpoint/DefaultEndPointSelector.java
 304f959 
  
engine/storage/src/org/apache/cloudstack/storage/image/BaseImageStoreDriverImpl.java
 7ed11ec 
  engine/storage/src/org/apache/cloudstack/storage/image/ImageStoreDriver.java 
fa7ea37 
  
engine/storage/src/org/apache/cloudstack/storage/image/TemplateEntityImpl.java 
c1aa8c2 
  
plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManager.java
 f78f370 
  
plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManagerImpl.java
 c1b907e 
  
plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/resource/VmwareResource.java
 0024b44 
  
plugins/hypervisors/vmware/src/com/cloud/storage/resource/VmwareSecondaryStorageResourceHandler.java
 f633774 
  
plugins/hypervisors/vmware/src/com/cloud/storage/resource/VmwareStorageProcessor.java
 ff893b2 
  plugins/hypervisors/xen/src/com/cloud/hypervisor/XenServerGuru.java 89e4ab5 
  server/src/com/cloud/api/ApiResponseHelper.java 250f5a9 
  server/src/com/cloud/api/query/QueryManagerImpl.java 8e020fc 
  server/src/com/cloud/api/query/dao/TemplateJoinDaoImpl.java 80ef0f6 
  server/src/com/cloud/api/query/vo/TemplateJoinVO.java 834a9ce 
  server/src/com/cloud/network/as/AutoScaleManagerImpl.java 09c6694 
  server/src/com/cloud/template/HypervisorTemplateAdapter.java 51dedf7 
  server/src/com/cloud/template/TemplateManagerImpl.java ead841f 
  server/src/com/cloud/vm/UserVmManagerImpl.java 3d262b7 
  setup/db/db/schema-440to450.sql 4cc4879 
  test/integration/component/test_ova_templates_with_multiple_disks.py 
PRE-CREATION 
  tools/marvin/marvin/lib/base.py 966e8dc 
  vmware-base/src/com/cloud/hypervisor/vmware/mo/HypervisorHostHelper.java 
38b68b3 

Diff: https://reviews.apache.org/r/21629/diff/


Testing
---

Re: VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Erik Weber
Site to site vpn.

I'm not in control of the 50.0.1 network, but the client is.

Basically the use case is that they want to secure the traffic to their
cloud vms, and are fortunate enough to not have to use rfc1918  on their
network.

I guess we could work around it by terminating the vpn on our equipment and
access it as a private gateway instead, but I'd prefer to use the
technology that we so braverly tell our clients about.

Erik
21. mai 2014 17:05 skrev "Daan Hoogland"  følgende:

> Are you creating a site to site vpn or connecting to an external network?
>
> On Wed, May 21, 2014 at 5:02 PM, Daan Hoogland 
> wrote:
> > Erik, If it doesn't work it is probably been blocked on purpose but I
> > don't see why it is. I don't know your use case either and it seems an
> > unlikely one. But if the 50.0.1 net is out of your control you maybe
> > should be able to configure this. So I would say it is a bug/lack of
> > feature. I'll look into the code for the place the error is generated.
> >
> > in short: file a ticket
> >
> > On Wed, May 21, 2014 at 2:34 PM, Erik Weber  wrote:
> >> I understand that, but what my client wants is to connect public ips
> >> instead of rfc1918 on one of the sides.
> >>
> >> e.g. one network has 10.0.1.0/24 and ip 1.2.3.4
> >> the other has 50.0.1.0/24 and ip 50.0.0.1
> >>
> >> but cloudstack currently does not let you do that, because it expects
> cidrs
> >> to be rfc1918. see log excerpt:
> >>
> >> 2014-05-21 12:30:42,326 WARN  [c.c.u.n.NetUtils]
> >> (API-Job-Executor-7:job-3072 ctx-bf3922b1) cidr 50.0.1.0/24 is not RFC
> 1918
> >> compliant
> >> 2014-05-21 12:30:42,335 ERROR [c.c.a.ApiAsyncJobDispatcher]
> >> (API-Job-Executor-7:job-3072) Unexpected exception while executing
> >> org.apache.cloudstack.api.command.user.vpn.CreateVpnCustomerGatewayCmd
> >> com.cloud.exception.InvalidParameterValueException: The customer gateway
> >> guest cidr list 50.0.1.0/24 is invalid guest cidr!
> >> at
> >>
> com.cloud.network.vpn.Site2SiteVpnManagerImpl.createCustomerGateway(Site2SiteVpnManagerImpl.java:176)
> >>
> >> I'm wondering if this is a bug/lacking feature, or intended.
> >> As I initially said I'm not a network guy, so there might be perfectly
> good
> >> reasons this shouldn't be allowed.
> >>
> >> But if it's a bug/lacking feature it would be great to know so that I
> could
> >> file a ticket for it.
> >>
> >> --
> >> Erik Weber
> >>
> >>
> >> On Wed, May 21, 2014 at 2:09 PM, Daan Hoogland  >wrote:
> >>
> >>> Erik,
> >>>
> >>> The vpn let's you connect to all the computers in the network on the
> >>> other site on their private adresses. This means that you can give the
> >>> cidr of the remote network in the definition on vpn connection.
> >>>
> >>> one network has 10.0.1.0/24 and ip 1.2.3.4
> >>> the other has 10.0.2.0/24 and ip 4.3.2.1
> >>>
> >>> on the first you define endpoint/gateway 4.3.2.1 with cidr 10.0.1.0/24
> >>> and you make it passive
> >>> on the second you define the adresses of the first and stat is without
> >>> the passive function
> >>> now you can ping a machine with address 10.0.1.123 from a machine with
> >>> ip 10.0.2.246
> >>>
> >>> Of course you can do this to an external network as well, which makes
> >>> far more sense.
> >>>
> >>> On Wed, May 21, 2014 at 12:14 PM, Erik Weber 
> wrote:
> >>> >
> >>>
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/vpn.html#site-to-site-vpnstates
> >>> :
> >>> >
> >>> >
> >>> >- *CIDR list*: The guest CIDR list of the remote subnets. Enter a
> CIDR
> >>> >or a comma-separated list of CIDRs. Ensure that a guest CIDR list
> is
> >>> not
> >>> >overlapped with the VPC’s CIDR, or another guest CIDR. The CIDR
> must
> >>> be
> >>> >RFC1918-compliant.
> >>> >
> >>> >
> >>> > I'm not a network guy, so excuse the question if it's obvious, but
> if a
> >>> > customer only has public ip's on their end, why is rfc1918 required?
> >>> >
> >>> >
> >>> > --
> >>> > Erik Weber
> >>>
> >>>
> >>>
> >>> --
> >>> Daan
> >>>
> >
> >
> >
> > --
> > Daan
>
>
>
> --
> Daan
>


Simulator setup on windows

2014-05-21 Thread Gaurav Aradhye
Hi all,

I am trying to setup simulator on windows machine and 2 tests in Cloud core
are failing.

Failed tests:
testFirewallRulesCommand(com.cloud.agent.resource.virtualnetwork
.VirtualRoutingResourceTest): expected:<...1.2/24:,64.10.10.10:
[reverted:0:0:0:,
64.10.10.10:TCP:22:80:10.10.1.1/24-10.10.1.2/24]:,> but
was:<...1.2/24:,64.10.10
.10:[TCP:22:80:10.10.1.1/24-10.10.1.2/24:,64.10.10.10:reverted:0:0:0]:,>

testAggregationCommands(com.cloud.agent.resource.virtualnetwork.VirtualRouting
ResourceTest): expected:<...1.2/24:,64.10.10.10:
[reverted:0:0:0:,64.10.10.10:TCP
:22:80:10.10.1.1/24-10.10.1.2/24]:,(..)

Can you tell me do I need to configure something to fix this?

Regards,
Gaurav


RE: Simulator setup on windows

2014-05-21 Thread Santhosh Edukulla
use skipTests with mvn command to skip tests, "but" not sure, if simulator is 
fully functional and works on windows, it was used and tested on non windows 
platform though. If your requirement is simulator and not its running platform, 
then try linux\mac.

Santhosh

From: Gaurav Aradhye [gaurav.arad...@clogeny.com]
Sent: Wednesday, May 21, 2014 3:32 PM
To: dev@cloudstack.apache.org
Subject: Simulator setup on windows

Hi all,

I am trying to setup simulator on windows machine and 2 tests in Cloud core
are failing.

Failed tests:
testFirewallRulesCommand(com.cloud.agent.resource.virtualnetwork
.VirtualRoutingResourceTest): expected:<...1.2/24:,64.10.10.10:
[reverted:0:0:0:,
64.10.10.10:TCP:22:80:10.10.1.1/24-10.10.1.2/24]:,> but
was:<...1.2/24:,64.10.10
.10:[TCP:22:80:10.10.1.1/24-10.10.1.2/24:,64.10.10.10:reverted:0:0:0]:,>

testAggregationCommands(com.cloud.agent.resource.virtualnetwork.VirtualRouting
ResourceTest): expected:<...1.2/24:,64.10.10.10:
[reverted:0:0:0:,64.10.10.10:TCP
:22:80:10.10.1.1/24-10.10.1.2/24]:,(..)

Can you tell me do I need to configure something to fix this?

Regards,
Gaurav


[Marvin] Having trouble installing Marvin

2014-05-21 Thread Mike Tutkowski
Hi,

I built Marvin today using the following command (on the 4.4 branch):

mvn -P developer -pl :cloud-marvin

I then ran the following:

sudo pip install tools/marvin/dist/Marvin-0.1.0.tar.gz

Unfortunately it completed with an error (below).

Does anyone know what might be wrong on my system here (Mac OS X 10.9.3)?:

cc -fno-strict-aliasing -fno-common -dynamic -arch x86_64 -arch i386 -pipe
-fno-common -fno-strict-aliasing -fwrapv -mno-fused-madd -DENABLE_DTRACE
-DMACOSX -Wall -Wstrict-prototypes -Wshorten-64-to-32 -fwrapv -Wall
-Wstrict-prototypes -DENABLE_DTRACE -arch x86_64 -arch i386 -pipe -std=c99
-O3 -fomit-frame-pointer -Isrc/
-I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7
-c src/MD2.c -o build/temp.macosx-10.9-intel-2.7/src/MD2.o

clang: error: unknown argument: '-mno-fused-madd'
[-Wunused-command-line-argument-hard-error-in-future]

clang: note: this will be a hard error (cannot be downgraded to a warning)
in the future

error: command 'cc' failed with exit status 1


Cleaning up...
  Removing temporary dir /private/tmp/pip_build_root...
Command /usr/bin/python -c "import setuptools,
tokenize;__file__='/private/tmp/pip_build_root/pycrypto/setup.py';exec(compile(getattr(tokenize,
'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))"
install --record /tmp/pip-jLn1ua-record/install-record.txt
--single-version-externally-managed --compile failed with error code 1 in
/private/tmp/pip_build_root/pycrypto
Exception information:
Traceback (most recent call last):
  File
"/Library/Python/2.7/site-packages/pip-1.5.6-py2.7.egg/pip/basecommand.py",
line 122, in main
status = self.run(options, args)
  File
"/Library/Python/2.7/site-packages/pip-1.5.6-py2.7.egg/pip/commands/install.py",
line 283, in run
requirement_set.install(install_options, global_options,
root=options.root_path)
  File "/Library/Python/2.7/site-packages/pip-1.5.6-py2.7.egg/pip/req.py",
line 1435, in install
requirement.install(install_options, global_options, *args, **kwargs)
  File "/Library/Python/2.7/site-packages/pip-1.5.6-py2.7.egg/pip/req.py",
line 706, in install
cwd=self.source_dir, filter_stdout=self._filter_install,
show_stdout=False)
  File "/Library/Python/2.7/site-packages/pip-1.5.6-py2.7.egg/pip/util.py",
line 697, in call_subprocess
% (command_desc, proc.returncode, cwd))
InstallationError: Command /usr/bin/python -c "import setuptools,
tokenize;__file__='/private/tmp/pip_build_root/pycrypto/setup.py';exec(compile(getattr(tokenize,
'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))"
install --record /tmp/pip-jLn1ua-record/install-record.txt
--single-version-externally-managed --compile failed with error code 1 in
/private/tmp/pip_build_root/pycrypto

Thanks!

-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*


Re: [Marvin] Having trouble installing Marvin

2014-05-21 Thread Mike Tutkowski
Looks like I sent this e-mail out a bit too soon. I found a solution:

sudo su - export CFLAGS=-Qunused-arguments export
CPPFLAGS=-Qunused-arguments pip install ansible exit

Then run:

sudo pip install tools/marvin/dist/Marvin-0.1.0.tar.gz


On Wed, May 21, 2014 at 2:43 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> Hi,
>
> I built Marvin today using the following command (on the 4.4 branch):
>
> mvn -P developer -pl :cloud-marvin
>
> I then ran the following:
>
> sudo pip install tools/marvin/dist/Marvin-0.1.0.tar.gz
>
> Unfortunately it completed with an error (below).
>
> Does anyone know what might be wrong on my system here (Mac OS X 10.9.3)?:
>
> cc -fno-strict-aliasing -fno-common -dynamic -arch x86_64 -arch i386 -pipe
> -fno-common -fno-strict-aliasing -fwrapv -mno-fused-madd -DENABLE_DTRACE
> -DMACOSX -Wall -Wstrict-prototypes -Wshorten-64-to-32 -fwrapv -Wall
> -Wstrict-prototypes -DENABLE_DTRACE -arch x86_64 -arch i386 -pipe -std=c99
> -O3 -fomit-frame-pointer -Isrc/
> -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7
> -c src/MD2.c -o build/temp.macosx-10.9-intel-2.7/src/MD2.o
>
> clang: error: unknown argument: '-mno-fused-madd'
> [-Wunused-command-line-argument-hard-error-in-future]
>
> clang: note: this will be a hard error (cannot be downgraded to a warning)
> in the future
>
> error: command 'cc' failed with exit status 1
>
> 
> Cleaning up...
>   Removing temporary dir /private/tmp/pip_build_root...
> Command /usr/bin/python -c "import setuptools,
> tokenize;__file__='/private/tmp/pip_build_root/pycrypto/setup.py';exec(compile(getattr(tokenize,
> 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))"
> install --record /tmp/pip-jLn1ua-record/install-record.txt
> --single-version-externally-managed --compile failed with error code 1 in
> /private/tmp/pip_build_root/pycrypto
> Exception information:
> Traceback (most recent call last):
>   File
> "/Library/Python/2.7/site-packages/pip-1.5.6-py2.7.egg/pip/basecommand.py",
> line 122, in main
> status = self.run(options, args)
>   File
> "/Library/Python/2.7/site-packages/pip-1.5.6-py2.7.egg/pip/commands/install.py",
> line 283, in run
> requirement_set.install(install_options, global_options,
> root=options.root_path)
>   File "/Library/Python/2.7/site-packages/pip-1.5.6-py2.7.egg/pip/req.py",
> line 1435, in install
> requirement.install(install_options, global_options, *args, **kwargs)
>   File "/Library/Python/2.7/site-packages/pip-1.5.6-py2.7.egg/pip/req.py",
> line 706, in install
> cwd=self.source_dir, filter_stdout=self._filter_install,
> show_stdout=False)
>   File
> "/Library/Python/2.7/site-packages/pip-1.5.6-py2.7.egg/pip/util.py", line
> 697, in call_subprocess
> % (command_desc, proc.returncode, cwd))
> InstallationError: Command /usr/bin/python -c "import setuptools,
> tokenize;__file__='/private/tmp/pip_build_root/pycrypto/setup.py';exec(compile(getattr(tokenize,
> 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))"
> install --record /tmp/pip-jLn1ua-record/install-record.txt
> --single-version-externally-managed --compile failed with error code 1 in
> /private/tmp/pip_build_root/pycrypto
>
> Thanks!
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the 
> cloud
> *™*
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*


Re: [PROPOSAL] Using continuous integration to maintain our code quality...

2014-05-21 Thread Chip Childers
On Wed, May 21, 2014 at 2:30 AM, sebgoa  wrote:
> Why don't Citrix developers show us how they would do it in the open ? Right 
> now it's all hidden.

+1 - I like some of the concepts of this proposal, but I have some
concerns as well.

I'll also state for the record, that I will -1 any decision that leads
us to depend on a single company's infrastructure as a project level
policy. That said, having it available from Citrix for use is a great
thing for that company to donate!  It's going to be difficult to
balance our development needs with our need to remain vendor neutral /
independent.

-chip


How does Jenkins test new plugin for new device support?

2014-05-21 Thread Ritu Sabharwal
Hi,

I am adding a new plugin for supporting new device.
Once the code is reviewed and committed to Git, would Jenkins run the automated 
tests only for the management server and not the plugin code because it would 
not have the new hardware to test it with.

How does that happen ?

Thanks & Regards,
Ritu S.


Updating ACS 4.4 features list on release page?

2014-05-21 Thread Demetrius Tsitrelis
In the "Features" section of the CloudStack 4.4 Release (Draft) page 
(https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=39623192) is 
a filter for a previous version of features 
(https://issues.apache.org/jira/sr/jira.issueviews:searchrequest-xml/12323168/SearchRequest-12323168.xml?tempMax=1000)
 which no longer works.



What is the value of that filter for the 4.4 feature list?


Re: VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Daan Hoogland
I guess you shouldn't use the site to site vpn but just a vpn. I am
not sure how to configure that but you should just create an active
(client side) vpn to the external network. I see no reason why it
should't work. the site to site assumes you have both sides in
cloudstack and thus with rfc1918 networks.

On Wed, May 21, 2014 at 6:10 PM, Erik Weber  wrote:
> Site to site vpn.
>
> I'm not in control of the 50.0.1 network, but the client is.
>
> Basically the use case is that they want to secure the traffic to their
> cloud vms, and are fortunate enough to not have to use rfc1918  on their
> network.
>
> I guess we could work around it by terminating the vpn on our equipment and
> access it as a private gateway instead, but I'd prefer to use the
> technology that we so braverly tell our clients about.
>
> Erik
> 21. mai 2014 17:05 skrev "Daan Hoogland"  følgende:
>
>> Are you creating a site to site vpn or connecting to an external network?
>>
>> On Wed, May 21, 2014 at 5:02 PM, Daan Hoogland 
>> wrote:
>> > Erik, If it doesn't work it is probably been blocked on purpose but I
>> > don't see why it is. I don't know your use case either and it seems an
>> > unlikely one. But if the 50.0.1 net is out of your control you maybe
>> > should be able to configure this. So I would say it is a bug/lack of
>> > feature. I'll look into the code for the place the error is generated.
>> >
>> > in short: file a ticket
>> >
>> > On Wed, May 21, 2014 at 2:34 PM, Erik Weber  wrote:
>> >> I understand that, but what my client wants is to connect public ips
>> >> instead of rfc1918 on one of the sides.
>> >>
>> >> e.g. one network has 10.0.1.0/24 and ip 1.2.3.4
>> >> the other has 50.0.1.0/24 and ip 50.0.0.1
>> >>
>> >> but cloudstack currently does not let you do that, because it expects
>> cidrs
>> >> to be rfc1918. see log excerpt:
>> >>
>> >> 2014-05-21 12:30:42,326 WARN  [c.c.u.n.NetUtils]
>> >> (API-Job-Executor-7:job-3072 ctx-bf3922b1) cidr 50.0.1.0/24 is not RFC
>> 1918
>> >> compliant
>> >> 2014-05-21 12:30:42,335 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> >> (API-Job-Executor-7:job-3072) Unexpected exception while executing
>> >> org.apache.cloudstack.api.command.user.vpn.CreateVpnCustomerGatewayCmd
>> >> com.cloud.exception.InvalidParameterValueException: The customer gateway
>> >> guest cidr list 50.0.1.0/24 is invalid guest cidr!
>> >> at
>> >>
>> com.cloud.network.vpn.Site2SiteVpnManagerImpl.createCustomerGateway(Site2SiteVpnManagerImpl.java:176)
>> >>
>> >> I'm wondering if this is a bug/lacking feature, or intended.
>> >> As I initially said I'm not a network guy, so there might be perfectly
>> good
>> >> reasons this shouldn't be allowed.
>> >>
>> >> But if it's a bug/lacking feature it would be great to know so that I
>> could
>> >> file a ticket for it.
>> >>
>> >> --
>> >> Erik Weber
>> >>
>> >>
>> >> On Wed, May 21, 2014 at 2:09 PM, Daan Hoogland > >wrote:
>> >>
>> >>> Erik,
>> >>>
>> >>> The vpn let's you connect to all the computers in the network on the
>> >>> other site on their private adresses. This means that you can give the
>> >>> cidr of the remote network in the definition on vpn connection.
>> >>>
>> >>> one network has 10.0.1.0/24 and ip 1.2.3.4
>> >>> the other has 10.0.2.0/24 and ip 4.3.2.1
>> >>>
>> >>> on the first you define endpoint/gateway 4.3.2.1 with cidr 10.0.1.0/24
>> >>> and you make it passive
>> >>> on the second you define the adresses of the first and stat is without
>> >>> the passive function
>> >>> now you can ping a machine with address 10.0.1.123 from a machine with
>> >>> ip 10.0.2.246
>> >>>
>> >>> Of course you can do this to an external network as well, which makes
>> >>> far more sense.
>> >>>
>> >>> On Wed, May 21, 2014 at 12:14 PM, Erik Weber 
>> wrote:
>> >>> >
>> >>>
>> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/vpn.html#site-to-site-vpnstates
>> >>> :
>> >>> >
>> >>> >
>> >>> >- *CIDR list*: The guest CIDR list of the remote subnets. Enter a
>> CIDR
>> >>> >or a comma-separated list of CIDRs. Ensure that a guest CIDR list
>> is
>> >>> not
>> >>> >overlapped with the VPC’s CIDR, or another guest CIDR. The CIDR
>> must
>> >>> be
>> >>> >RFC1918-compliant.
>> >>> >
>> >>> >
>> >>> > I'm not a network guy, so excuse the question if it's obvious, but
>> if a
>> >>> > customer only has public ip's on their end, why is rfc1918 required?
>> >>> >
>> >>> >
>> >>> > --
>> >>> > Erik Weber
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> Daan
>> >>>
>> >
>> >
>> >
>> > --
>> > Daan
>>
>>
>>
>> --
>> Daan
>>



-- 
Daan


Network IDS in VPC

2014-05-21 Thread Marcus
Hi guys,
   Not sure if this has been discussed before, but we are getting feature
requests for an IDS or packet-sniffing/monitoring capability. I have a
prototyped idea of how to do this (manual config), but would like some
input.

We create a network offering or network capability/detail that is
specifically a 'sniffer net'. This would be relatively simple, and just do
two things:

1) when network is added to VPC, spin up a simple daemon on the VPC router
that does traffic mirroring (netsniff-ng or daemonlogger are debian
packages) from the public interface to the 'sniffer net' interface.

2) disables mac learning on the bridges created for the sniffer net, so
that an IDS system can come up in this net and see all of the mirrored
traffic. It wouldn't handle making the IDS appliance, that would be up to
the customer, it would simply create a network that enables traffic
monitoring for the VPC.

I think we'd prefer any VMs brought up in this network to live on the same
host as the router for performance reasons, but that's probably not an
immediate requirement. I dislike the idea of trying to run an actual
capture saved to the VPC router, or an IDS software on the VPC router that
would need to be updated.

We could also run traffic mirroring from the VPC router's interface
directly to another VM's interface, host side (daemonlogger -i vpcintf -o
idsintf), but it would need to be on the same host.


Re: Updating ACS 4.4 features list on release page?

2014-05-21 Thread Daan Hoogland
you can find those (it's not just one that is broken) at
https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12323265

On Wed, May 21, 2014 at 11:34 PM, Demetrius Tsitrelis
 wrote:
> In the "Features" section of the CloudStack 4.4 Release (Draft) page 
> (https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=39623192) 
> is a filter for a previous version of features 
> (https://issues.apache.org/jira/sr/jira.issueviews:searchrequest-xml/12323168/SearchRequest-12323168.xml?tempMax=1000)
>  which no longer works.
>
>
>
> What is the value of that filter for the 4.4 feature list?



-- 
Daan


Re: VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Erik Weber
The documentation says something else, excerpt:
" The difference from Remote VPN is that Site-to-site VPNs connects entire
networks to each other, for example, connecting a branch office network to
a company headquarters network. In a site-to-site VPN, hosts do not have
VPN client software; they send and receive normal TCP/IP traffic through a
VPN gateway.".

Assuming that both sides is under cloudstack control is just odd and makes
no sense.

I'll file a ticket whenever I find the time, but still appreciate input :-)

Erik Weber
22. mai 2014 00:16 skrev "Daan Hoogland"  følgende:

> I guess you shouldn't use the site to site vpn but just a vpn. I am
> not sure how to configure that but you should just create an active
> (client side) vpn to the external network. I see no reason why it
> should't work. the site to site assumes you have both sides in
> cloudstack and thus with rfc1918 networks.
>
> On Wed, May 21, 2014 at 6:10 PM, Erik Weber  wrote:
> > Site to site vpn.
> >
> > I'm not in control of the 50.0.1 network, but the client is.
> >
> > Basically the use case is that they want to secure the traffic to their
> > cloud vms, and are fortunate enough to not have to use rfc1918  on their
> > network.
> >
> > I guess we could work around it by terminating the vpn on our equipment
> and
> > access it as a private gateway instead, but I'd prefer to use the
> > technology that we so braverly tell our clients about.
> >
> > Erik
> > 21. mai 2014 17:05 skrev "Daan Hoogland" 
> følgende:
> >
> >> Are you creating a site to site vpn or connecting to an external
> network?
> >>
> >> On Wed, May 21, 2014 at 5:02 PM, Daan Hoogland  >
> >> wrote:
> >> > Erik, If it doesn't work it is probably been blocked on purpose but I
> >> > don't see why it is. I don't know your use case either and it seems an
> >> > unlikely one. But if the 50.0.1 net is out of your control you maybe
> >> > should be able to configure this. So I would say it is a bug/lack of
> >> > feature. I'll look into the code for the place the error is generated.
> >> >
> >> > in short: file a ticket
> >> >
> >> > On Wed, May 21, 2014 at 2:34 PM, Erik Weber 
> wrote:
> >> >> I understand that, but what my client wants is to connect public ips
> >> >> instead of rfc1918 on one of the sides.
> >> >>
> >> >> e.g. one network has 10.0.1.0/24 and ip 1.2.3.4
> >> >> the other has 50.0.1.0/24 and ip 50.0.0.1
> >> >>
> >> >> but cloudstack currently does not let you do that, because it expects
> >> cidrs
> >> >> to be rfc1918. see log excerpt:
> >> >>
> >> >> 2014-05-21 12:30:42,326 WARN  [c.c.u.n.NetUtils]
> >> >> (API-Job-Executor-7:job-3072 ctx-bf3922b1) cidr 50.0.1.0/24 is not
> RFC
> >> 1918
> >> >> compliant
> >> >> 2014-05-21 12:30:42,335 ERROR [c.c.a.ApiAsyncJobDispatcher]
> >> >> (API-Job-Executor-7:job-3072) Unexpected exception while executing
> >> >>
> org.apache.cloudstack.api.command.user.vpn.CreateVpnCustomerGatewayCmd
> >> >> com.cloud.exception.InvalidParameterValueException: The customer
> gateway
> >> >> guest cidr list 50.0.1.0/24 is invalid guest cidr!
> >> >> at
> >> >>
> >>
> com.cloud.network.vpn.Site2SiteVpnManagerImpl.createCustomerGateway(Site2SiteVpnManagerImpl.java:176)
> >> >>
> >> >> I'm wondering if this is a bug/lacking feature, or intended.
> >> >> As I initially said I'm not a network guy, so there might be
> perfectly
> >> good
> >> >> reasons this shouldn't be allowed.
> >> >>
> >> >> But if it's a bug/lacking feature it would be great to know so that I
> >> could
> >> >> file a ticket for it.
> >> >>
> >> >> --
> >> >> Erik Weber
> >> >>
> >> >>
> >> >> On Wed, May 21, 2014 at 2:09 PM, Daan Hoogland <
> daan.hoogl...@gmail.com
> >> >wrote:
> >> >>
> >> >>> Erik,
> >> >>>
> >> >>> The vpn let's you connect to all the computers in the network on the
> >> >>> other site on their private adresses. This means that you can give
> the
> >> >>> cidr of the remote network in the definition on vpn connection.
> >> >>>
> >> >>> one network has 10.0.1.0/24 and ip 1.2.3.4
> >> >>> the other has 10.0.2.0/24 and ip 4.3.2.1
> >> >>>
> >> >>> on the first you define endpoint/gateway 4.3.2.1 with cidr
> 10.0.1.0/24
> >> >>> and you make it passive
> >> >>> on the second you define the adresses of the first and stat is
> without
> >> >>> the passive function
> >> >>> now you can ping a machine with address 10.0.1.123 from a machine
> with
> >> >>> ip 10.0.2.246
> >> >>>
> >> >>> Of course you can do this to an external network as well, which
> makes
> >> >>> far more sense.
> >> >>>
> >> >>> On Wed, May 21, 2014 at 12:14 PM, Erik Weber 
> >> wrote:
> >> >>> >
> >> >>>
> >>
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/vpn.html#site-to-site-vpnstates
> >> >>> :
> >> >>> >
> >> >>> >
> >> >>> >- *CIDR list*: The guest CIDR list of the remote subnets.
> Enter a
> >> CIDR
> >> >>> >or a comma-separated list of CIDRs. Ensure that a guest CIDR
> list
> >> is
> >> >>> not
> >> >>> >overlapped w

[ACS4.4] Cherry-pick e3bb8b98bd9055115004da2ec67b29271a3974c5

2014-05-21 Thread Kelven Yang
There is an typo on the bug id, it should be the fix for CLOUDSTACK-6743

commit e3bb8b98bd9055115004da2ec67b29271a3974c5
Author: Kelven Yang 
Date:   Wed May 21 16:14:14 2014 -0700

CLOUDSTACK-5485: Use edge-triggering in MessageDetector to handle
bogus wakeup gracefully. Level triggering plus bogus wakeup can cause a
tight loop to spin

Thanks
Kelven



[ACS4.4] Cherry-pick 356f6121a78d147d72136044c90472234f667730

2014-05-21 Thread Min Chen
Hi Daan,

Can you please cherry-pick this commit from 4.4-forward to 4.4?

Commit: 356f6121a78d147d72136044c90472234f667730
CLOUDSTACK-6742: listVolumes - As regularuser , able to list Vms and
volumes of other users.

Thanks
-min



Proxy Console (RealhostIP Retired) Question

2014-05-21 Thread Mo
Hello:

I am attempting to find more information (read: step by step) how to
correct the issue that came to be when realhostip was retired.

The links I saw suggested I setup the following for every IP address in my
DNS Zone:

192-168-1-1.cloud.domain.tldINA192.168.1.1

I have done that for ALL my IPs. Restarted my named/bind service. Not only
am I not obtaining an A record with this configuration, but I am also still
unable to proceed in getting console access as it states it's unable to
resolve the DNS.

All my other DNS resolves without issue, please note; 192.x is just an IP
address I tossed in this e-mail for general purposes, I am utilizing public
subnets.

I have also purchased an SSL certificate went through all of that too, if
someone could point me in the right direction or perhaps offer ideas
(alternates) that would be fantastic.

Thanks,
Mo


[GitHub] cloudstack-docs-rn pull request: rnotes.rst: fix release refences ...

2014-05-21 Thread pdion891
Github user pdion891 closed the pull request at:

https://github.com/apache/cloudstack-docs-rn/pull/8


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack-docs-rn pull request: rnotes.rst: fix release refences ...

2014-05-21 Thread pdion891
Github user pdion891 commented on the pull request:

https://github.com/apache/cloudstack-docs-rn/pull/8#issuecomment-43839704
  
oudated pull request.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[ACS4.4] Cherry-pick request : b4457d92f4ceec83f09b4514a0164c7ec3775e4d

2014-05-21 Thread Yoshikazu Nojima
Daan,
Could you cherry-pick the commit b4457d92f4ceec83f09b4514a0164c7ec3775e4d ?
It fix the bug that makes systemvm template build failed since newer
vboxmanage generates $appliance-$branch-vmware-disk3.vmdk.

Regards,
Noji


RE: VPC Site to Site VPN CIDR RFC1918

2014-05-21 Thread Sanjeev Neelarapu
In site-to-site vpn both sides need not to be under cloudstack control. Only 
one site can be under cs control. 

-Original Message-
From: Erik Weber [mailto:terbol...@gmail.com] 
Sent: Thursday, May 22, 2014 4:23 AM
To: dev
Subject: Re: VPC Site to Site VPN CIDR RFC1918

The documentation says something else, excerpt:
" The difference from Remote VPN is that Site-to-site VPNs connects entire 
networks to each other, for example, connecting a branch office network to a 
company headquarters network. In a site-to-site VPN, hosts do not have VPN 
client software; they send and receive normal TCP/IP traffic through a VPN 
gateway.".

Assuming that both sides is under cloudstack control is just odd and makes no 
sense.

I'll file a ticket whenever I find the time, but still appreciate input :-)

Erik Weber
22. mai 2014 00:16 skrev "Daan Hoogland"  følgende:

> I guess you shouldn't use the site to site vpn but just a vpn. I am 
> not sure how to configure that but you should just create an active 
> (client side) vpn to the external network. I see no reason why it 
> should't work. the site to site assumes you have both sides in 
> cloudstack and thus with rfc1918 networks.
>
> On Wed, May 21, 2014 at 6:10 PM, Erik Weber  wrote:
> > Site to site vpn.
> >
> > I'm not in control of the 50.0.1 network, but the client is.
> >
> > Basically the use case is that they want to secure the traffic to 
> > their cloud vms, and are fortunate enough to not have to use rfc1918  
> > on their network.
> >
> > I guess we could work around it by terminating the vpn on our 
> > equipment
> and
> > access it as a private gateway instead, but I'd prefer to use the 
> > technology that we so braverly tell our clients about.
> >
> > Erik
> > 21. mai 2014 17:05 skrev "Daan Hoogland" 
> følgende:
> >
> >> Are you creating a site to site vpn or connecting to an external
> network?
> >>
> >> On Wed, May 21, 2014 at 5:02 PM, Daan Hoogland 
> >>  >
> >> wrote:
> >> > Erik, If it doesn't work it is probably been blocked on purpose 
> >> > but I don't see why it is. I don't know your use case either and 
> >> > it seems an unlikely one. But if the 50.0.1 net is out of your 
> >> > control you maybe should be able to configure this. So I would 
> >> > say it is a bug/lack of feature. I'll look into the code for the place 
> >> > the error is generated.
> >> >
> >> > in short: file a ticket
> >> >
> >> > On Wed, May 21, 2014 at 2:34 PM, Erik Weber 
> wrote:
> >> >> I understand that, but what my client wants is to connect public 
> >> >> ips instead of rfc1918 on one of the sides.
> >> >>
> >> >> e.g. one network has 10.0.1.0/24 and ip 1.2.3.4 the other has 
> >> >> 50.0.1.0/24 and ip 50.0.0.1
> >> >>
> >> >> but cloudstack currently does not let you do that, because it 
> >> >> expects
> >> cidrs
> >> >> to be rfc1918. see log excerpt:
> >> >>
> >> >> 2014-05-21 12:30:42,326 WARN  [c.c.u.n.NetUtils]
> >> >> (API-Job-Executor-7:job-3072 ctx-bf3922b1) cidr 50.0.1.0/24 is 
> >> >> not
> RFC
> >> 1918
> >> >> compliant
> >> >> 2014-05-21 12:30:42,335 ERROR [c.c.a.ApiAsyncJobDispatcher]
> >> >> (API-Job-Executor-7:job-3072) Unexpected exception while 
> >> >> executing
> >> >>
> org.apache.cloudstack.api.command.user.vpn.CreateVpnCustomerGatewayCmd
> >> >> com.cloud.exception.InvalidParameterValueException: The customer
> gateway
> >> >> guest cidr list 50.0.1.0/24 is invalid guest cidr!
> >> >> at
> >> >>
> >>
> com.cloud.network.vpn.Site2SiteVpnManagerImpl.createCustomerGateway(Si
> te2SiteVpnManagerImpl.java:176)
> >> >>
> >> >> I'm wondering if this is a bug/lacking feature, or intended.
> >> >> As I initially said I'm not a network guy, so there might be
> perfectly
> >> good
> >> >> reasons this shouldn't be allowed.
> >> >>
> >> >> But if it's a bug/lacking feature it would be great to know so 
> >> >> that I
> >> could
> >> >> file a ticket for it.
> >> >>
> >> >> --
> >> >> Erik Weber
> >> >>
> >> >>
> >> >> On Wed, May 21, 2014 at 2:09 PM, Daan Hoogland <
> daan.hoogl...@gmail.com
> >> >wrote:
> >> >>
> >> >>> Erik,
> >> >>>
> >> >>> The vpn let's you connect to all the computers in the network 
> >> >>> on the other site on their private adresses. This means that 
> >> >>> you can give
> the
> >> >>> cidr of the remote network in the definition on vpn connection.
> >> >>>
> >> >>> one network has 10.0.1.0/24 and ip 1.2.3.4 the other has 
> >> >>> 10.0.2.0/24 and ip 4.3.2.1
> >> >>>
> >> >>> on the first you define endpoint/gateway 4.3.2.1 with cidr
> 10.0.1.0/24
> >> >>> and you make it passive
> >> >>> on the second you define the adresses of the first and stat is
> without
> >> >>> the passive function
> >> >>> now you can ping a machine with address 10.0.1.123 from a 
> >> >>> machine
> with
> >> >>> ip 10.0.2.246
> >> >>>
> >> >>> Of course you can do this to an external network as well, which
> makes
> >> >>> far more sense.
> >> >>>
> >> >>> On Wed, May 21, 2014 at 12:14 PM, Erik Weber 
> >> >>> 
> >> wrote:
> >> >>> >
>

Re: Network IDS in VPC

2014-05-21 Thread Marcus
I really like the lower overhead of just port mirroring from one of the
router's interfaces to an instance interface host-side, but I really
dislike the affinity it creates between the router and the listener, and
all of the complications it creates for host maintenance and migrations. It
may also require that whomever creates a network or vms on a network with
this permission be a domain admin, since it has the ability to see
everything on the wire for the whole VPC.


On Wed, May 21, 2014 at 4:25 PM, Marcus  wrote:

> Hi guys,
>Not sure if this has been discussed before, but we are getting feature
> requests for an IDS or packet-sniffing/monitoring capability. I have a
> prototyped idea of how to do this (manual config), but would like some
> input.
>
> We create a network offering or network capability/detail that is
> specifically a 'sniffer net'. This would be relatively simple, and just do
> two things:
>
> 1) when network is added to VPC, spin up a simple daemon on the VPC router
> that does traffic mirroring (netsniff-ng or daemonlogger are debian
> packages) from the public interface to the 'sniffer net' interface.
>
> 2) disables mac learning on the bridges created for the sniffer net, so
> that an IDS system can come up in this net and see all of the mirrored
> traffic. It wouldn't handle making the IDS appliance, that would be up to
> the customer, it would simply create a network that enables traffic
> monitoring for the VPC.
>
> I think we'd prefer any VMs brought up in this network to live on the same
> host as the router for performance reasons, but that's probably not an
> immediate requirement. I dislike the idea of trying to run an actual
> capture saved to the VPC router, or an IDS software on the VPC router that
> would need to be updated.
>
> We could also run traffic mirroring from the VPC router's interface
> directly to another VM's interface, host side (daemonlogger -i vpcintf -o
> idsintf), but it would need to be on the same host.
>
>
>
>


RE: git commit: updated refs/heads/4.4-forward to b4457d9

2014-05-21 Thread Sateesh Chodapuneedi
Hi Yoshi,

Can you please let me know the JIRA bug ID addressed by this commit?

Regards,
Sateesh

> -Original Message-
> From: ynoj...@apache.org [mailto:ynoj...@apache.org]
> Sent: 22 May 2014 07:25
> To: comm...@cloudstack.apache.org
> Subject: git commit: updated refs/heads/4.4-forward to b4457d9
> 
> Repository: cloudstack
> Updated Branches:
>   refs/heads/4.4-forward 65bb733a4 -> b4457d92f
> 
> 
> bugfix: systemvm template build failed
> 
> since newer vboxmanage generates $appliance-$branch-vmware-disk3.vmdk
> 
> 
> Project: http://git-wip-us.apache.org/repos/asf/cloudstack/repo
> Commit: http://git-wip-us.apache.org/repos/asf/cloudstack/commit/b4457d92
> Tree: http://git-wip-us.apache.org/repos/asf/cloudstack/tree/b4457d92
> Diff: http://git-wip-us.apache.org/repos/asf/cloudstack/diff/b4457d92
> 
> Branch: refs/heads/4.4-forward
> Commit: b4457d92f4ceec83f09b4514a0164c7ec3775e4d
> Parents: 65bb733
> Author: ynojima 
> Authored: Wed May 21 18:23:29 2014 -0600
> Committer: ynojima 
> Committed: Wed May 21 19:54:34 2014 -0600
> 
> --
>  tools/appliance/build.sh | 4 ++--
>  1 file changed, 2 insertions(+), 2 deletions(-)
> --
> 
> 
> http://git-wip-us.apache.org/repos/asf/cloudstack/blob/b4457d92/tools/appliance/build.sh
> --
> diff --git a/tools/appliance/build.sh b/tools/appliance/build.sh index 
> 6d2bd8f..a228e26 100644
> --- a/tools/appliance/build.sh
> +++ b/tools/appliance/build.sh
> @@ -105,8 +105,8 @@ echo "$appliance exported for VMWare: 
> dist/$appliance-$branch-vmware.vmdk.bz2"
>  vboxmanage export $machine_uuid --output $appliance-$branch-vmware.ovf  mv 
> $appliance-$branch-vmware.ovf $appliance-$branch-
> vmware.ovf-orig
>  java -cp convert Convert convert_ovf_vbox_to_esx.xslt 
> $appliance-$branch-vmware.ovf-orig $appliance-$branch-vmware.ovf -tar -cf
> $appliance-$branch-vmware.ova $appliance-$branch-vmware.ovf 
> $appliance-$branch-vmware-disk1.vmdk
> -rm -f $appliance-$branch-vmware.ovf $appliance-$branch-vmware.ovf-orig 
> $appliance-$branch-vmware-disk1.vmdk
> +tar -cf $appliance-$branch-vmware.ova $appliance-$branch-vmware.ovf
> +$appliance-$branch-vmware-disk[0-9].vmdk
> +rm -f $appliance-$branch-vmware.ovf $appliance-$branch-vmware.ovf-orig
> +$appliance-$branch-vmware-disk[0-9].vmdk
>  echo "$appliance exported for VMWare: dist/$appliance-$branch-vmware.ova"
> 
>  # Export for HyperV



Re: Review Request 21629: CLOUDSTACK-4757. Support OVA files containing multiple disks.

2014-05-21 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21629/#review43704
---


Commit ebc92d6cd758d031f9d05ab7b277d5541149f771 in cloudstack's branch 
refs/heads/multiple-disk-ova from Likitha Shetty
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=ebc92d6 ]

CLOUDSTACK-4757. Update API params


- ASF Subversion and Git Services


On May 21, 2014, 4:10 p.m., Likitha Shetty wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21629/
> ---
> 
> (Updated May 21, 2014, 4:10 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Bugs: CLOUDSTACK-4757
> https://issues.apache.org/jira/browse/CLOUDSTACK-4757
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> This patch is for 4.5 feature 'Support OVA files containing multiple disks'.
> Functional spec for the feature is available at - 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Support+OVA+files+containing+multiple+disks
>  
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/agent/api/to/DatadiskTO.java PRE-CREATION 
>   api/src/com/cloud/storage/Storage.java cc8d010 
>   api/src/com/cloud/template/VirtualMachineTemplate.java 599212b 
>   api/src/com/cloud/vm/DiskProfile.java a37f7aa 
>   api/src/com/cloud/vm/UserVmService.java af4e1d3 
>   api/src/org/apache/cloudstack/api/ApiConstants.java a3faca7 
>   api/src/org/apache/cloudstack/api/ResponseGenerator.java 10fb6df 
>   
> api/src/org/apache/cloudstack/api/command/user/template/ListTemplatesCmd.java 
> 7a2a158 
>   api/src/org/apache/cloudstack/api/command/user/vm/DeployVMCmd.java 0adc57b 
>   api/src/org/apache/cloudstack/api/response/TemplateResponse.java 3e21043 
>   core/src/com/cloud/agent/api/storage/CreateDatadiskTemplateAnswer.java 
> PRE-CREATION 
>   core/src/com/cloud/agent/api/storage/CreateDatadiskTemplateCommand.java 
> PRE-CREATION 
>   core/src/com/cloud/agent/api/storage/GetDatadisksAnswer.java PRE-CREATION 
>   core/src/com/cloud/agent/api/storage/GetDatadisksCommand.java PRE-CREATION 
>   core/src/com/cloud/storage/template/OVAProcessor.java 0db3bb0 
>   core/src/org/apache/cloudstack/storage/to/TemplateObjectTO.java b201c38 
>   engine/api/src/com/cloud/vm/VirtualMachineManager.java f070210 
>   
> engine/api/src/org/apache/cloudstack/engine/orchestration/service/VolumeOrchestrationService.java
>  df0b5e8 
>   
> engine/api/src/org/apache/cloudstack/engine/service/api/OrchestrationService.java
>  93f969f 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/EndPointSelector.java
>  4657316 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/TemplateService.java
>  88ce932 
>   
> engine/api/src/org/apache/cloudstack/storage/image/datastore/ImageStoreEntity.java
>  43a0f75 
>   engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java 
> e15d287 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/orchestration/CloudOrchestrator.java
>  2b49954 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/orchestration/VolumeOrchestrator.java
>  6256e25 
>   engine/schema/src/com/cloud/storage/VMTemplateVO.java 9a77cbf 
>   engine/schema/src/com/cloud/storage/dao/VMTemplateDao.java 2b815d8 
>   engine/schema/src/com/cloud/storage/dao/VMTemplateDaoImpl.java 401a4a2 
>   
> engine/storage/image/src/org/apache/cloudstack/storage/image/TemplateServiceImpl.java
>  4e6ab6b 
>   
> engine/storage/image/src/org/apache/cloudstack/storage/image/store/ImageStoreImpl.java
>  8da7eb7 
>   
> engine/storage/image/src/org/apache/cloudstack/storage/image/store/TemplateObject.java
>  7288d45 
>   
> engine/storage/src/org/apache/cloudstack/storage/endpoint/DefaultEndPointSelector.java
>  304f959 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/BaseImageStoreDriverImpl.java
>  7ed11ec 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/ImageStoreDriver.java 
> fa7ea37 
>   
> engine/storage/src/org/apache/cloudstack/storage/image/TemplateEntityImpl.java
>  c1aa8c2 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManager.java
>  f78f370 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManagerImpl.java
>  c1b907e 
>   
> plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/resource/VmwareResource.java
>  0024b44 
>   
> plugins/hypervisors/vmware/src/com/cloud/storage/resource/VmwareSecondaryStorageResourceHandler.java
>  f633774 
>   
> plugins/hypervisors/vmware/src/com/cloud/storage/resource/VmwareStorageProcessor.java
>  ff893b2 
>   plugins/hypervisors/xen/src/com/cloud/hypervisor/XenServerGuru.java 89e4ab5 
>   server/src/com/cloud/api/ApiResponseHelper.java 250f5a9 
>   server/src/

Re: git commit: updated refs/heads/4.4-forward to b4457d9

2014-05-21 Thread Yoshikazu Nojima
Sateesh,
Sorry for skipping ticket creation.
Here it is:
https://issues.apache.org/jira/browse/CLOUDSTACK-6746

Regards,
Noji

2014-05-21 22:44 GMT-06:00 Sateesh Chodapuneedi
:
> Hi Yoshi,
>
> Can you please let me know the JIRA bug ID addressed by this commit?
>
> Regards,
> Sateesh
>
>> -Original Message-
>> From: ynoj...@apache.org [mailto:ynoj...@apache.org]
>> Sent: 22 May 2014 07:25
>> To: comm...@cloudstack.apache.org
>> Subject: git commit: updated refs/heads/4.4-forward to b4457d9
>>
>> Repository: cloudstack
>> Updated Branches:
>>   refs/heads/4.4-forward 65bb733a4 -> b4457d92f
>>
>>
>> bugfix: systemvm template build failed
>>
>> since newer vboxmanage generates $appliance-$branch-vmware-disk3.vmdk
>>
>>
>> Project: http://git-wip-us.apache.org/repos/asf/cloudstack/repo
>> Commit: http://git-wip-us.apache.org/repos/asf/cloudstack/commit/b4457d92
>> Tree: http://git-wip-us.apache.org/repos/asf/cloudstack/tree/b4457d92
>> Diff: http://git-wip-us.apache.org/repos/asf/cloudstack/diff/b4457d92
>>
>> Branch: refs/heads/4.4-forward
>> Commit: b4457d92f4ceec83f09b4514a0164c7ec3775e4d
>> Parents: 65bb733
>> Author: ynojima 
>> Authored: Wed May 21 18:23:29 2014 -0600
>> Committer: ynojima 
>> Committed: Wed May 21 19:54:34 2014 -0600
>>
>> --
>>  tools/appliance/build.sh | 4 ++--
>>  1 file changed, 2 insertions(+), 2 deletions(-)
>> --
>>
>>
>> http://git-wip-us.apache.org/repos/asf/cloudstack/blob/b4457d92/tools/appliance/build.sh
>> --
>> diff --git a/tools/appliance/build.sh b/tools/appliance/build.sh index 
>> 6d2bd8f..a228e26 100644
>> --- a/tools/appliance/build.sh
>> +++ b/tools/appliance/build.sh
>> @@ -105,8 +105,8 @@ echo "$appliance exported for VMWare: 
>> dist/$appliance-$branch-vmware.vmdk.bz2"
>>  vboxmanage export $machine_uuid --output $appliance-$branch-vmware.ovf  mv 
>> $appliance-$branch-vmware.ovf $appliance-$branch-
>> vmware.ovf-orig
>>  java -cp convert Convert convert_ovf_vbox_to_esx.xslt 
>> $appliance-$branch-vmware.ovf-orig $appliance-$branch-vmware.ovf -tar -cf
>> $appliance-$branch-vmware.ova $appliance-$branch-vmware.ovf 
>> $appliance-$branch-vmware-disk1.vmdk
>> -rm -f $appliance-$branch-vmware.ovf $appliance-$branch-vmware.ovf-orig 
>> $appliance-$branch-vmware-disk1.vmdk
>> +tar -cf $appliance-$branch-vmware.ova $appliance-$branch-vmware.ovf
>> +$appliance-$branch-vmware-disk[0-9].vmdk
>> +rm -f $appliance-$branch-vmware.ovf $appliance-$branch-vmware.ovf-orig
>> +$appliance-$branch-vmware-disk[0-9].vmdk
>>  echo "$appliance exported for VMWare: dist/$appliance-$branch-vmware.ova"
>>
>>  # Export for HyperV
>