date:20140416


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20411/
---

Review request for cloudstack and SrikanteswaraRao Talluri.


Repository: cloudstack-git


Description
---

Added few changes for CLOUDSTACK-6316

1. Added pep8 changes, delete dc flag.
2. Now, delete dc works only if flag is set under config.
3. SSH, retries and delay were altered to reduce the time
for ssh connection


Diffs
-

  tools/marvin/marvin/cloudstackConnection.py e3c5590 
  tools/marvin/marvin/cloudstackTestClient.py 1e13506 
  tools/marvin/marvin/codes.py 4096a44 
  tools/marvin/marvin/config/test_data.py 67acc77 
  tools/marvin/marvin/deployDataCenter.py 8e39e73 
  tools/marvin/marvin/marvinLog.py 9b4dd19 
  tools/marvin/marvin/marvinPlugin.py e631985 
  tools/marvin/marvin/sshClient.py fb4e18b 
  tools/marvin/setup.py 9160642 

Diff: https://reviews.apache.org/r/20411/diff/


Testing
---


Thanks,

Santhosh Edukulla

Re: Review Request 18964: Windowsfication of CloudStack Management Server - Changes to support windows OS

2014-04-16 Thread Damodar Reddy Talakanti

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18964/
---

(Updated April 16, 2014, 9:52 a.m.)

Review request for cloudstack, Abhinandan Prateek, Chiradeep Vittal, daan
Hoogland, and Donal Lafferty.

Changes
---

License headers were missing added the same.

Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-6105

https://issues.apache.org/jira/browse/https://issues.apache.org/jira/browse/CLOUDSTACK-6105

Repository: cloudstack-git

Description
---

Windowsfication of CloudStack Management Server

Diffs (updated)
-

Wix-cloudstack-maven-plugin/pom.xml e5b9bd1
Wix-cloudstack-maven-plugin/src/org/apache/cloudstack/wix/HeatMojo.java
4724d76

Diff: https://reviews.apache.org/r/18964/diff/

Testing
---

Tested in Linux environment after changes
Also tested in Windows environment(For now tested on windows-8) to make sure it
is getting installed and management service is running.

Able to add zones, able to register templates, able to launch a VM when it is
running on windows.

Currently though it is getting added as a windows service, not able to start
the service through windows service control manager which I am looking into
currently. When run .exe file which is installed then server is getting up and
able to access cloud stack UI.

For now The following assumptions are made:
1. SSH keys are already installed
2. JAVA is already installed
3. tomcat is already installed

This patch contains the following new files related to WiX tool (To compile and
run we need this tool)
1. acs.wxs
The following command will be used to compile
"\bin\candle.exe" acs.wxs
2. client.wxs
The following command will be used to generate the above file
"\bin\heat" dir client -gg -cg Test -ke -sfrag
-template fragment -out client.wxs -var wix.SourceClient -dr WEBAPPS
The following command will be used to compile the above generated file
"\bin\candle.exe" client.wxs
3. The following command will be used to generate .msi file
"\bin\light.exe" acs.wixobj client.wixobj -out acs.msi
-ext "C:\Program Files (x86)\WiX Toolset v3.8\bin\WixUIExtension.dll"
-dSourceClient=SourceDir\client

Thanks,

Damodar Reddy Talakanti

Re: Review Request 20366: Integrating Windows wix tool to maven

2014-04-16 Thread Damodar Reddy Talakanti


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20366/
---

(Updated April 16, 2014, 9:57 a.m.)


Review request for cloudstack, Abhinandan Prateek and daan Hoogland.


Changes
---

Added missing license header files


Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-6410

https://issues.apache.org/jira/browse/https://issues.apache.org/jira/browse/CLOUDSTACK-6410


Repository: cloudstack-git


Description
---

Integrated Wix tool set with maven build process so that no manual steps are 
required to create windows msi installer file.


Diffs (updated)
-

  Wix-cloudstack-maven-plugin/pom.xml e5b9bd1 
  Wix-cloudstack-maven-plugin/src/org/apache/cloudstack/wix/HeatMojo.java 
4724d76 

Diff: https://reviews.apache.org/r/20366/diff/


Testing
---

Build process has been Tested on Windows server.
Regular profile Builds are tested 
Tested new profile "buildw" and verified msi file is getting created in target.


Thanks,

Damodar Reddy Talakanti

Re: Review Request 20366: Integrating Windows wix tool to maven

2014-04-16 Thread Damodar Reddy Talakanti



> On April 15, 2014, 11:39 a.m., daan Hoogland wrote:
> > please test on other platforms to make sure it doesn't break non-windows 
> > builds

Sure Daan will do that


- Damodar Reddy


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20366/#review40380
---


On April 16, 2014, 9:57 a.m., Damodar Reddy Talakanti wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20366/
> ---
> 
> (Updated April 16, 2014, 9:57 a.m.)
> 
> 
> Review request for cloudstack, Abhinandan Prateek and daan Hoogland.
> 
> 
> Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-6410
> 
> https://issues.apache.org/jira/browse/https://issues.apache.org/jira/browse/CLOUDSTACK-6410
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Integrated Wix tool set with maven build process so that no manual steps are 
> required to create windows msi installer file.
> 
> 
> Diffs
> -
> 
>   Wix-cloudstack-maven-plugin/pom.xml e5b9bd1 
>   Wix-cloudstack-maven-plugin/src/org/apache/cloudstack/wix/HeatMojo.java 
> 4724d76 
> 
> Diff: https://reviews.apache.org/r/20366/diff/
> 
> 
> Testing
> ---
> 
> Build process has been Tested on Windows server.
> Regular profile Builds are tested 
> Tested new profile "buildw" and verified msi file is getting created in 
> target.
> 
> 
> Thanks,
> 
> Damodar Reddy Talakanti
> 
>

Snapshot size

2014-04-16 Thread Gaurav Aradhye

Hello all,

Snapshot size is not listed in any API and it does not count in the
secondary storage count. It is only tracked in "snapshottotal" of the
account/domain/project.

Can somebody please address following questions?
1) Why snapshot size is not listed?
2) As a consequence, why isn't it counted in secondary storage count?
3) Is it possible that secondary storage gets full due to snapshots of huge
volumes even when snapshot limit (number of snapshots allowed) is not
exceeded?

Regards,
Gaurav

RE: Snapshot size

2014-04-16 Thread Alex Hitchins

Hello,

I think your point is raised here (or certainly similar): 

https://issues.apache.org/jira/browse/CLOUDSTACK-5035

This is my next item to look at.



Alex Hitchins | 07788 423 969 | 01892 523 587
-

-Original Message-
From: Gaurav Aradhye [mailto:gaurav.arad...@clogeny.com] 
Sent: 16 April 2014 11:01
To: dev@cloudstack.apache.org
Subject: Snapshot size

Hello all,

Snapshot size is not listed in any API and it does not count in the secondary 
storage count. It is only tracked in "snapshottotal" of the 
account/domain/project.

Can somebody please address following questions?
1) Why snapshot size is not listed?
2) As a consequence, why isn't it counted in secondary storage count?
3) Is it possible that secondary storage gets full due to snapshots of huge 
volumes even when snapshot limit (number of snapshots allowed) is not exceeded?

Regards,
Gaurav

Re: Review Request 18768: CLOUDSTACK-6151: Local data disk with tag goes to the wrong local storage pool

2014-04-16 Thread Saksham Srivastava


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18768/
---

(Updated April 16, 2014, 10:14 a.m.)


Review request for cloudstack and Koushik Das.


Bugs: CLOUDSTACK-6151
https://issues.apache.org/jira/browse/CLOUDSTACK-6151


Repository: cloudstack-git


Description (updated)
---

Updating the patch for 4.4 and master because of merge conflicts.


Diffs
-

  
engine/schema/resources/META-INF/cloudstack/core/spring-engine-schema-core-daos-context.xml
 489b37d 
  
engine/schema/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDao.java
 2c4369d 
  
engine/schema/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDaoImpl.java
 57afa16 
  
engine/storage/src/org/apache/cloudstack/storage/allocator/LocalStoragePoolAllocator.java
 678b2a3 
  server/test/resources/createNetworkOffering.xml 6ae1978 

Diff: https://reviews.apache.org/r/18768/diff/


Testing
---

Tested the folowing scenarios:
attaching local volume with tags
attaching local volume without tags
attaching local volume with different tags
attaching shared volume

Build passes successfully.
Patch applies cleanly.


Thanks,

Saksham Srivastava

Re: Review Request 20411: Added few fixes for CLOUDSTACK-6316

2014-04-16 Thread SrikanteswaraRao Talluri


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20411/#review40527
---

Ship it!


Ship It!

- SrikanteswaraRao Talluri


On April 16, 2014, 9:50 a.m., Santhosh Edukulla wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20411/
> ---
> 
> (Updated April 16, 2014, 9:50 a.m.)
> 
> 
> Review request for cloudstack and SrikanteswaraRao Talluri.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added few changes for CLOUDSTACK-6316
> 
> 1. Added pep8 changes, delete dc flag.
> 2. Now, delete dc works only if flag is set under config.
> 3. SSH, retries and delay were altered to reduce the time
> for ssh connection
> 
> 
> Diffs
> -
> 
>   tools/marvin/marvin/cloudstackConnection.py e3c5590 
>   tools/marvin/marvin/cloudstackTestClient.py 1e13506 
>   tools/marvin/marvin/codes.py 4096a44 
>   tools/marvin/marvin/config/test_data.py 67acc77 
>   tools/marvin/marvin/deployDataCenter.py 8e39e73 
>   tools/marvin/marvin/marvinLog.py 9b4dd19 
>   tools/marvin/marvin/marvinPlugin.py e631985 
>   tools/marvin/marvin/sshClient.py fb4e18b 
>   tools/marvin/setup.py 9160642 
> 
> Diff: https://reviews.apache.org/r/20411/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Santhosh Edukulla
> 
>

Re: Review Request 20280: CLOUDSTACK-6393: Add gpu details in Compute Offering detail view

2014-04-16 Thread Sanjay Tripathi


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20280/#review40528
---

Ship it!


Ship It!

- Sanjay Tripathi


On April 12, 2014, 10:22 a.m., Mihaela Stoica wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20280/
> ---
> 
> (Updated April 12, 2014, 10:22 a.m.)
> 
> 
> Review request for cloudstack, Brian Federle and Jessica Wang.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added gpu details in Compute Offering detail view
> 
> 
> Diffs
> -
> 
>   ui/scripts/configuration.js ba6bdce 
> 
> Diff: https://reviews.apache.org/r/20280/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Mihaela Stoica
> 
>

Re: Review Request 20411: Added few fixes for CLOUDSTACK-6316


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20411/#review40529
---


Commit 901d633ca426ee5542e9b021135cd8fb2288a25c in cloudstack's branch 
refs/heads/marvin from Santhosh Edukulla
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=901d633 ]

Added few changes for CLOUDSTACK-6316

1. Added pep8 changes, delete dc flag.
2. Now, delete dc works only if flag is set under config.
3. SSH, retries and delay were altered to reduce the time
for ssh connection

Signed-off-by: Santhosh Edukulla 
Signed-off-by: SrikanteswaraRao Talluri 


- ASF Subversion and Git Services


On April 16, 2014, 9:50 a.m., Santhosh Edukulla wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20411/
> ---
> 
> (Updated April 16, 2014, 9:50 a.m.)
> 
> 
> Review request for cloudstack and SrikanteswaraRao Talluri.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added few changes for CLOUDSTACK-6316
> 
> 1. Added pep8 changes, delete dc flag.
> 2. Now, delete dc works only if flag is set under config.
> 3. SSH, retries and delay were altered to reduce the time
> for ssh connection
> 
> 
> Diffs
> -
> 
>   tools/marvin/marvin/cloudstackConnection.py e3c5590 
>   tools/marvin/marvin/cloudstackTestClient.py 1e13506 
>   tools/marvin/marvin/codes.py 4096a44 
>   tools/marvin/marvin/config/test_data.py 67acc77 
>   tools/marvin/marvin/deployDataCenter.py 8e39e73 
>   tools/marvin/marvin/marvinLog.py 9b4dd19 
>   tools/marvin/marvin/marvinPlugin.py e631985 
>   tools/marvin/marvin/sshClient.py fb4e18b 
>   tools/marvin/setup.py 9160642 
> 
> Diff: https://reviews.apache.org/r/20411/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Santhosh Edukulla
> 
>

Re: Review Request 20281: CLOUDSTACK-6394: Add gpu details in "Add Compute Offering”

2014-04-16 Thread Sanjay Tripathi


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20281/#review40530
---

Ship it!


Ship It!

- Sanjay Tripathi


On April 12, 2014, 10:26 a.m., Mihaela Stoica wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20281/
> ---
> 
> (Updated April 12, 2014, 10:26 a.m.)
> 
> 
> Review request for cloudstack, Brian Federle and Jessica Wang.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added gpu details in "Add Compute Offering”
> 
> 
> Diffs
> -
> 
>   ui/scripts/configuration.js ba6bdce 
> 
> Diff: https://reviews.apache.org/r/20281/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Mihaela Stoica
> 
>

Re: Review Request 20261: CLOUDSTACK-6233: Add new tab "GPU" in Host detailView for gpu enabled hosts

2014-04-16 Thread Sanjay Tripathi


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20261/#review40531
---

Ship it!


Ship It!

- Sanjay Tripathi


On April 11, 2014, 3:49 p.m., Mihaela Stoica wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20261/
> ---
> 
> (Updated April 11, 2014, 3:49 p.m.)
> 
> 
> Review request for cloudstack, Brian Federle and Jessica Wang.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added new "GPU" tab in Host detail page for gpu enabled hosts
> 
> 
> Diffs
> -
> 
>   client/WEB-INF/classes/resources/messages.properties 8abe874 
>   ui/css/cloudstack3.css 6602c16 
>   ui/dictionary.jsp ebe71b6 
>   ui/scripts/system.js ce62936 
> 
> Diff: https://reviews.apache.org/r/20261/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Mihaela Stoica
> 
>

Re: Review Request 20280: CLOUDSTACK-6393: Add gpu details in Compute Offering detail view


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20280/#review40532
---


Commit a0e6eff6e8ce94d4fae83a6f49deed77838b7a9b in cloudstack's branch 
refs/heads/4.4 from Mihaela Stoica
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=a0e6eff ]

CLOUDSTACK-6393: Add gpu details in Compute Offering detail view

Signed-off-by: Mihaela Stoica 
Signed-off-by: Sanjay Tripathi 


- ASF Subversion and Git Services


On April 12, 2014, 10:22 a.m., Mihaela Stoica wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20280/
> ---
> 
> (Updated April 12, 2014, 10:22 a.m.)
> 
> 
> Review request for cloudstack, Brian Federle and Jessica Wang.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added gpu details in Compute Offering detail view
> 
> 
> Diffs
> -
> 
>   ui/scripts/configuration.js ba6bdce 
> 
> Diff: https://reviews.apache.org/r/20280/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Mihaela Stoica
> 
>

Re: Review Request 20261: CLOUDSTACK-6233: Add new tab "GPU" in Host detailView for gpu enabled hosts


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20261/#review40533
---


Commit eee8a04dabe5eb19fd7fc6be4b33b39ed27ffde6 in cloudstack's branch 
refs/heads/4.4 from Mihaela Stoica
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=eee8a04 ]

CLOUDSTACK-6233: Add new tab "GPU" in Host detailView for gpu enabled hosts

Signed-off-by: Mihaela Stoica 
Signed-off-by: Sanjay Tripathi 


- ASF Subversion and Git Services


On April 11, 2014, 3:49 p.m., Mihaela Stoica wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20261/
> ---
> 
> (Updated April 11, 2014, 3:49 p.m.)
> 
> 
> Review request for cloudstack, Brian Federle and Jessica Wang.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added new "GPU" tab in Host detail page for gpu enabled hosts
> 
> 
> Diffs
> -
> 
>   client/WEB-INF/classes/resources/messages.properties 8abe874 
>   ui/css/cloudstack3.css 6602c16 
>   ui/dictionary.jsp ebe71b6 
>   ui/scripts/system.js ce62936 
> 
> Diff: https://reviews.apache.org/r/20261/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Mihaela Stoica
> 
>

Re: Review Request 20280: CLOUDSTACK-6393: Add gpu details in Compute Offering detail view


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20280/#review40535
---


Commit 3fbac14aa99c40bf7fad584c373b46720881628d in cloudstack's branch 
refs/heads/master from Mihaela Stoica
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=3fbac14 ]

CLOUDSTACK-6393: Add gpu details in Compute Offering detail view

Signed-off-by: Mihaela Stoica 
Signed-off-by: Sanjay Tripathi 


- ASF Subversion and Git Services


On April 12, 2014, 10:22 a.m., Mihaela Stoica wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20280/
> ---
> 
> (Updated April 12, 2014, 10:22 a.m.)
> 
> 
> Review request for cloudstack, Brian Federle and Jessica Wang.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added gpu details in Compute Offering detail view
> 
> 
> Diffs
> -
> 
>   ui/scripts/configuration.js ba6bdce 
> 
> Diff: https://reviews.apache.org/r/20280/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Mihaela Stoica
> 
>

Re: Review Request 20261: CLOUDSTACK-6233: Add new tab "GPU" in Host detailView for gpu enabled hosts


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20261/#review40536
---


Commit f3cf85bb6248aee7d2d64cc8e766fcbb12f6f029 in cloudstack's branch 
refs/heads/master from Mihaela Stoica
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=f3cf85b ]

CLOUDSTACK-6233: Add new tab "GPU" in Host detailView for gpu enabled hosts

Signed-off-by: Mihaela Stoica 
Signed-off-by: Sanjay Tripathi 


- ASF Subversion and Git Services


On April 11, 2014, 3:49 p.m., Mihaela Stoica wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20261/
> ---
> 
> (Updated April 11, 2014, 3:49 p.m.)
> 
> 
> Review request for cloudstack, Brian Federle and Jessica Wang.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added new "GPU" tab in Host detail page for gpu enabled hosts
> 
> 
> Diffs
> -
> 
>   client/WEB-INF/classes/resources/messages.properties 8abe874 
>   ui/css/cloudstack3.css 6602c16 
>   ui/dictionary.jsp ebe71b6 
>   ui/scripts/system.js ce62936 
> 
> Diff: https://reviews.apache.org/r/20261/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Mihaela Stoica
> 
>

Build failed in Jenkins: build-master #629

See 

Changes:

[sanjay.tripathi] CLOUDSTACK-6394: Add gpu details in "Add Compute Offering”

[sanjay.tripathi] CLOUDSTACK-6393: Add gpu details in Compute Offering detail 
view

[sanjay.tripathi] CLOUDSTACK-6233: Add new tab "GPU" in Host detailView for gpu 
enabled hosts

--
[...truncated 1374 lines...]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 30 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ cloud-server 
---
[INFO] Compiling 360 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
cloud-server ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 29 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
cloud-server ---
[INFO] Compiling 85 source files to 

[INFO] 
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ cloud-server ---
[INFO] Surefire report directory: 


---
 T E S T S
---
Running com.cloud.event.EventControlsUnitTest
log4j:WARN No appenders could be found for logger 
(com.cloud.event.EventControlsUnitTest).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more 
info.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.664 sec
Running com.cloud.keystore.KeystoreTest
org.apache.cloudstack.api.response.UserVmResponse/null/{"id":"3","securitygroup":[],"nic":[],"tags":[],"affinitygroup":[]}
org.apache.cloudstack.api.response.AlertResponse/null/{"id":"100","description":"Hello"}
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.159 sec
Running com.cloud.alert.AlertControlsUnitTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.027 sec
Running com.cloud.capacity.CapacityManagerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.145 sec
Running com.cloud.resourcelimit.ResourceLimitManagerImplTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running com.cloud.network.firewall.FirewallManagerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.002 sec
Running com.cloud.network.UpdatePhysicalNetworkTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.214 sec
Running com.cloud.network.CreatePrivateNetworkTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.134 sec
Running com.cloud.network.NetworkModelTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.104 sec
Running com.cloud.network.security.SecurityGroupManagerImplTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.519 sec
Running com.cloud.network.security.SecurityGroupQueueTest
Total jobs dequeued = 10, num queued=1000 queue current size=990
Num Vms= 50 Queue size = 50
Num Vms= 2 Queue size = 2 time=908 ms
Num Vms= 5000 Queue size = 5000 time=964 ms
Num Vms= 1 Queue size = 1 time=1 ms
Num Vms= 100 Queue size = 100 time=394 ms
Total jobs dequeued = 10, num queued=1000 queue current size=991
Tests run: 4, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 2.902 sec <<< 
FAILURE!
Running com.cloud.network.vpc.VpcManagerImplTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.04 sec
Running com.cloud.network.DedicateGuestVlanRangesTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.043 sec
Running com.cloud.network.lb.AssignLoadBalancerTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.095 sec
Running com.cloud.network.dao.NetworkDaoTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running com.cloud.vm.DeploymentPlanningManagerImplTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.195 sec
Running com.cloud.vm.snapshot.VMSnapshotManagerTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.31 sec
Running com.cloud.vm.UserVmManagerTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.272 sec
Running com.cloud.configuration.ValidateIpRangeTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.04 sec
Running com.cloud.configuration.ConfigurationManagerTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.064 sec
Running com.cloud.server.ConfigurationServerImplTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec
Running com.cloud.template.TemplateManagerImplTest
Tests run: 1,

Re: Review Request 18768: CLOUDSTACK-6151: Local data disk with tag goes to the wrong local storage pool


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18768/#review40538
---


Commit eb195d0575ee8d4b618ec52d2fd453a2c0867666 in cloudstack's branch 
refs/heads/master from Saksham Srivastava
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=eb195d0 ]

CLOUDSTACK-6151: Local data disk with tag goes to the wrong local storage pool

Signed-off-by: Koushik Das 


- ASF Subversion and Git Services


On April 16, 2014, 10:14 a.m., Saksham Srivastava wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/18768/
> ---
> 
> (Updated April 16, 2014, 10:14 a.m.)
> 
> 
> Review request for cloudstack and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-6151
> https://issues.apache.org/jira/browse/CLOUDSTACK-6151
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Updating the patch for 4.4 and master because of merge conflicts.
> 
> 
> Diffs
> -
> 
>   
> engine/schema/resources/META-INF/cloudstack/core/spring-engine-schema-core-daos-context.xml
>  489b37d 
>   
> engine/schema/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDao.java
>  2c4369d 
>   
> engine/schema/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDaoImpl.java
>  57afa16 
>   
> engine/storage/src/org/apache/cloudstack/storage/allocator/LocalStoragePoolAllocator.java
>  678b2a3 
>   server/test/resources/createNetworkOffering.xml 6ae1978 
> 
> Diff: https://reviews.apache.org/r/18768/diff/
> 
> 
> Testing
> ---
> 
> Tested the folowing scenarios:
> attaching local volume with tags
> attaching local volume without tags
> attaching local volume with different tags
> attaching shared volume
> 
> Build passes successfully.
> Patch applies cleanly.
> 
> 
> Thanks,
> 
> Saksham Srivastava
> 
>

Re: [PROPOSAL] Enhance the cloudstack events to include more information

2014-04-16 Thread Sonal Ojha

Hello ,

I have started putting up thoughts into the wiki article related to
enhancing the cloudstack events.

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Enhance+cloudstack+events+to+be+more+detailed

Kindly let me know any thoughts / suggestions.

-Sonal


On Wed, Mar 19, 2014 at 6:29 PM, Daan Hoogland wrote:

> Sonal, you're in
>
> On Wed, Mar 19, 2014 at 11:23 AM, Sonal Ojha 
> wrote:
> > Can someone grant me permission to create a page in cwiki?
> >
> >
> > On Tue, Mar 18, 2014 at 4:55 PM, Chip Childers  >wrote:
> >
> >> Jira for tracking progress, and a design page on the wiki for any design
> >> info.
> >>
> >> > On Mar 18, 2014, at 6:34 AM, Sonal Ojha 
> wrote:
> >> >
> >> > Shall I go ahead and open a jira item on this to add more details?
> >> >
> >> >
> >> >> On Tue, Mar 18, 2014 at 3:59 PM, Sonal Ojha 
> >> wrote:
> >> >>
> >> >> Hello Nitin,
> >> >>
> >> >> I agree with you, to start with we can replace the event
> descriptions to
> >> >> include the resource UUIDs of the required parameters only. For
> example,
> >> >> DetachIsoCmd needs only virtualMachineId as the required parameter.
> >> Hence,
> >> >> the event description should include the resource UUID for the
> virtual
> >> >> machine. Likewise the required parameters resource UUIDs would be
> >> included
> >> >> in the event description.
> >> >>
> >> >> -Sonal
> >> >>
> >> >>
> >> >> On Mon, Mar 17, 2014 at 10:48 PM, Nitin Mehta <
> nitin.me...@citrix.com
> >> >wrote:
> >> >>
> >> >>> Sonal - This is a great proposal. In addition, you should also
> include
> >> all
> >> >>> the first class entities involved in the event.
> >> >>> Say its a detach iso on a vm - then I should have uuids for both the
> >> iso
> >> >>> and the vm. This would definitely help giving more information and
> in
> >> >>> debugging.
> >> >>>
> >> >>> Thanks,
> >> >>> -Nitin
> >> >>>
> >> >>> On 17/03/14 9:52 AM, "Alena Prokharchyk" <
> alena.prokharc...@citrix.com
> >> >
> >> >>> wrote:
> >> >>>
> >>  On #1 I would say “display UUID INSTEAD of the DB id in the events
> >> API”.
> >>  We should never expose the DB ids to the API caller, especially if
> the
> >>  caller is not an admin. I guess we just never revised the events
> after
> >>  UUIDs were introduced.
> >> 
> >>  On #4. We should distinguish between end user and an admin and
> >> determine
> >>  which errors are allowed to be shown to the end user. For example,
> he
> >>  shouldn’t see any errors related to physical resources allocation
> >> error
> >> >>> as
> >>  he has no knowledge about hosts/storages/physical network topology.
> >> 
> >> 
> >>  -Alena.
> >> 
> >> 
> >> 
> >> > On 3/17/14, 9:40 AM, "John Kinsella"  wrote:
> >> >
> >> > I didn’t see comments from others, but this sounds great to me.
> More
> >> >>> info
> >> > is always better IMHO.
> >> >
> >> > On Mar 11, 2014, at 2:31 AM, Sonal Ojha
> >> > mailto:sonal.o...@sungard.com>> wrote:
> >> >
> >> > Currently the event logged in CloudStack doesn't give detailed
> >> > information
> >> > about the event that has occurred. The information provided in
> each
> >> >>> event
> >> > shown on the cloudstack ui doesn't provide specifics,
> particularly in
> >> > case
> >> > of errors. For example, the message shown on the cloudstack ui is
> >> just
> >> > "Error while starting Vm. Vm Id: " in case of failure to
> start a
> >> vm
> >> >>> ,
> >> > which doesnt help much.
> >> >
> >> > I would like to propose some changes to enhance the events to be
> more
> >> > informative. Like:
> >> >
> >> > 1) Instead of just showing resource database id in the event
> details
> >> it
> >> > should also display resource UUID. Since all the cloudstack apis
> take
> >> > input
> >> > as resource uuid it would be helpful to see the same on the ui as
> >> well.
> >> > Like in the quickview mode introduce another field as resource
> UUID
> >> >>> which
> >> > would specify the UUID for the resource on which the event
> occurred.
> >> >
> >> > 2) Enhance the events and listEvents API to include the resource
> >> UUID so
> >> > that it can be queried by the resource UUID as well.
> >> >
> >> > 3) Currently, the event description messages are specified in the
> >> > *Cmd.java
> >> > file instead, all of them should be externalize to a resource
> file.
> >> This
> >> > would be helpful even for internationalization.
> >> >
> >> > 4) Provide more detailed messages in case of error events.
> Messages
> >> such
> >> > as
> >> > "Error while starting VM" are generic to take any action.
> >> >
> >> > These changes could be taken forward in phases, some suggestion
> like
> >> >
> >> > Phase I -
> >> > include 2 and 3 point mentioned above
> >> > Phase II -
> >> > include 1 and 4 point mentioned above
> >> >
> >> > Thou

Jenkins build is back to normal : build-master #630

See

Re: Review Request 18768: CLOUDSTACK-6151: Local data disk with tag goes to the wrong local storage pool


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18768/#review40541
---


Commit 406c289d15fb25501c6e9d9ce1a73725c34b7aea in cloudstack's branch 
refs/heads/4.4 from Saksham Srivastava
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=406c289 ]

CLOUDSTACK-6151: Local data disk with tag goes to the wrong local storage pool

Signed-off-by: Koushik Das 


- ASF Subversion and Git Services


On April 16, 2014, 10:14 a.m., Saksham Srivastava wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/18768/
> ---
> 
> (Updated April 16, 2014, 10:14 a.m.)
> 
> 
> Review request for cloudstack and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-6151
> https://issues.apache.org/jira/browse/CLOUDSTACK-6151
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Updating the patch for 4.4 and master because of merge conflicts.
> 
> 
> Diffs
> -
> 
>   
> engine/schema/resources/META-INF/cloudstack/core/spring-engine-schema-core-daos-context.xml
>  489b37d 
>   
> engine/schema/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDao.java
>  2c4369d 
>   
> engine/schema/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDaoImpl.java
>  57afa16 
>   
> engine/storage/src/org/apache/cloudstack/storage/allocator/LocalStoragePoolAllocator.java
>  678b2a3 
>   server/test/resources/createNetworkOffering.xml 6ae1978 
> 
> Diff: https://reviews.apache.org/r/18768/diff/
> 
> 
> Testing
> ---
> 
> Tested the folowing scenarios:
> attaching local volume with tags
> attaching local volume without tags
> attaching local volume with different tags
> attaching shared volume
> 
> Build passes successfully.
> Patch applies cleanly.
> 
> 
> Thanks,
> 
> Saksham Srivastava
> 
>

Re: Review Request 18768: CLOUDSTACK-6151: Local data disk with tag goes to the wrong local storage pool

2014-04-16 Thread Koushik Das


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18768/#review40542
---

Ship it!


Ship It!

- Koushik Das


On April 16, 2014, 10:14 a.m., Saksham Srivastava wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/18768/
> ---
> 
> (Updated April 16, 2014, 10:14 a.m.)
> 
> 
> Review request for cloudstack and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-6151
> https://issues.apache.org/jira/browse/CLOUDSTACK-6151
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Updating the patch for 4.4 and master because of merge conflicts.
> 
> 
> Diffs
> -
> 
>   
> engine/schema/resources/META-INF/cloudstack/core/spring-engine-schema-core-daos-context.xml
>  489b37d 
>   
> engine/schema/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDao.java
>  2c4369d 
>   
> engine/schema/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDaoImpl.java
>  57afa16 
>   
> engine/storage/src/org/apache/cloudstack/storage/allocator/LocalStoragePoolAllocator.java
>  678b2a3 
>   server/test/resources/createNetworkOffering.xml 6ae1978 
> 
> Diff: https://reviews.apache.org/r/18768/diff/
> 
> 
> Testing
> ---
> 
> Tested the folowing scenarios:
> attaching local volume with tags
> attaching local volume without tags
> attaching local volume with different tags
> attaching shared volume
> 
> Build passes successfully.
> Patch applies cleanly.
> 
> 
> Thanks,
> 
> Saksham Srivastava
> 
>

Re: [PROPOSAL] Enhance the cloudstack events to include more information

2014-04-16 Thread Jeff Hair

Hi,

Is it possible to put something in there about standardizing the format of
the events on the event bus to a JSON format similar to how the resource
state transition and usage events work?

Jeff


On Wed, Apr 16, 2014 at 10:55 AM, Sonal Ojha  wrote:

> Hello ,
>
> I have started putting up thoughts into the wiki article related to
> enhancing the cloudstack events.
>
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Enhance+cloudstack+events+to+be+more+detailed
>
> Kindly let me know any thoughts / suggestions.
>
> -Sonal
>
>
> On Wed, Mar 19, 2014 at 6:29 PM, Daan Hoogland  >wrote:
>
> > Sonal, you're in
> >
> > On Wed, Mar 19, 2014 at 11:23 AM, Sonal Ojha 
> > wrote:
> > > Can someone grant me permission to create a page in cwiki?
> > >
> > >
> > > On Tue, Mar 18, 2014 at 4:55 PM, Chip Childers <
> chip.child...@gmail.com
> > >wrote:
> > >
> > >> Jira for tracking progress, and a design page on the wiki for any
> design
> > >> info.
> > >>
> > >> > On Mar 18, 2014, at 6:34 AM, Sonal Ojha 
> > wrote:
> > >> >
> > >> > Shall I go ahead and open a jira item on this to add more details?
> > >> >
> > >> >
> > >> >> On Tue, Mar 18, 2014 at 3:59 PM, Sonal Ojha <
> sonal.o...@sungard.com>
> > >> wrote:
> > >> >>
> > >> >> Hello Nitin,
> > >> >>
> > >> >> I agree with you, to start with we can replace the event
> > descriptions to
> > >> >> include the resource UUIDs of the required parameters only. For
> > example,
> > >> >> DetachIsoCmd needs only virtualMachineId as the required parameter.
> > >> Hence,
> > >> >> the event description should include the resource UUID for the
> > virtual
> > >> >> machine. Likewise the required parameters resource UUIDs would be
> > >> included
> > >> >> in the event description.
> > >> >>
> > >> >> -Sonal
> > >> >>
> > >> >>
> > >> >> On Mon, Mar 17, 2014 at 10:48 PM, Nitin Mehta <
> > nitin.me...@citrix.com
> > >> >wrote:
> > >> >>
> > >> >>> Sonal - This is a great proposal. In addition, you should also
> > include
> > >> all
> > >> >>> the first class entities involved in the event.
> > >> >>> Say its a detach iso on a vm - then I should have uuids for both
> the
> > >> iso
> > >> >>> and the vm. This would definitely help giving more information and
> > in
> > >> >>> debugging.
> > >> >>>
> > >> >>> Thanks,
> > >> >>> -Nitin
> > >> >>>
> > >> >>> On 17/03/14 9:52 AM, "Alena Prokharchyk" <
> > alena.prokharc...@citrix.com
> > >> >
> > >> >>> wrote:
> > >> >>>
> > >>  On #1 I would say “display UUID INSTEAD of the DB id in the
> events
> > >> API”.
> > >>  We should never expose the DB ids to the API caller, especially
> if
> > the
> > >>  caller is not an admin. I guess we just never revised the events
> > after
> > >>  UUIDs were introduced.
> > >> 
> > >>  On #4. We should distinguish between end user and an admin and
> > >> determine
> > >>  which errors are allowed to be shown to the end user. For
> example,
> > he
> > >>  shouldn’t see any errors related to physical resources allocation
> > >> error
> > >> >>> as
> > >>  he has no knowledge about hosts/storages/physical network
> topology.
> > >> 
> > >> 
> > >>  -Alena.
> > >> 
> > >> 
> > >> 
> > >> > On 3/17/14, 9:40 AM, "John Kinsella"  wrote:
> > >> >
> > >> > I didn’t see comments from others, but this sounds great to me.
> > More
> > >> >>> info
> > >> > is always better IMHO.
> > >> >
> > >> > On Mar 11, 2014, at 2:31 AM, Sonal Ojha
> > >> > mailto:sonal.o...@sungard.com>> wrote:
> > >> >
> > >> > Currently the event logged in CloudStack doesn't give detailed
> > >> > information
> > >> > about the event that has occurred. The information provided in
> > each
> > >> >>> event
> > >> > shown on the cloudstack ui doesn't provide specifics,
> > particularly in
> > >> > case
> > >> > of errors. For example, the message shown on the cloudstack ui
> is
> > >> just
> > >> > "Error while starting Vm. Vm Id: " in case of failure to
> > start a
> > >> vm
> > >> >>> ,
> > >> > which doesnt help much.
> > >> >
> > >> > I would like to propose some changes to enhance the events to be
> > more
> > >> > informative. Like:
> > >> >
> > >> > 1) Instead of just showing resource database id in the event
> > details
> > >> it
> > >> > should also display resource UUID. Since all the cloudstack apis
> > take
> > >> > input
> > >> > as resource uuid it would be helpful to see the same on the ui
> as
> > >> well.
> > >> > Like in the quickview mode introduce another field as resource
> > UUID
> > >> >>> which
> > >> > would specify the UUID for the resource on which the event
> > occurred.
> > >> >
> > >> > 2) Enhance the events and listEvents API to include the resource
> > >> UUID so
> > >> > that it can be queried by the resource UUID as well.
> > >> >
> > >> > 3) Currently, the event description messages are specified in
> the
> > >> >>

[ACS44] codefreeze in a couple of days

2014-04-16 Thread Daan Hoogland

heads up;

the official code-freeze date is friday the 18th of april (2014). in
practice I will start branch 4.4-forward on saterday morning CET so
COB on friday you can still submit to our present 4.4 branch. I will
be taking over the task as primary point of contact from Hugo as of
now. Please direct any popularity disclaimers to me from now on.

kind regards,
-- 
Daan

Re: AsyncJobEvents missing from Event Bus in 4.3

2014-04-16 Thread David Grizzanti

I've created a bug in Jira for this,
https://issues.apache.org/jira/browse/CLOUDSTACK-6426


On Tue, Apr 15, 2014 at 2:14 AM, Murali Reddy wrote:

> On 15/04/14 3:03 AM, "Kelven Yang"  wrote:
>
> >I was the original author for AsyncJob management and I wasn¹t aware of
> >that there is a hook-up to EventBus?
>
> Changes related to below commit gone missing in 4.3, 4.4 and master.
>
> commit 70f33efa7250d1ac8022f4390cddcbcb62ba92f8
> Author: Ryan Dietrich 
> Date:   Fri Jul 5 17:43:34 2013 +0530
>
> CLOUDSTACK-3190: Async jobs actions now trigger event bus messages to
> be
> published-AsyncJobManagerImpl to publish async job events when async
> jobs are
> created, updated and completed
>
>
> >
> >Kelven
> >
> >On 4/14/14, 1:37 PM, "David Grizzanti" 
> >wrote:
> >
> >>Hi All,
> >>
> >>I came across an issue this week that I wanted to see if anyone is aware
> >>of. Until recently we've been running on 4.2 and using the Event Bus
> >>pretty
> >>heavily. We upgraded to 4.3 last week and I noticed since upgrading that
> >>we're not seeing any AsyncJobEvent messages. We see all the other
> >>expected
> >>types (Action, Usage, Alert, ResourceState), just no Async.
> >>
> >>I poked around at the code a bit and noticed that the AsyncJob manager
> >>code
> >>was rewritten, but I don't know enough to pinpoint any potential issues.
> >>
> >>Is it something we're doing wrong with configuration or have others
> >>noticed
> >>this?
> >>
> >>Thanks!
> >
> >
>
>
>

Re: Devcloud2 errors on 4.4

2014-04-16 Thread David Grizzanti

Didn't realize there was a new version of devcloud - thanks for the tip.
 Will try this out!


On Wed, Apr 16, 2014 at 1:30 AM, Punith S  wrote:

> hi,
>
> check whether you are using the new updated devcloud2(1.3GB) for 4.3
> onwards!
> ref - https://cwiki.apache.org/confluence/display/CLOUDSTACK/DevCloud
>
> and its recommended to use devcloud as host only mode.
> thanks,
>
>
>
> On Wed, Apr 16, 2014 at 12:18 AM, David Grizzanti <
> david.grizza...@sungard.com> wrote:
>
> > All,
> >
> > I am facing an issue when trying to get devcloud2 running with latest
> code
> > from 4.4 branch. There was a similar email to this a few weeks back on
> > master, but I did not see any resolution.
> >
> > I'm running everything in side of devcloud2 (mgmt server, mysql, xen).
> >
> > Seeing the following errors when trying to deploy an initial zone.  Don't
> > see any issues with creating the /opt/cloud/bin directory inside the VM.
> >
> > WARN  [c.c.a.m.DirectAgentAttache] (DirectAgent-37:ctx-0d57a0bf) Seq
> > 3-8906994163031998465: Exception Caught while executing command
> > com.cloud.utils.exception.CloudRuntimeException: Cannot create directory
> > /opt/cloud/bin on XenServer hosts
> > at
> >
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.setupServer(CitrixResourceBase.java:4842)
> > at
> >
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:4668)
> > at
> >
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
> > at
> >
> com.cloud.hypervisor.xen.resource.XcpOssResource.executeRequest(XcpOssResource.java:176)
> > at
> >
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
> > at
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> > at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> > at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> > at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> > at
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> > at
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > at
> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> > at
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
> > at
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:724)
> > WARN  [c.c.h.x.d.XcpServerDiscoverer] (AgentTaskPool-13:ctx-5015bd03)
> > Unable to setup agent 3 due to
> > com.cloud.utils.exception.CloudRuntimeException: Cannot create directory
> > /opt/cloud/bin on XenServer hosts
> > INFO  [c.c.u.e.CSExceptionErrorCode] (AgentTaskPool-13:ctx-5015bd03)
> Could
> > not find exception: com.cloud.exception.ConnectionException in error code
> > list for exceptions
> > WARN  [c.c.a.m.AgentManagerImpl] (AgentTaskPool-13:ctx-5015bd03) Monitor
> > XcpServerDiscoverer says there is an error in the connect process for 3
> due
> > to Reinitialize agent after setup.
> > INFO  [c.c.a.m.AgentManagerImpl] (AgentTaskPool-13:ctx-5015bd03) Host 3
> is
> > disconnecting with event AgentDisconnected
> > WARN  [c.c.r.ResourceManagerImpl] (AgentTaskPool-13:ctx-5015bd03) Unable
> > to connect due to
> > com.cloud.exception.ConnectionException: Reinitialize agent after setup.
> > at
> >
> com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.processConnect(XcpServerDiscoverer.java:658)
> > at
> >
> com.cloud.agent.manager.AgentManagerImpl.notifyMonitorsOfConnection(AgentManagerImpl.java:514)
> > at
> >
> com.cloud.agent.manager.AgentManagerImpl.handleDirectConnectAgent(AgentManagerImpl.java:1428)
> > at
> >
> com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:1767)
> > at
> >
> com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:1893)
> > at sun.reflect.GeneratedMethodAccessor226.invoke(Unknown Source)
> > at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:31

Re: AsyncJobEvents missing from Event Bus in 4.3

2014-04-16 Thread Daan Hoogland

this sounds like a regression!?! is it being tested in a unit/integration test?

On Wed, Apr 16, 2014 at 2:16 PM, David Grizzanti
 wrote:
> I've created a bug in Jira for this,
> https://issues.apache.org/jira/browse/CLOUDSTACK-6426
>
>
> On Tue, Apr 15, 2014 at 2:14 AM, Murali Reddy wrote:
>
>> On 15/04/14 3:03 AM, "Kelven Yang"  wrote:
>>
>> >I was the original author for AsyncJob management and I wasn¹t aware of
>> >that there is a hook-up to EventBus?
>>
>> Changes related to below commit gone missing in 4.3, 4.4 and master.
>>
>> commit 70f33efa7250d1ac8022f4390cddcbcb62ba92f8
>> Author: Ryan Dietrich 
>> Date:   Fri Jul 5 17:43:34 2013 +0530
>>
>> CLOUDSTACK-3190: Async jobs actions now trigger event bus messages to
>> be
>> published-AsyncJobManagerImpl to publish async job events when async
>> jobs are
>> created, updated and completed
>>
>>
>> >
>> >Kelven
>> >
>> >On 4/14/14, 1:37 PM, "David Grizzanti" 
>> >wrote:
>> >
>> >>Hi All,
>> >>
>> >>I came across an issue this week that I wanted to see if anyone is aware
>> >>of. Until recently we've been running on 4.2 and using the Event Bus
>> >>pretty
>> >>heavily. We upgraded to 4.3 last week and I noticed since upgrading that
>> >>we're not seeing any AsyncJobEvent messages. We see all the other
>> >>expected
>> >>types (Action, Usage, Alert, ResourceState), just no Async.
>> >>
>> >>I poked around at the code a bit and noticed that the AsyncJob manager
>> >>code
>> >>was rewritten, but I don't know enough to pinpoint any potential issues.
>> >>
>> >>Is it something we're doing wrong with configuration or have others
>> >>noticed
>> >>this?
>> >>
>> >>Thanks!
>> >
>> >
>>
>>
>>



-- 
Daan

old review requests

2014-04-16 Thread Daan Hoogland

LS,

I have been going over the review requests that are more then 3 months
old. I will continue going over older requests asking people to update
or discard them next week. Please have a look at your review board
desktop to save me work.

TIA
-- 
Daan

Re: Review Request 19912: [CLOUDSTACK-6322] Fixed Contrail: Params validation is missing while launching a service instance thru cloudmonkey

2014-04-16 Thread daan Hoogland



> On April 15, 2014, 2:23 p.m., daan Hoogland wrote:
> > It would seem that this is a behavioral change that would break backwards 
> > compatibility, is it? Right now empty service names are accepted. What is 
> > the consequence and why change the behavior, can you shed light on the 
> > subject?
> > 
> > otherwise the change seems trivial enough and is applicable.
> 
> Sachchidanand Vaidya wrote:
> Hi Daan,
> 
>  If user passes "null" string during instance creation then it's an issue 
> since we can't search service-instance with a null string as part of Fully 
> Qualified Name lookup on Contrail Controller. Hence user can't delete a 
> service-instance with "null" string. Passing empty string is functionally ok 
> but we want to avoid both "null" and "empty" string since  it's not a good 
> idea from usability/debugability point of view.
> 
> Thanks & Regards,
> Sachin

ok, thanks. seems like a bug fix more then a behavioral change.


- daan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19912/#review40393
---


On April 2, 2014, 9:14 a.m., Sachchidanand Vaidya wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/19912/
> ---
> 
> (Updated April 2, 2014, 9:14 a.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Don't allow service instance creation with empty or null service-instance 
> "name"
> 
> 
> Diffs
> -
> 
>   
> plugins/network-elements/juniper-contrail/src/org/apache/cloudstack/network/contrail/api/command/CreateServiceInstanceCmd.java
>  d2cb4de 
> 
> Diff: https://reviews.apache.org/r/19912/diff/
> 
> 
> Testing
> ---
> 
> Unit tested for null and empty "name" parameter.
> 
> 
> Thanks,
> 
> Sachchidanand Vaidya
> 
>

Re: Review Request 19912: [CLOUDSTACK-6322] Fixed Contrail: Params validation is missing while launching a service instance thru cloudmonkey


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19912/#review40545
---


Commit 085911f0a6c256c5f2a439ec0bf79b5027cdc078 in cloudstack's branch 
refs/heads/master from Sachchidanand Vaidya
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=085911f ]

CLOUDSTACK-6322 - Don't allow service instance creation with empty or null 
service-instance "name".

Signed-off-by: Daan Hoogland 


- ASF Subversion and Git Services


On April 2, 2014, 9:14 a.m., Sachchidanand Vaidya wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/19912/
> ---
> 
> (Updated April 2, 2014, 9:14 a.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Don't allow service instance creation with empty or null service-instance 
> "name"
> 
> 
> Diffs
> -
> 
>   
> plugins/network-elements/juniper-contrail/src/org/apache/cloudstack/network/contrail/api/command/CreateServiceInstanceCmd.java
>  d2cb4de 
> 
> Diff: https://reviews.apache.org/r/19912/diff/
> 
> 
> Testing
> ---
> 
> Unit tested for null and empty "name" parameter.
> 
> 
> Thanks,
> 
> Sachchidanand Vaidya
> 
>

Re: Review Request 19686: Implementation of the issue CLOUDSTACK 6139 - System.vm.use.local.storage global setting to zone setting

2014-04-16 Thread daan Hoogland


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19686/#review40546
---


doesn't apply (anymore) can you rebase? sorry

- daan Hoogland


On April 16, 2014, 9:18 a.m., Wilder Rodrigues wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/19686/
> ---
> 
> (Updated April 16, 2014, 9:18 a.m.)
> 
> 
> Review request for cloudstack, daan Hoogland and Hugo Trippaers.
> 
> 
> Bugs: CLOUDSTACK-6139
> https://issues.apache.org/jira/browse/CLOUDSTACK-6139
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> I changed the following code in order to accomplish what is expected by the 
> issue:
> 
> Config enum:
> 
> SystemVMUseLocalStorage(
> "Advanced",
> ManagementServer.class,
> Boolean.class,
> "system.vm.use.local.storage",
> "false",
> "Indicates whether to use local storage pools or shared storage 
> pools for system VMs.",
> null, ConfigKey.Scope.Zone.toString()),
> 
> DeploymentPlanningManagerImpl:
> 
> 
> * I injected the DataCenterDao in order to check if the Zone uses 
> local storage
> 
>  String ssvmUseLocalStorage = 
> _configDao.getValue(Config.SystemVMUseLocalStorage.key());
>  DataCenterVO zone = _zoneDao.findById(plan.getDataCenterId());
>  boolean zoneUsesLocalStorage = zone.isLocalStorageEnabled();
> 
>  if (ssvmUseLocalStorage.equalsIgnoreCase("true") && 
> zoneUsesLocalStorage) {
> useLocalStorage = true;
>  }
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/configuration/Config.java af1f062 
>   server/src/com/cloud/deploy/DeploymentPlanningManagerImpl.java fc7c300 
> 
> Diff: https://reviews.apache.org/r/19686/diff/
> 
> 
> Testing
> ---
> 
> I have tested those changes running multiple zones (2 with local storage and 
> 1 without). Instances, networks, and all the rest are working fine. I ran the 
> tests against 3 hosts running XenServer, where one of them has an extra disk 
> which is used as NFS primary storage. From the 2 instances using local 
> storage, one was created with Cloudtack 4.3 RC (9th round). In order to make 
> it clear, below the steps I followed to test it:
> 
> Global settings: system.vm.use.local.storage == true
> 
> 
> 1.  Deploy Cloudstack 4.3.0 RC (9th round)
> 
> 2.  Create a zone (local storage enabled)
> 
> a.   Create an instance and network
> 
> 3.  Test firewalling and port forwarding
> 
> 4.  Upgrade Cloudstack 4.3.0 RC (9th round) to Cloudstack 4.5.0-SNAPSHOT
> 
> 5.  Test firewalling and port forwarding
> 
> 6.  Create a zone (local storage enabled)
> 
> a.   Create an instance and network
> 
> 7.  Create a zone (local storage disabled) + NFS primary storage
> 
> a.   Create an instance and network
> 
> 8.  Test firewalling and port forwarding
> 
> With the steps above, I was able to set up the whole environment and make 
> sure the VMs were running properly and ACL/Port-Forwarding were also working 
> as expected.
> 
> Global settings: system.vm.use.local.storage == false
> 
> 
> 1.  Deploy Cloudstack 4.3.0 RC (9th round)
> 
> 2.  Create a zone (local storage disabled) + NFS primary storage
> 
> a.   Create an instance and network
> 
> 3.  Test firewalling and port forwarding
> 
> 4.  Upgrade Cloudstack 4.3.0 RC (9th round) to Cloudstack 4.5.0-SNAPSHOT
> 
> 5.  Test firewalling and port forwarding
> 
> 6.  Set system.vm.use.local.storage to true
> 
> 7.  Create a zone (local storage enabled)
> 
> a.   Create an instance and network
> 
> 8.  Create a zone (local storage enabled)
> 
> a.   Create an instance and network
> 
> 9.  Create new instance under the Zone which does not use local storage
> 
> 10.  Test firewalling and port forwarding
> 
> Again, everything worked as expected.
> 
> With the steps provided above, I can make sure that resources created with 
> version prior to master (4.5.0-SNAPSHOT) won't have problems when performing 
> an update.
> 
> 
> Thanks,
> 
> Wilder Rodrigues
> 
>

Build failed in Jenkins: build-master #631

See 

Changes:

[Daan Hoogland] CLOUDSTACK-6322 - Don't allow service instance creation with 
empty or null service-instance "name".

--
[...truncated 1374 lines...]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 30 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ cloud-server 
---
[INFO] Compiling 360 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
cloud-server ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 29 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
cloud-server ---
[INFO] Compiling 85 source files to 

[INFO] 
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ cloud-server ---
[INFO] Surefire report directory: 


---
 T E S T S
---
Running com.cloud.event.EventControlsUnitTest
log4j:WARN No appenders could be found for logger 
(com.cloud.event.EventControlsUnitTest).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more 
info.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.638 sec
Running com.cloud.keystore.KeystoreTest
org.apache.cloudstack.api.response.UserVmResponse/null/{"id":"3","securitygroup":[],"nic":[],"tags":[],"affinitygroup":[]}
org.apache.cloudstack.api.response.AlertResponse/null/{"id":"100","description":"Hello"}
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.149 sec
Running com.cloud.alert.AlertControlsUnitTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec
Running com.cloud.capacity.CapacityManagerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.192 sec
Running com.cloud.resourcelimit.ResourceLimitManagerImplTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running com.cloud.network.firewall.FirewallManagerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.001 sec
Running com.cloud.network.UpdatePhysicalNetworkTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.196 sec
Running com.cloud.network.CreatePrivateNetworkTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.108 sec
Running com.cloud.network.NetworkModelTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.136 sec
Running com.cloud.network.security.SecurityGroupManagerImplTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.81 sec
Running com.cloud.network.security.SecurityGroupQueueTest
Total jobs dequeued = 10, num queued=1008 queue current size=998
Num Vms= 50 Queue size = 50
Num Vms= 2 Queue size = 2 time=188 ms
Num Vms= 5000 Queue size = 5000 time=1450 ms
Num Vms= 1 Queue size = 1 time=0 ms
Num Vms= 100 Queue size = 100 time=671 ms
Total jobs dequeued = 10, num queued=1009 queue current size=1000
Tests run: 4, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 3.084 sec <<< 
FAILURE!
Running com.cloud.network.vpc.VpcManagerImplTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.044 sec
Running com.cloud.network.DedicateGuestVlanRangesTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.042 sec
Running com.cloud.network.lb.AssignLoadBalancerTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.092 sec
Running com.cloud.network.dao.NetworkDaoTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running com.cloud.vm.DeploymentPlanningManagerImplTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.873 sec
Running com.cloud.vm.snapshot.VMSnapshotManagerTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.145 sec
Running com.cloud.vm.UserVmManagerTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.2 sec
Running com.cloud.configuration.ValidateIpRangeTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec
Running com.cloud.configuration.ConfigurationManagerTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.058 sec
Running com.cloud.server.ConfigurationServerImplTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec
Running com.cloud.template.TemplateManagerImplTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
Running com.cloud.vpc.Site2SiteVpnTest
Tests run: 1, Failures: 0, Errors: 0, S

[GitHub] cloudstack-docs-rn pull request: Update CS RelNotes 4.2.x to 4.3

GitHub user simonfiddaman opened a pull request:

https://github.com/apache/cloudstack-docs-rn/pull/6

Update CS RelNotes 4.2.x to 4.3

 - Break out validation step as it applies to all upgrades and installations
 - Update visual format of commands
 - Update instructions for 4.2.x upgrade
 - Reordered and clarified agent upgrade steps

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/simonfiddaman/cloudstack-docs-rn master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack-docs-rn/pull/6.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #6


commit 617b141e18e686af6af431e586d761e5566f6097
Author: Simon Fiddaman 
Date:   2014-03-25T15:37:00Z

Update format of 4.2.0 upgrade commands

Make Ubuntu and CentOS commands consistently formatted ( $ sudo ... ) for 
4.2.0 upgrade instructions.

commit 8a2d3f8ee038251d3b53fed3d287a81fcdbc189c
Author: Simon Fiddaman 
Date:   2014-03-25T16:12:31Z

Update 4.2.0 upgrade instructions

Update 4.2.0 upgrade instructions for Ubuntu and CentOS to correct apt / 
yum usage.

commit 113541ee5c507cde950cbe979fa38e1d3828bc4e
Author: Simon Fiddaman 
Date:   2014-03-26T08:06:32Z

Update references to 4.2.0

Update references to version 4.2.0 to version 4.2.x. 
Update references to versioned repository 4.2.0 to 4.2 (as the repository 
should be specific to the 4.2 release, not the point-release).

commit 6b9fad09ef75ebde6ffdecb4a41ae13384a83957
Author: Simon Fiddaman 
Date:   2014-03-26T08:25:09Z

Move source tarball verification up document

The source tarball verification steps can and should be performed 
independently of the specific 4.2.x to 4.3.0 upgrade steps. Move the source 
tarball verification steps to the beginning of the document to simplify the 
4.2.x upgrade steps and minimise downtime (should these steps be performed in 
sequence as described).




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: [4.4]copy_vhd_from_secondarystorage is timing out

This is a similar problem to what I sent an e-mail out about last night:
XmlRpcException (Read timed out). For me it's happening when
CitrixResourceBase issues SR.create.

This issue is currently blocking my testing progress and I'm not really
sure who might be the right person to look into this.

Any thoughts on this anyone?


On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy wrote:

>  System VM's are launching fine now after Anthony's fix. But user VM's
> are failing to get created with exception.
>
>  43275 2014-04-16 12:59:08,647 DEBUG [c.c.h.x.r.XenServerConnectionPool]
> (DirectAgent-137:ctx-4761cb0c) XmlRpcException for method: VDI.snapshot due
> to org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
> 43276 2014-04-16 12:59:08,647 WARN [c.c.h.x.r.XenServerStorageProcessor]
> (DirectAgent-137:ctx-4761cb0c) Catch Exception
> org.apache.xmlrpc.XmlRpcException for template + due to
> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
>
>  org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
>  org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
> at
> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpcSunHttpTransport.java:99)
> at
> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:152)
> at
> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
> at
> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunHttpTransport.java:69)
> at
> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
> at com.xensource.xenapi.Connection.dispatch(Connection.java:285)
> at
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:456)
> at com.xensource.xenapi.VDI.snapshot(VDI.java:1155)
> at
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:972)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:77)
>
>   From: Mike Tutkowski 
> Date: Wednesday, 16 April 2014 12:35 AM
> To: "dev@cloudstack.apache.org" 
> Cc: Murali Reddy 
>
> Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out
>
>   Hi Anthony,
>
>  Can you go into a bit more depth about copy_vhd_from_secondarystorage
> not being used with XenServer 6.2?
>
>  Does that mean "public Answer copyTemplateToPrimaryStorage(CopyCommand
> cmd)" in XenServerStorageProcessor is not called when XenServer 6.2 is in
> use?
>
>  I'm testing out a feature of mine for 4.4, but have only been using
> XenServer 6.1 so far.
>
>  Thanks!
> Mike
>
>
> On Tue, Apr 15, 2014 at 12:44 PM, Anthony Xu  wrote:
>
>> Hi Murali,
>>
>> It is caused by the commit, I tested the commit on XS 6.2 FOX, which
>> doesn't use copy_vhd_from_secondarystorage, that's why I didn't see this
>> issue.
>>
>> Just disabled XAPI Event in 4.4 branch.
>>
>>
>> Thanks,
>> Anthony
>>
>>
>>
>>
>>
>>
>> -Original Message-
>> From: Murali Reddy
>> Sent: Tuesday, April 15, 2014 10:54 AM
>> To: dev@cloudstack.apache.org; Anthony Xu
>> Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out
>>
>>
>> I am still running into this issue. Alex reverted complete change
>> replacing xapi.jar, which was also resulting XmlRpc exceptions but system
>> VM's were launching fine after revert. I may be wrong but looking at the
>> stack trace and recent commits, commit
>> 9f44909e63a19b2b8034baa13b92e24ea2eb0227 (use event instead of poll for
>> xapi async call in XS 6.2 and above to reduce the pressure on XAPI) may be
>> causing this issue. Anthony can you please take a look?
>>
>>
>> On 14/04/14 8:12 AM, "Mike Tutkowski" 
>> wrote:
>>
>> >I was seeing a similar issue when XAPI was changed when I tried to
>> >create an SR.
>> >
>> >I wonder if that XAPI issue hasn't been fully resolved.
>> >
>> >
>> >On Sun, Apr 13, 2014 at 4:16 PM, Srikanteswararao Talluri <
>> >srikanteswararao.tall...@citrix.com> wrote:
>> >
>> >> Did anybody see this on latest 4.4?
>> >>
>> >>
>> >> 2014-04-14 00:01:34,305 DEBUG [c.c.h.x.r.XenServerConnectionPool]
>> >> (DirectAgent-71:ctx-12d9be59) XmlRpcException for method: event.from
>> >>due to
>> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream:
>> >>Read  timed out
>> >>
>> >> 2014-04-14 00:01:34,305 WARN  [c.c.h.x.r.CitrixResourceBase]
>> >> (DirectAgent-71:ctx-12d9be59) callHostPlugin failed for cmd:
>> >> copy_vhd_from_secondarystorage with args mountpoint:
>> >>10.147.28.7:/export/home/talluri/psec/template/tmpl/1/1/,
>> >> sruuid: b3dd21aa-8e82-a923-ed29-ee58220d158b, namelabel:
>> >> cloud-8498d88f-be

Jenkins build is back to normal : build-master #632

See

Instance on KVM + NFS fails

Hey everybody, I am trying to deploy a VM instance in KVM using NFS for
primary storage (on 4.3).  Unfortunately, this is the exception I am
getting:

2014-04-16 06:44:53,128 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(Work-Job-Executor-6:job-30/job-31 ctx-b83982e8) Unable to create
Vol[4|vm=4|ROOT]:java.lang.ClassCastException:
com.cloud.agent.api.to.NfsTO cannot be cast to
org.apache.cloudstack.storage.to.PrimaryDataStoreTO
at 
com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
torage(KVMStorageProcessor.java:150)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
geSubsystemCommandHandlerBase.java:75)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
Commands(StorageSubsystemCommandHandlerBase.java:50)
at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(L
ibvirtComputingResource.java:1359)
at com.cloud.agent.Agent.processRequest(Agent.java:498)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
at com.cloud.utils.nio.Task.run(Task.java:83)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
603)
at java.lang.Thread.run(Thread.java:722)


Is this a known issue or are there any gotchas that I am overlooking?

Thanks!

// David


P.s., good to have seen some of you at CCCNA14 last week.  Looking forward
to Budapest.

Re: Instance on KVM + NFS fails

2014-04-16 Thread Yitao Jiang

Hi, David

Did u see anything wrong within kvm agent log file？



Thanks,

Yitao


2014-04-16 22:59 GMT+08:00 La Motta, David :

> Hey everybody, I am trying to deploy a VM instance in KVM using NFS for
> primary storage (on 4.3).  Unfortunately, this is the exception I am
> getting:
>
> 2014-04-16 06:44:53,128 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> (Work-Job-Executor-6:job-30/job-31 ctx-b83982e8) Unable to create
> Vol[4|vm=4|ROOT]:java.lang.ClassCastException:
> com.cloud.agent.api.to.NfsTO cannot be cast to
> org.apache.cloudstack.storage.to.PrimaryDataStoreTO
> at
> com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
> torage(KVMStorageProcessor.java:150)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
> geSubsystemCommandHandlerBase.java:75)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
> Commands(StorageSubsystemCommandHandlerBase.java:50)
> at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(L
> ibvirtComputingResource.java:1359)
> at com.cloud.agent.Agent.processRequest(Agent.java:498)
> at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
> at com.cloud.utils.nio.Task.run(Task.java:83)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
> 110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
> 603)
> at java.lang.Thread.run(Thread.java:722)
>
>
> Is this a known issue or are there any gotchas that I am overlooking?
>
> Thanks!
>
> // David
>
>
> P.s., good to have seen some of you at CCCNA14 last week.  Looking forward
> to Budapest.
>
>

Re: Instance on KVM + NFS fails

I'm positive I tested one of the last RCs with NFS, but I'm running
through a fresh install with the release RPMs to see if I can
reproduce it.

On Wed, Apr 16, 2014 at 9:25 AM, Yitao Jiang  wrote:
> Hi, David
>
> Did u see anything wrong within kvm agent log file？
>
>
>
> Thanks,
>
> Yitao
>
>
> 2014-04-16 22:59 GMT+08:00 La Motta, David :
>
>> Hey everybody, I am trying to deploy a VM instance in KVM using NFS for
>> primary storage (on 4.3).  Unfortunately, this is the exception I am
>> getting:
>>
>> 2014-04-16 06:44:53,128 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>> (Work-Job-Executor-6:job-30/job-31 ctx-b83982e8) Unable to create
>> Vol[4|vm=4|ROOT]:java.lang.ClassCastException:
>> com.cloud.agent.api.to.NfsTO cannot be cast to
>> org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>> at
>> com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
>> torage(KVMStorageProcessor.java:150)
>> at
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
>> geSubsystemCommandHandlerBase.java:75)
>> at
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
>> Commands(StorageSubsystemCommandHandlerBase.java:50)
>> at
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(L
>> ibvirtComputingResource.java:1359)
>> at com.cloud.agent.Agent.processRequest(Agent.java:498)
>> at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
>> at com.cloud.utils.nio.Task.run(Task.java:83)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
>> 110)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
>> 603)
>> at java.lang.Thread.run(Thread.java:722)
>>
>>
>> Is this a known issue or are there any gotchas that I am overlooking?
>>
>> Thanks!
>>
>> // David
>>
>>
>> P.s., good to have seen some of you at CCCNA14 last week.  Looking forward
>> to Budapest.
>>
>>

Re: Instance on KVM + NFS fails

The 4.3 released RPMs work with my NFS tests for a fresh install. Is
this a fresh install or an upgrade? What code are you running, both on
mgmt server and agent (rpms, debs, or from source and commit hash)? Do
you have a CopyCommand in the logs that shows the full JSON objects
representing the NfsTO being passed? Example:

2014-04-16 09:40:34,979 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-5:null) Request:Seq 1-946470950:  { Cmd ,
MgmtId: 90520735907663, via: 1, Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/2/202/daf8a242-226a-391e-afab-25b9598cc5c1.qcow2","origUrl":"http://marcus.mlsorensen.com/cloudstack-extras/tiny-centos-63.qcow2","uuid":"b4f4e742-7099-4dca-a589-1c75e2199ba9","id":202,"format":"QCOW2","accountId":2,"checksum":"44cd0e6330a59f031460bc18a40c95a2","hvm":true,"displayText":"tiny","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172.17.10.10/nfs/secondary","_role":"Image"}},"name":"202-2-f40033ea-61c3-3e02-823f-d279eeab3e44","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://marcus.mlsorensen.com/cloudstack-extras/tiny-centos-63.qcow2","uuid":"b4f4e742-7099-4dca-a589-1c75e2199ba9","id":202,"format":"QCOW2","accountId":2,"checksum":"44cd0e6330a59f031460bc18a40c95a2","hvm":true,"displayText":"tiny","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"2fe9a944-505e-38cb-bf87-72623634be4a","id":2,"poolType":"NetworkFilesystem","host":"172.17.10.10","path":"/nfs/primary","port":2049,"url":"NetworkFilesystem://172.17.10.10//nfs/primary/?ROLE=Primary&STOREUUID=2fe9a944-505e-38cb-bf87-72623634be4a"}},"name":"202-2-f40033ea-61c3-3e02-823f-d279eeab3e44","hypervisorType":"KVM"}},"executeInSequence":false,"options":{},"wait":10800}}]
}

On Wed, Apr 16, 2014 at 9:34 AM, Marcus  wrote:
> I'm positive I tested one of the last RCs with NFS, but I'm running
> through a fresh install with the release RPMs to see if I can
> reproduce it.
>
> On Wed, Apr 16, 2014 at 9:25 AM, Yitao Jiang  wrote:
>> Hi, David
>>
>> Did u see anything wrong within kvm agent log file？
>>
>>
>>
>> Thanks,
>>
>> Yitao
>>
>>
>> 2014-04-16 22:59 GMT+08:00 La Motta, David :
>>
>>> Hey everybody, I am trying to deploy a VM instance in KVM using NFS for
>>> primary storage (on 4.3).  Unfortunately, this is the exception I am
>>> getting:
>>>
>>> 2014-04-16 06:44:53,128 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>> (Work-Job-Executor-6:job-30/job-31 ctx-b83982e8) Unable to create
>>> Vol[4|vm=4|ROOT]:java.lang.ClassCastException:
>>> com.cloud.agent.api.to.NfsTO cannot be cast to
>>> org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>>> at
>>> com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
>>> torage(KVMStorageProcessor.java:150)
>>> at
>>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
>>> geSubsystemCommandHandlerBase.java:75)
>>> at
>>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
>>> Commands(StorageSubsystemCommandHandlerBase.java:50)
>>> at
>>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(L
>>> ibvirtComputingResource.java:1359)
>>> at com.cloud.agent.Agent.processRequest(Agent.java:498)
>>> at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
>>> at com.cloud.utils.nio.Task.run(Task.java:83)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
>>> 110)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
>>> 603)
>>> at java.lang.Thread.run(Thread.java:722)
>>>
>>>
>>> Is this a known issue or are there any gotchas that I am overlooking?
>>>
>>> Thanks!
>>>
>>> // David
>>>
>>>
>>> P.s., good to have seen some of you at CCCNA14 last week.  Looking forward
>>> to Budapest.
>>>
>>>

Re: Review Request 20390: CLOUDSTACK-6202: Add signatureversion and expiring datetime to cloudmonkey, make it configurable

2014-04-16 Thread Yichi Lu



> On April 16, 2014, 2:50 a.m., Rohit Yadav wrote:
> > If it's backward compatible and works fine, let's merge. LGTM

Rohit:
As far as I know this will not break the backward compatibility. For API calls, 
the signature version and expiration time is consumed by 
server/src/com/cloud/api/ApiServer.java::verifyRequest() like this:
String signatureVersion = null;
String expires = null;

for (final String paramName : parameterNames) {
// parameters come as name/value pairs in the form 
String/String[]
final String paramValue = 
((String[])requestParameters.get(paramName))[0];

if (ApiConstants.SIGNATURE.equalsIgnoreCase(paramName)) {
signature = paramValue;
} else {
if (ApiConstants.API_KEY.equalsIgnoreCase(paramName)) {
apiKey = paramValue;
} else if 
(ApiConstants.SIGNATURE_VERSION.equalsIgnoreCase(paramName)) {
signatureVersion = paramValue;
} else if 
(ApiConstants.EXPIRES.equalsIgnoreCase(paramName)) {
expires = paramValue;
}

if (unsignedRequest == null) {
unsignedRequest = paramName + "=" + 
URLEncoder.encode(paramValue, UTF_8).replaceAll("\\+", "%20");
} else {
unsignedRequest = unsignedRequest + "&" + paramName + 
"=" + URLEncoder.encode(paramValue, UTF_8).replaceAll("\\+", "%20");
}
}
}

// if api/secret key are passed to the parameters
if ((signature == null) || (apiKey == null)) {
s_logger.debug("Expired session, missing signature, or missing 
apiKey -- ignoring request. Signature: " + signature + ", apiKey: " + apiKey);
return false; // no signature, bad request
}

Date expiresTS = null;
// FIXME: Hard coded signature, why not have an enum
if ("3".equals(signatureVersion)) {
// New signature authentication. Check for expire parameter and 
its validity
if (expires == null) {
s_logger.debug("Missing Expires parameter -- ignoring 
request. Signature: " + signature + ", apiKey: " + apiKey);
return false;
}
synchronized (DateFormatToUse) {
try {
expiresTS = DateFormatToUse.parse(expires);
} catch (final ParseException pe) {
s_logger.debug("Incorrect date format for Expires 
parameter", pe);
return false;
}
}
final Date now = new Date(System.currentTimeMillis());
if (expiresTS.before(now)) {
s_logger.debug("Request expired -- ignoring ...sig: " + 
signature + ", apiKey: " + apiKey);
return false;
}
}

So expires will be checked only if an api call uses the key signatureversion, 
and its value == 3. Otherwise the key expires will just be ignored.

Yichi


- Yichi


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20390/#review40515
---


On April 15, 2014, 5:28 p.m., Yichi Lu wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20390/
> ---
> 
> (Updated April 15, 2014, 5:28 p.m.)
> 
> 
> Review request for cloudstack, Chiradeep Vittal and Rohit Yadav.
> 
> 
> Repository: cloudstack-cloudmonkey
> 
> 
> Description
> ---
> 
> use signature version 3 for cloudmonkey api calls, with 600 seconds 
> expiration time as default. The expiration time is configurable via 
> .cloudmonkey/config
> 
> 
> Diffs
> -
> 
>   cloudmonkey/cloudmonkey.py b465bec 
>   cloudmonkey/config.py 2f91608 
>   cloudmonkey/requester.py b06e1fc 
> 
> Diff: https://reviews.apache.org/r/20390/diff/
> 
> 
> Testing
> ---
> 
> for 600 seconds expiration time and CST:
> now:  2014-04-15T16:36:46+ , expires:  2014-04-15T21:46:46+
> 
> 
> Thanks,
> 
> Yichi Lu
> 
>

Re: Instance on KVM + NFS fails

I am running this on a fresh install of 4.3, all from RPMs.

2014-04-16 06:44:54,992 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:job-30/job-33 ctx-c1a39369) Seq 5-968885921: Sending
{ Cmd , MgmtId: 345040294157, via: 5(rhelkvm1.demo.netapp.com), Ver: v1,
Flags: 100111, 
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache
.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.
com/templates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2","uuid
":"bb63ad7c-bbfc-11e3-bb63-00505601110d","id":3,"format":"QCOW2","accountId
":1,"checksum":"85a1bed07bf43cbf022451cb2ecae4ff","hvm":false,"displayText"
:"SystemVM Template
(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.
168.0.131/svm1_ccp_secondary","_role":"Image"}},"name":"routing-3","hypervi
sorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObject
TO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-
2014-01-14-master-kvm.qcow2.bz2","uuid":"bb63ad7c-bbfc-11e3-bb63-0050560111
0d","id":3,"format":"QCOW2","accountId":1,"checksum":"85a1bed07bf43cbf02245
1cb2ecae4ff","hvm":false,"displayText":"SystemVM Template
(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.
168.0.131/kvmPrimary","_role":"Primary","uuid":"9e3145ae-6074-4aa8-bbbf-05f
2d8f284be"}},"name":"routing-3","hypervisorType":"KVM"}},"executeInSequence
":true,"options":{},"wait":10800}}] }


David La Motta
Technical Marketing Engineer | Integrated Infrastructures

NetApp
Office: 1.919.476.5042
Mobile: 1.919.413.5600




On 4/16/14, 11:46 AM, "Marcus"  wrote:

>The 4.3 released RPMs work with my NFS tests for a fresh install. Is
>this a fresh install or an upgrade? What code are you running, both on
>mgmt server and agent (rpms, debs, or from source and commit hash)? Do
>you have a CopyCommand in the logs that shows the full JSON objects
>representing the NfsTO being passed? Example:
>
>2014-04-16 09:40:34,979 DEBUG [cloud.agent.Agent]
>(agentRequest-Handler-5:null) Request:Seq 1-946470950:  { Cmd ,
>MgmtId: 90520735907663, via: 1, Ver: v1, Flags: 100011,
>[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apach
>e.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/2/202/daf
>8a242-226a-391e-afab-25b9598cc5c1.qcow2","origUrl":"http://marcus.mlsorens
>en.com/cloudstack-extras/tiny-centos-63.qcow2","uuid":"b4f4e742-7099-4dca-
>a589-1c75e2199ba9","id":202,"format":"QCOW2","accountId":2,"checksum":"44c
>d0e6330a59f031460bc18a40c95a2","hvm":true,"displayText":"tiny","imageDataS
>tore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172.17.10.10/nfs/seco
>ndary","_role":"Image"}},"name":"202-2-f40033ea-61c3-3e02-823f-d279eeab3e4
>4","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.Te
>mplateObjectTO":{"origUrl":"http://marcus.mlsorensen.com/cloudstack-extras
>/tiny-centos-63.qcow2","uuid":"b4f4e742-7099-4dca-a589-1c75e2199ba9","id":
>202,"format":"QCOW2","accountId":2,"checksum":"44cd0e6330a59f031460bc18a40
>c95a2","hvm":true,"displayText":"tiny","imageDataStore":{"org.apache.cloud
>stack.storage.to.PrimaryDataStoreTO":{"uuid":"2fe9a944-505e-38cb-bf87-7262
>3634be4a","id":2,"poolType":"NetworkFilesystem","host":"172.17.10.10","pat
>h":"/nfs/primary","port":2049,"url":"NetworkFilesystem://172.17.10.10//nfs
>/primary/?ROLE=Primary&STOREUUID=2fe9a944-505e-38cb-bf87-72623634be4a"}},"
>name":"202-2-f40033ea-61c3-3e02-823f-d279eeab3e44","hypervisorType":"KVM"}
>},"executeInSequence":false,"options":{},"wait":10800}}]
>}
>
>On Wed, Apr 16, 2014 at 9:34 AM, Marcus  wrote:
>> I'm positive I tested one of the last RCs with NFS, but I'm running
>> through a fresh install with the release RPMs to see if I can
>> reproduce it.
>>
>> On Wed, Apr 16, 2014 at 9:25 AM, Yitao Jiang 
>>wrote:
>>> Hi, David
>>>
>>> Did u see anything wrong within kvm agent log file？
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Yitao
>>>
>>>
>>> 2014-04-16 22:59 GMT+08:00 La Motta, David :
>>>
 Hey everybody, I am trying to deploy a VM instance in KVM using NFS
for
 primary storage (on 4.3).  Unfortunately, this is the exception I am
 getting:

 2014-04-16 06:44:53,128 DEBUG [o.a.c.e.o.VolumeOrchestrator]
 (Work-Job-Executor-6:job-30/job-31 ctx-b83982e8) Unable to create
 Vol[4|vm=4|ROOT]:java.lang.ClassCastException:
 com.cloud.agent.api.to.NfsTO cannot be cast to
 org.apache.cloudstack.storage.to.PrimaryDataStoreTO
 at
 
com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrim
aryS
 torage(KVMStorageProcessor.java:150)
 at
 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(S
tora
 geSubsystemCommandHandlerBase.java:75)
 at
 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleSto
rage
 Commands(StorageSubsystemCommandHandlerBase.java:50)
 at
 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeReque

Re: Instance on KVM + NFS fails

Hi Jang, where exactly is that log file?  :-)


David La Motta
Technical Marketing Engineer | Integrated Infrastructures

NetApp
Office: 1.919.476.5042
Mobile: 1.919.413.5600




On 4/16/14, 11:25 AM, "Yitao Jiang"  wrote:

>Hi, David
>
>Did u see anything wrong within kvm agent log file？
>
>
>
>Thanks,
>
>Yitao
>
>
>2014-04-16 22:59 GMT+08:00 La Motta, David :
>
>> Hey everybody, I am trying to deploy a VM instance in KVM using NFS for
>> primary storage (on 4.3).  Unfortunately, this is the exception I am
>> getting:
>>
>> 2014-04-16 06:44:53,128 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>> (Work-Job-Executor-6:job-30/job-31 ctx-b83982e8) Unable to create
>> Vol[4|vm=4|ROOT]:java.lang.ClassCastException:
>> com.cloud.agent.api.to.NfsTO cannot be cast to
>> org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>> at
>> 
>>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimar
>>yS
>> torage(KVMStorageProcessor.java:150)
>> at
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Sto
>>ra
>> geSubsystemCommandHandlerBase.java:75)
>> at
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStora
>>ge
>> Commands(StorageSubsystemCommandHandlerBase.java:50)
>> at
>> 
>>com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest
>>(L
>> ibvirtComputingResource.java:1359)
>> at com.cloud.agent.Agent.processRequest(Agent.java:498)
>> at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
>> at com.cloud.utils.nio.Task.run(Task.java:83)
>> at
>> 
>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java
>>:1
>> 110)
>> at
>> 
>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav
>>a:
>> 603)
>> at java.lang.Thread.run(Thread.java:722)
>>
>>
>> Is this a known issue or are there any gotchas that I am overlooking?
>>
>> Thanks!
>>
>> // David
>>
>>
>> P.s., good to have seen some of you at CCCNA14 last week.  Looking
>>forward
>> to Budapest.
>>
>>

Re: Review Request 20410: CLOUDSTACK-6282 - Added automated tests for Instances API calls in test_escalations.py

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20410/#review40552
---

test/integration/component/test_escalations.py

Just Append the values to cleanup. The list is earlier initialized.

test/integration/component/test_escalations.py

Why cant we use the earlier created apiclient?

test/integration/component/test_escalations.py

Use @Desc and @Steps, instead of @summary.

test/integration/component/test_escalations.py

This is a self service case. We can remove the attribute provisioning.

test/integration/component/test_escalations.py

Why this case of list? We didnt verified the list is of zero size. The case 
mentions to see the size of vms increased by 1 post create, so size of 
virtualMachine.list post create should increse by 1, we verified it for None 
but not for empty list?

test/integration/component/test_escalations.py

There is a function to remove multiple assert inside utils, please use 
that, it verifies whether it is a list, none, empty, and returns the first 
element. This way much code can be removed from here.

test/integration/component/test_escalations.py

We just got the first vm. 

test/integration/component/test_escalations.py

why hard code hypervisor?

test/integration/component/test_escalations.py

Verify for the empty list as well.

test/integration/component/test_escalations.py

Verify for empty list with size 0.

test/integration/component/test_escalations.py

For all big if else, may be we can just verify it and assert before only, 
if not continue with our tests. The if else length is big.

test/integration/component/test_escalations.py

For all asserts pertaining to list, please use the verify function added in 
utils.

test/integration/component/test_escalations.py

Test Names requires better naming i believe. EX: update_vm does not signify 
its purpose.

- Santhosh Edukulla

On April 16, 2014, 8:29 a.m., Vinay Varma wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20410/
> ---
> 
> (Updated April 16, 2014, 8:29 a.m.)
> 
> 
> Review request for cloudstack and Santhosh Edukulla.
> 
> 
> Bugs: cloudstack-6282
> https://issues.apache.org/jira/browse/cloudstack-6282
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added automated tests for Instances API calls in test_escalations.py
> Modified an existing test for Volumes to handle the non-exists check
> Added few utility functions in base.py which are currently not present
> 
> 
> Diffs
> -
> 
>   test/integration/component/test_escalations.py f2ae801 
>   tools/marvin/marvin/lib/base.py 26f920e 
> 
> Diff: https://reviews.apache.org/r/20410/diff/
> 
> 
> Testing
> ---
> 
> Executed all the Added tests on both basic and Advance zones and attached the 
> results for the same
> 
> 
> File Attachments
> 
> 
> Advance Zone Results
>   
> https://reviews.apache.org/media/uploaded/files/2014/04/16/21eaf8f7-691f-4d4d-927b-0aadffe589ec__AdvZoneResults.txt
> Basic Zone Results
>   
> https://reviews.apache.org/media/uploaded/files/2014/04/16/f8754d7e-5fe3-48e6-bdfe-f822171b50cd__BasicZoneResults.txt
> 
> 
> Thanks,
> 
> Vinay Varma
> 
>

Re: Instance on KVM + NFS fails

Nevermind, I was looking in the wrong place.


[root@rhelkvm1 log]# cd cloudstack/
[root@rhelkvm1 cloudstack]# ll
total 4
drwxrwx---. 2 root root 4096 Apr 16 06:44 agent
[root@rhelkvm1 cloudstack]# cd agent/
[root@rhelkvm1 agent]# ll
total 16236
-rw-r--r--. 1 root root 2162 Apr 16 06:44 agent.log
-rw-r--r--. 1 root root 2782 Apr  2 03:19 agent.log.2014-04-01.gz
-rw-r--r--. 1 root root  678 Apr  3 08:01 agent.log.2014-04-02.gz
-rw-r--r--. 1 root root64535 Apr  4 00:00 agent.log.2014-04-03.gz
-rw-r--r--. 1 root root   152158 Apr  5 00:00 agent.log.2014-04-04.gz
-rw-r--r--. 1 root root   173710 Apr  6 00:00 agent.log.2014-04-05.gz
-rw-r--r--. 1 root root   157839 Apr  7 06:16 agent.log.2014-04-06.gz
-rw-r--r--. 1 root root21497 Apr 15 07:55 agent.log.2014-04-14.gz
-rw-r--r--. 1 root root 4737 Apr 16 06:44 agent.log.2014-04-15.gz
-rw-r--r--. 1 root root14614 Apr 16 06:44 cloudstack-agent.err
-rw-r--r--. 1 root root 15918896 Apr 16 06:44 cloudstack-agent.out
-rw-r--r--. 1 root root59198 Apr 16 09:00 security_group.log
-rw-r--r--. 1 root root15113 Apr  1 20:58 setup.log

[root@rhelkvm1 agent]# cat agent.log
2014-04-16 06:44:53,056 WARN  [cloud.agent.Agent]
(agentRequest-Handler-5:null) Caught:
java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be cast
to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
at 
com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
torage(KVMStorageProcessor.java:150)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
geSubsystemCommandHandlerBase.java:75)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
Commands(StorageSubsystemCommandHandlerBase.java:50)
at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(L
ibvirtComputingResource.java:1359)
at com.cloud.agent.Agent.processRequest(Agent.java:498)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
at com.cloud.utils.nio.Task.run(Task.java:83)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
603)
at java.lang.Thread.run(Thread.java:722)
2014-04-16 06:44:55,001 WARN  [cloud.agent.Agent]
(agentRequest-Handler-2:null) Caught:
java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be cast
to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
at 
com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
torage(KVMStorageProcessor.java:150)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
geSubsystemCommandHandlerBase.java:75)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
Commands(StorageSubsystemCommandHandlerBase.java:50)
at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(L
ibvirtComputingResource.java:1359)
at com.cloud.agent.Agent.processRequest(Agent.java:498)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
at com.cloud.utils.nio.Task.run(Task.java:83)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
603)
at java.lang.Thread.run(Thread.java:722)
[root@rhelkvm1 agent]#






David La Motta
Technical Marketing Engineer | Integrated Infrastructures

NetApp
Office: 1.919.476.5042
Mobile: 1.919.413.5600

   









On 4/16/14, 12:07 PM, "La Motta, David"  wrote:

>Hi Jang, where exactly is that log file?  :-)
>
>
>David La Motta
>Technical Marketing Engineer | Integrated Infrastructures
>
>NetApp
>Office: 1.919.476.5042
>Mobile: 1.919.413.5600
>
>
>
>
>On 4/16/14, 11:25 AM, "Yitao Jiang"  wrote:
>
>>Hi, David
>>
>>Did u see anything wrong within kvm agent log file？
>>
>>
>>
>>Thanks,
>>
>>Yitao
>>
>>
>>2014-04-16 22:59 GMT+08:00 La Motta, David :
>>
>>> Hey everybody, I am trying to deploy a VM instance in KVM using NFS for
>>> primary storage (on 4.3).  Unfortunately, this is the exception I am
>>> getting:
>>>
>>> 2014-04-16 06:44:53,128 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>> (Work-Job-Executor-6:job-30/job-31 ctx-b83982e8) Unable to create
>>> Vol[4|vm=4|ROOT]:java.lang.ClassCastException:
>>> com.cloud.agent.api.to.NfsTO cannot be cast to
>>> org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>>> at
>>> 
>>>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrima
>>>r
>>>yS
>>> torage(KVMStorageProcessor.java:150)
>>> at
>>> 
>>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(St
>>>o
>>>ra
>>> geSubsystemComm

Re: Instance on KVM + NFS fails

turn on debugging for the agent:

sed -i 's/INFO/DEBUG/g' /etc/cloudstack/agent/log4j-cloud.xml

then look in /var/log/cloudstack/agent/agent.log


On Wed, Apr 16, 2014 at 10:07 AM, La Motta, David
 wrote:
> Hi Jang, where exactly is that log file?  :-)
>
>
> David La Motta
> Technical Marketing Engineer | Integrated Infrastructures
>
> NetApp
> Office: 1.919.476.5042
> Mobile: 1.919.413.5600
>
>
>
>
> On 4/16/14, 11:25 AM, "Yitao Jiang"  wrote:
>
>>Hi, David
>>
>>Did u see anything wrong within kvm agent log file？
>>
>>
>>
>>Thanks,
>>
>>Yitao
>>
>>
>>2014-04-16 22:59 GMT+08:00 La Motta, David :
>>
>>> Hey everybody, I am trying to deploy a VM instance in KVM using NFS for
>>> primary storage (on 4.3).  Unfortunately, this is the exception I am
>>> getting:
>>>
>>> 2014-04-16 06:44:53,128 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>> (Work-Job-Executor-6:job-30/job-31 ctx-b83982e8) Unable to create
>>> Vol[4|vm=4|ROOT]:java.lang.ClassCastException:
>>> com.cloud.agent.api.to.NfsTO cannot be cast to
>>> org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>>> at
>>>
>>>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimar
>>>yS
>>> torage(KVMStorageProcessor.java:150)
>>> at
>>>
>>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Sto
>>>ra
>>> geSubsystemCommandHandlerBase.java:75)
>>> at
>>>
>>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStora
>>>ge
>>> Commands(StorageSubsystemCommandHandlerBase.java:50)
>>> at
>>>
>>>com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest
>>>(L
>>> ibvirtComputingResource.java:1359)
>>> at com.cloud.agent.Agent.processRequest(Agent.java:498)
>>> at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
>>> at com.cloud.utils.nio.Task.run(Task.java:83)
>>> at
>>>
>>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java
>>>:1
>>> 110)
>>> at
>>>
>>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav
>>>a:
>>> 603)
>>> at java.lang.Thread.run(Thread.java:722)
>>>
>>>
>>> Is this a known issue or are there any gotchas that I am overlooking?
>>>
>>> Thanks!
>>>
>>> // David
>>>
>>>
>>> P.s., good to have seen some of you at CCCNA14 last week.  Looking
>>>forward
>>> to Budapest.
>>>
>>>
>

Re: Instance on KVM + NFS fails

Just comparing your output to mine, your TemplateObjectTO has no
"path" attribute. This would suggest that the template does not exist
on your secondary storage (or perhaps CloudStack doesn't know about
it).

Also, something is bothering me here. It complains about
KVMStorageProcessor.java line 150, which is not casting to
PrimaryDataStoreTO. According to the 4.3.0 tarball, line 150 is
concerned with the TemplateObjectTO, secondary storage (source), not
primary storage (dest). This suggests that the code I'm looking at is
different from what you're running, at least on a superficial level.

Last, here's my primary storage definition as passed:

"imageDataStore": {
"org.apache.cloudstack.storage.to.PrimaryDataStoreTO": {
"uuid": "2fe9a944-505e-38cb-bf87-72623634be4a",
"id": 2,
"poolType": "NetworkFilesystem",
"host": "172.17.10.10",
"path": "/nfs/primary",
"port": 2049,
"url":
"NetworkFilesystem://172.17.10.10//nfs/primary/?ROLE=Primary&STOREUUID=2fe9a944-505e-38cb-bf87-72623634be4a"
}
},

And here is yours:

"imageDataStore": {
"com.cloud.agent.api.to.NfsTO": {
"_url": "nfs://192.168.0.131/kvmPrimary",
"_role": "Primary",
"uuid": "9e3145ae-6074-4aa8-bbbf-05f2d8f284be"
}
},

I'm not sure what the difference is, if we are both running 4.3. Are
you using the default storage driver for NFS, or a custom one? How did
you add the NFS primary storage, through an API call or through the UI
form?

On Wed, Apr 16, 2014 at 10:11 AM, La Motta, David
 wrote:
> Nevermind, I was looking in the wrong place.
>
>
> [root@rhelkvm1 log]# cd cloudstack/
> [root@rhelkvm1 cloudstack]# ll
> total 4
> drwxrwx---. 2 root root 4096 Apr 16 06:44 agent
> [root@rhelkvm1 cloudstack]# cd agent/
> [root@rhelkvm1 agent]# ll
> total 16236
> -rw-r--r--. 1 root root 2162 Apr 16 06:44 agent.log
> -rw-r--r--. 1 root root 2782 Apr  2 03:19 agent.log.2014-04-01.gz
> -rw-r--r--. 1 root root  678 Apr  3 08:01 agent.log.2014-04-02.gz
> -rw-r--r--. 1 root root64535 Apr  4 00:00 agent.log.2014-04-03.gz
> -rw-r--r--. 1 root root   152158 Apr  5 00:00 agent.log.2014-04-04.gz
> -rw-r--r--. 1 root root   173710 Apr  6 00:00 agent.log.2014-04-05.gz
> -rw-r--r--. 1 root root   157839 Apr  7 06:16 agent.log.2014-04-06.gz
> -rw-r--r--. 1 root root21497 Apr 15 07:55 agent.log.2014-04-14.gz
> -rw-r--r--. 1 root root 4737 Apr 16 06:44 agent.log.2014-04-15.gz
> -rw-r--r--. 1 root root14614 Apr 16 06:44 cloudstack-agent.err
> -rw-r--r--. 1 root root 15918896 Apr 16 06:44 cloudstack-agent.out
> -rw-r--r--. 1 root root59198 Apr 16 09:00 security_group.log
> -rw-r--r--. 1 root root15113 Apr  1 20:58 setup.log
>
> [root@rhelkvm1 agent]# cat agent.log
> 2014-04-16 06:44:53,056 WARN  [cloud.agent.Agent]
> (agentRequest-Handler-5:null) Caught:
> java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be cast
> to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
> at
> com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
> torage(KVMStorageProcessor.java:150)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
> geSubsystemCommandHandlerBase.java:75)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
> Commands(StorageSubsystemCommandHandlerBase.java:50)
> at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(L
> ibvirtComputingResource.java:1359)
> at com.cloud.agent.Agent.processRequest(Agent.java:498)
> at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
> at com.cloud.utils.nio.Task.run(Task.java:83)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
> 110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
> 603)
> at java.lang.Thread.run(Thread.java:722)
> 2014-04-16 06:44:55,001 WARN  [cloud.agent.Agent]
> (agentRequest-Handler-2:null) Caught:
> java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be cast
> to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
> at
> com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
> torage(KVMStorageProcessor.java:150)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
> geSubsystemCommandHandlerBase.java:75)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
> Commands(StorageSubsystemCommandHandlerBase.java:50)
> at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(L
> ibvirtComp

Re: Instance on KVM + NFS fails

Thanks, Marcus.   The virtual router can’t start, either.


2014-04-16 09:28:52,874 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4:null)
Found NFS storage pool 9e3145ae-6074-4aa8-bbbf-05f2d8f284be in libvirt,
continuing
2014-04-16 09:28:52,875 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4:null)
Executing: 
/usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/kvmheartbeat.sh -i
192.168.0.131 -p /kvmPrimary -m /mnt/9e3145ae-6074-4aa8-bbbf-05f2d8f284be
-h 192.168.0.66
2014-04-16 09:28:52,901 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4:null)
Execution is successful.
2014-04-16 09:28:53,485 DEBUG [kvm.resource.LibvirtComputingResource]
(UgentTask-2:null) Executing:
/usr/share/cloudstack-common/scripts/vm/network/security_group.py
get_rule_logs_for_vms
2014-04-16 09:28:53,623 DEBUG [kvm.resource.LibvirtComputingResource]
(UgentTask-2:null) Execution is successful.
2014-04-16 09:28:53,626 DEBUG [cloud.agent.Agent] (UgentTask-2:null)
Sending ping: Seq 5-2:  { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.PingRoutingWithNwGroupsCommand":{"newGroupStates":{}
,"newStates":{},"_hostVmStateReport":{},"_gatewayAccessible":true,"_vnetAcc
essible":true,"hostType":"Routing","hostId":5,"wait":0}}] }
2014-04-16 09:28:53,640 DEBUG [cloud.agent.Agent] (Agent-Handler-5:null)
Received response: Seq 5-2:  { Ans: , MgmtId: 345040294157, via: 5, Ver:
v1, Flags: 100010, 
[{"com.cloud.agent.api.PingAnswer":{"_command":{"hostType":"Routing","hostI
d":5,"wait":0},"result":true,"wait":0}}] }
2014-04-16 09:29:03,044 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-5:null) Request:Seq 5-6225930:  { Cmd , MgmtId:
345040294157, via: 5, Ver: v1, Flags: 100111,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache
.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/3/535b2e9
9-c2f9-37fa-9667-abdd091eee41.qcow2","origUrl":"http://download.cloud.com/t
emplates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2","uuid":"bb
63ad7c-bbfc-11e3-bb63-00505601110d","id":3,"format":"QCOW2","accountId":1,"
checksum":"85a1bed07bf43cbf022451cb2ecae4ff","hvm":false,"displayText":"Sys
temVM Template 
(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.
168.0.131/svm1_ccp_secondary
","_role":"Image"}},"name":"routin
g-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.T
emplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/system
vm64template-2014-01-14-master-kvm.qcow2.bz2","uuid":"bb63ad7c-bbfc-11e3-bb
63-00505601110d","id":3,"format":"QCOW2","accountId":1,"checksum":"85a1bed0
7bf43cbf022451cb2ecae4ff","hvm":false,"displayText":"SystemVM Template
(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.
168.0.131/kvmPrimary
","_role":"Primary","uuid":"9e3145ae-6074-
4aa8-bbbf-05f2d8f284be"}},"name":"routing-3","hypervisorType":"KVM"}},"exec
uteInSequence":true,"options":{},"wait":10800}}] }
2014-04-16 09:29:03,045 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-5:null) Processing command:
org.apache.cloudstack.storage.command.CopyCommand
2014-04-16 09:29:03,047 WARN  [cloud.agent.Agent]
(agentRequest-Handler-5:null) Caught:
java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be cast
to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
at 
com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
torage(KVMStorageProcessor.java:150)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
geSubsystemCommandHandlerBase.java:75)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
Commands(StorageSubsystemCommandHandlerBase.java:50)
at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(L
ibvirtComputingResource.java:1359)
at com.cloud.agent.Agent.processRequest(Agent.java:498)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
at com.cloud.utils.nio.Task.run(Task.java:83)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
603)
at java.lang.Thread.run(Thread.java:722)
2014-04-16 09:29:03,052 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-5:null) Seq 5-6225930:  { Ans: , MgmtId:
345040294157, via: 5, Ver: v1, Flags: 110,
[{"com.cloud.agent.api.Answer":{"result":false,"details":"java.lang.ClassCa
stException: com.cloud.agent.api.to.NfsTO cannot be cast to
org.apache.cloudstack.storage.to.PrimaryDataStoreTO\n\tat
com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
torage(KVMStorageProcessor.java:150)\n\tat
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
geSubsystemCommandHandlerBase.java:75)\n\tat
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
Commands(StorageSubsy

Re: Instance on KVM + NFS fails

Strange.

I added the NFS vol through the NetApp plugin, which created that Primary
Storage via API calls.

Let me give this a shot with a manually-added KVM Primary Storage.


David La Motta
Technical Marketing Engineer | Integrated Infrastructures

NetApp
Office: 1.919.476.5042
Mobile: 1.919.413.5600




On 4/16/14, 12:36 PM, "Marcus"  wrote:

>Just comparing your output to mine, your TemplateObjectTO has no
>"path" attribute. This would suggest that the template does not exist
>on your secondary storage (or perhaps CloudStack doesn't know about
>it).
>
>Also, something is bothering me here. It complains about
>KVMStorageProcessor.java line 150, which is not casting to
>PrimaryDataStoreTO. According to the 4.3.0 tarball, line 150 is
>concerned with the TemplateObjectTO, secondary storage (source), not
>primary storage (dest). This suggests that the code I'm looking at is
>different from what you're running, at least on a superficial level.
>
>Last, here's my primary storage definition as passed:
>
>"imageDataStore": {
>  
>"org.apache.cloudstack.storage.to.PrimaryDataStoreTO": {
>"uuid": "2fe9a944-505e-38cb-bf87-72623634be4a",
>"id": 2,
>"poolType": "NetworkFilesystem",
>"host": "172.17.10.10",
>"path": "/nfs/primary",
>"port": 2049,
>"url":
>"NetworkFilesystem://172.17.10.10//nfs/primary/?ROLE=Primary&STOREUUID=2fe
>9a944-505e-38cb-bf87-72623634be4a"
>}
>},
>
>And here is yours:
>
>"imageDataStore": {
>"com.cloud.agent.api.to.NfsTO": {
>"_url": "nfs://192.168.0.131/kvmPrimary",
>"_role": "Primary",
>"uuid": "9e3145ae-6074-4aa8-bbbf-05f2d8f284be"
>}
>},
>
>I'm not sure what the difference is, if we are both running 4.3. Are
>you using the default storage driver for NFS, or a custom one? How did
>you add the NFS primary storage, through an API call or through the UI
>form?
>
>On Wed, Apr 16, 2014 at 10:11 AM, La Motta, David
> wrote:
>> Nevermind, I was looking in the wrong place.
>>
>>
>> [root@rhelkvm1 log]# cd cloudstack/
>> [root@rhelkvm1 cloudstack]# ll
>> total 4
>> drwxrwx---. 2 root root 4096 Apr 16 06:44 agent
>> [root@rhelkvm1 cloudstack]# cd agent/
>> [root@rhelkvm1 agent]# ll
>> total 16236
>> -rw-r--r--. 1 root root 2162 Apr 16 06:44 agent.log
>> -rw-r--r--. 1 root root 2782 Apr  2 03:19 agent.log.2014-04-01.gz
>> -rw-r--r--. 1 root root  678 Apr  3 08:01 agent.log.2014-04-02.gz
>> -rw-r--r--. 1 root root64535 Apr  4 00:00 agent.log.2014-04-03.gz
>> -rw-r--r--. 1 root root   152158 Apr  5 00:00 agent.log.2014-04-04.gz
>> -rw-r--r--. 1 root root   173710 Apr  6 00:00 agent.log.2014-04-05.gz
>> -rw-r--r--. 1 root root   157839 Apr  7 06:16 agent.log.2014-04-06.gz
>> -rw-r--r--. 1 root root21497 Apr 15 07:55 agent.log.2014-04-14.gz
>> -rw-r--r--. 1 root root 4737 Apr 16 06:44 agent.log.2014-04-15.gz
>> -rw-r--r--. 1 root root14614 Apr 16 06:44 cloudstack-agent.err
>> -rw-r--r--. 1 root root 15918896 Apr 16 06:44 cloudstack-agent.out
>> -rw-r--r--. 1 root root59198 Apr 16 09:00 security_group.log
>> -rw-r--r--. 1 root root15113 Apr  1 20:58 setup.log
>>
>> [root@rhelkvm1 agent]# cat agent.log
>> 2014-04-16 06:44:53,056 WARN  [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Caught:
>> java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be
>>cast
>> to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>> at
>> 
>>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimar
>>yS
>> torage(KVMStorageProcessor.java:150)
>> at
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Sto
>>ra
>> geSubsystemCommandHandlerBase.java:75)
>> at
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStora
>>ge
>> Commands(StorageSubsystemCommandHandlerBase.java:50)
>> at
>> 
>>com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest
>>(L
>> ibvirtComputingResource.java:1359)
>> at com.cloud.agent.Agent.processRequest(Agent.java:498)
>> at 
>>com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
>> at com.cloud.utils.nio.Task.run(Task.java:83)
>> at
>> 
>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java
>>:1
>> 110)
>> at
>> 
>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav
>>a:
>> 603)
>> at java.lang.Thread.run(Thread.java:722)
>> 2014-04-16 06:44:55,001 WARN  [cloud.agent.Agent]
>> (agentRequest-Handler-2:null) Caught:
>> java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be
>>cast
>> to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>> at
>> 
>

Re: Instance on KVM + NFS fails

Yes, it wouldn't start without a disk :-)

On Wed, Apr 16, 2014 at 10:39 AM, La Motta, David
 wrote:
> Thanks, Marcus.   The virtual router can’t start, either.
>
>
> 2014-04-16 09:28:52,874 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4:null)
> Found NFS storage pool 9e3145ae-6074-4aa8-bbbf-05f2d8f284be in libvirt,
> continuing
> 2014-04-16 09:28:52,875 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4:null)
> Executing:
> /usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/kvmheartbeat.sh -i
> 192.168.0.131 -p /kvmPrimary -m /mnt/9e3145ae-6074-4aa8-bbbf-05f2d8f284be
> -h 192.168.0.66
> 2014-04-16 09:28:52,901 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4:null)
> Execution is successful.
> 2014-04-16 09:28:53,485 DEBUG [kvm.resource.LibvirtComputingResource]
> (UgentTask-2:null) Executing:
> /usr/share/cloudstack-common/scripts/vm/network/security_group.py
> get_rule_logs_for_vms
> 2014-04-16 09:28:53,623 DEBUG [kvm.resource.LibvirtComputingResource]
> (UgentTask-2:null) Execution is successful.
> 2014-04-16 09:28:53,626 DEBUG [cloud.agent.Agent] (UgentTask-2:null)
> Sending ping: Seq 5-2:  { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11,
> [{"com.cloud.agent.api.PingRoutingWithNwGroupsCommand":{"newGroupStates":{}
> ,"newStates":{},"_hostVmStateReport":{},"_gatewayAccessible":true,"_vnetAcc
> essible":true,"hostType":"Routing","hostId":5,"wait":0}}] }
> 2014-04-16 09:28:53,640 DEBUG [cloud.agent.Agent] (Agent-Handler-5:null)
> Received response: Seq 5-2:  { Ans: , MgmtId: 345040294157, via: 5, Ver:
> v1, Flags: 100010,
> [{"com.cloud.agent.api.PingAnswer":{"_command":{"hostType":"Routing","hostI
> d":5,"wait":0},"result":true,"wait":0}}] }
> 2014-04-16 09:29:03,044 DEBUG [cloud.agent.Agent]
> (agentRequest-Handler-5:null) Request:Seq 5-6225930:  { Cmd , MgmtId:
> 345040294157, via: 5, Ver: v1, Flags: 100111,
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache
> .cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/3/535b2e9
> 9-c2f9-37fa-9667-abdd091eee41.qcow2","origUrl":"http://download.cloud.com/t
> emplates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2","uuid":"bb
> 63ad7c-bbfc-11e3-bb63-00505601110d","id":3,"format":"QCOW2","accountId":1,"
> checksum":"85a1bed07bf43cbf022451cb2ecae4ff","hvm":false,"displayText":"Sys
> temVM Template
> (KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.
> 168.0.131/svm1_ccp_secondary
> ","_role":"Image"}},"name":"routin
> g-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.T
> emplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/system
> vm64template-2014-01-14-master-kvm.qcow2.bz2","uuid":"bb63ad7c-bbfc-11e3-bb
> 63-00505601110d","id":3,"format":"QCOW2","accountId":1,"checksum":"85a1bed0
> 7bf43cbf022451cb2ecae4ff","hvm":false,"displayText":"SystemVM Template
> (KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.
> 168.0.131/kvmPrimary
> ","_role":"Primary","uuid":"9e3145ae-6074-
> 4aa8-bbbf-05f2d8f284be"}},"name":"routing-3","hypervisorType":"KVM"}},"exec
> uteInSequence":true,"options":{},"wait":10800}}] }
> 2014-04-16 09:29:03,045 DEBUG [cloud.agent.Agent]
> (agentRequest-Handler-5:null) Processing command:
> org.apache.cloudstack.storage.command.CopyCommand
> 2014-04-16 09:29:03,047 WARN  [cloud.agent.Agent]
> (agentRequest-Handler-5:null) Caught:
> java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be cast
> to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
> at
> com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimaryS
> torage(KVMStorageProcessor.java:150)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stora
> geSubsystemCommandHandlerBase.java:75)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorage
> Commands(StorageSubsystemCommandHandlerBase.java:50)
> at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(L
> ibvirtComputingResource.java:1359)
> at com.cloud.agent.Agent.processRequest(Agent.java:498)
> at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
> at com.cloud.utils.nio.Task.run(Task.java:83)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
> 110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
> 603)
> at java.lang.Thread.run(Thread.java:722)
> 2014-04-16 09:29:03,052 DEBUG [cloud.agent.Agent]
> (agentRequest-Handler-5:null) Seq 5-6225930:  { Ans: , MgmtId:
> 345040294157, via: 5, Ver: v1, Flags: 110,
> [{"com.cloud.agent.api.Answer":{"result":false,"details":"java.lang.ClassCa
> stException: com.cloud.agent.api.to.NfsTO cannot be cast to
> org.apache.cloudstack.storage.to.PrimaryDataStoreTO\n\tat
> com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrim

RE: login API with MD5 is not working

2014-04-16 Thread Demetrius Tsitrelis

One problem is that the API documentation 
(https://cloudstack.apache.org/docs/api/apidocs-4.3/root_admin/login.html) 
still says that the password should be hashed.  The docs are out of date; send 
the password in plain text.

And - think about security.  DON'T use HTTP GET or the query parameters you 
send will be saved in the caches of all intermediate servers.  Also DO use 
HTTPS.

-Original Message-
From: Tejas Gadaria [mailto:refond.g...@gmail.com]
Sent: Tuesday, April 15, 2014 2:02 AM
To: dev@cloudstack.apache.org
Subject: login API with MD5 is not working

Hi,

I am trying to login in to CS 4.3 though login API.

I am passing MD5 hash (1st) in password that works fine with CS 4.0.2 but same 
doesn't works well with CS 4.3. Then I try to pass password in plain text ( 
2nd) & it worked, Is this a bug?

Both APIs are given below,


1)
http://10.129.151.55:8080/client/api?&command=login&username=admin&password=5f4dcc3b5aa765d61d8327deb882cf99


2)
http://10.129.151.55:8080/client/api?&command=login&username=admin&password=password

Regards,
Tejas


smime.p7s
Description: S/MIME cryptographic signature

Re: Instance on KVM + NFS fails

The instance creation worked on a manually created primary storage.  We’ll
take a look on our end to see what the difference is between manual vs.
API-created primary storage.

Thanks for the help.


David La Motta
Technical Marketing Engineer | Integrated Infrastructures

NetApp
Office: 1.919.476.5042
Mobile: 1.919.413.5600




On 4/16/14, 12:43 PM, "Marcus"  wrote:

>Yes, it wouldn't start without a disk :-)
>
>On Wed, Apr 16, 2014 at 10:39 AM, La Motta, David
> wrote:
>> Thanks, Marcus.   The virtual router can’t start, either.
>>
>>
>> 2014-04-16 09:28:52,874 DEBUG [kvm.resource.KVMHAMonitor]
>>(Thread-4:null)
>> Found NFS storage pool 9e3145ae-6074-4aa8-bbbf-05f2d8f284be in libvirt,
>> continuing
>> 2014-04-16 09:28:52,875 DEBUG [kvm.resource.KVMHAMonitor]
>>(Thread-4:null)
>> Executing:
>> /usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/kvmheartbeat.sh
>>-i
>> 192.168.0.131 -p /kvmPrimary -m
>>/mnt/9e3145ae-6074-4aa8-bbbf-05f2d8f284be
>> -h 192.168.0.66
>> 2014-04-16 09:28:52,901 DEBUG [kvm.resource.KVMHAMonitor]
>>(Thread-4:null)
>> Execution is successful.
>> 2014-04-16 09:28:53,485 DEBUG [kvm.resource.LibvirtComputingResource]
>> (UgentTask-2:null) Executing:
>> /usr/share/cloudstack-common/scripts/vm/network/security_group.py
>> get_rule_logs_for_vms
>> 2014-04-16 09:28:53,623 DEBUG [kvm.resource.LibvirtComputingResource]
>> (UgentTask-2:null) Execution is successful.
>> 2014-04-16 09:28:53,626 DEBUG [cloud.agent.Agent] (UgentTask-2:null)
>> Sending ping: Seq 5-2:  { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>> 
>>[{"com.cloud.agent.api.PingRoutingWithNwGroupsCommand":{"newGroupStates":
>>{}
>> 
>>,"newStates":{},"_hostVmStateReport":{},"_gatewayAccessible":true,"_vnetA
>>cc
>> essible":true,"hostType":"Routing","hostId":5,"wait":0}}] }
>> 2014-04-16 09:28:53,640 DEBUG [cloud.agent.Agent] (Agent-Handler-5:null)
>> Received response: Seq 5-2:  { Ans: , MgmtId: 345040294157, via: 5, Ver:
>> v1, Flags: 100010,
>> 
>>[{"com.cloud.agent.api.PingAnswer":{"_command":{"hostType":"Routing","hos
>>tI
>> d":5,"wait":0},"result":true,"wait":0}}] }
>> 2014-04-16 09:29:03,044 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Request:Seq 5-6225930:  { Cmd , MgmtId:
>> 345040294157, via: 5, Ver: v1, Flags: 100111,
>> 
>>[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apac
>>he
>> 
>>.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/3/535b2
>>e9
>> 
>>9-c2f9-37fa-9667-abdd091eee41.qcow2","origUrl":"http://download.cloud.com
>>/t
>> 
>>emplates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2","uuid":"
>>bb
>> 
>>63ad7c-bbfc-11e3-bb63-00505601110d","id":3,"format":"QCOW2","accountId":1
>>,"
>> 
>>checksum":"85a1bed07bf43cbf022451cb2ecae4ff","hvm":false,"displayText":"S
>>ys
>> temVM Template
>> 
>>(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://19
>>2.
>> 168.0.131/svm1_ccp_secondary
>> 
>>","_role":"Image"}},"name":"rout
>>in
>> 
>>g-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to
>>.T
>> 
>>emplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/syst
>>em
>> 
>>vm64template-2014-01-14-master-kvm.qcow2.bz2","uuid":"bb63ad7c-bbfc-11e3-
>>bb
>> 
>>63-00505601110d","id":3,"format":"QCOW2","accountId":1,"checksum":"85a1be
>>d0
>> 7bf43cbf022451cb2ecae4ff","hvm":false,"displayText":"SystemVM Template
>> 
>>(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://19
>>2.
>> 168.0.131/kvmPrimary
>> 
>>","_role":"Primary","uuid":"9e3145ae-607
>>4-
>> 
>>4aa8-bbbf-05f2d8f284be"}},"name":"routing-3","hypervisorType":"KVM"}},"ex
>>ec
>> uteInSequence":true,"options":{},"wait":10800}}] }
>> 2014-04-16 09:29:03,045 DEBUG [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Processing command:
>> org.apache.cloudstack.storage.command.CopyCommand
>> 2014-04-16 09:29:03,047 WARN  [cloud.agent.Agent]
>> (agentRequest-Handler-5:null) Caught:
>> java.lang.ClassCastException: com.cloud.agent.api.to.NfsTO cannot be
>>cast
>> to org.apache.cloudstack.storage.to.PrimaryDataStoreTO
>> at
>> 
>>com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.copyTemplateToPrimar
>>yS
>> torage(KVMStorageProcessor.java:150)
>> at
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Sto
>>ra
>> geSubsystemCommandHandlerBase.java:75)
>> at
>> 
>>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStora
>>ge
>> Commands(StorageSubsystemCommandHandlerBase.java:50)
>> at
>> 
>>com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest
>>(L
>> ibvirtComputingResource.java:1359)
>> at com.cloud.agent.Agent.processRequest(Agent.java:498)
>> at 
>>com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
>> at com.cloud.utils.nio.Task.run(Task.java:83)
>> at
>> 
>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecut

Re: Review Request 20316: CLOUDSTACK-1466: Adding "Domain Limits" and "Resize Volume" test suits for Primary Storage Limits


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20316/#review40563
---



test/integration/component/test_ps_domain_limits.py


where is this func defined? I couldnt see it in current common mod?



test/integration/component/test_ps_domain_limits.py


I believe codes and common module changes r missing



test/integration/component/test_ps_domain_limits.py


Please call teardown in case of exception.



test/integration/component/test_ps_domain_limits.py


Just check whether create is successful by verifying not None case and then 
add to clean up.



test/integration/component/test_ps_domain_limits.py


Not calling teardown in case of exception.



test/integration/component/test_ps_domain_limits.py


Its always 10, so may be we can remove this debug.



test/integration/component/test_ps_domain_limits.py


We didnt added it to clean up. Is that ok?



test/integration/component/test_ps_domain_limits.py


We are not adding it to cleanup?



test/integration/component/test_ps_domain_limits.py


I believe the tag is selfservice, not simulator.



test/integration/component/test_ps_domain_limits.py


Does clean up is not required here?



test/integration/component/test_ps_domain_limits.py


We can remove typecasting to int here.



test/integration/component/test_ps_resize_volume.py


Its not an issue though, just add one line of assert instead of if and 
fail, it  may reduce few lines of code.


- Santhosh Edukulla


On April 14, 2014, 10:22 a.m., Gaurav Aradhye wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20316/
> ---
> 
> (Updated April 14, 2014, 10:22 a.m.)
> 
> 
> Review request for cloudstack, Girish Shilamkar and Santhosh Edukulla.
> 
> 
> Bugs: CLOUDSTACK-1466
> https://issues.apache.org/jira/browse/CLOUDSTACK-1466
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Adding test suits in Primary Storage Limits test cases.
> 1)Domain Limits
> 2)Resize volume
> 
> 
> Diffs
> -
> 
>   test/integration/component/test_ps_domain_limits.py PRE-CREATION 
>   test/integration/component/test_ps_resize_volume.py PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/20316/diff/
> 
> 
> Testing
> ---
> 
> Yes
> 
> 
> Thanks,
> 
> Gaurav Aradhye
> 
>

Re: [ACS44] codefreeze in a couple of days

The biggest issue I have at the moment is an XmlRpcException with XenServer
(I've seen others e-mail about this, as well).

I'm pretty sure we changed our dependency on this JAR when XAPI was
changed, but then that code was reverted. I will probably try to wipe out
all of my dependencies and re-get them to see if that fixes the issue.

On Wed, Apr 16, 2014 at 6:13 AM, Daan Hoogland wrote:

> heads up;
>
> the official code-freeze date is friday the 18th of april (2014). in
> practice I will start branch 4.4-forward on saterday morning CET so
> COB on friday you can still submit to our present 4.4 branch. I will
> be taking over the task as primary point of contact from Hugo as of
> now. Please direct any popularity disclaimers to me from now on.
>
> kind regards,
> --
> Daan
>

-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*(tm)*

Re: Devcloud2 errors on 4.4

2014-04-16 Thread Amogh Vasekar

Let me know if you get it working, hasn't been for me.

Thanks,
Amogh

On 4/16/14 5:20 AM, "David Grizzanti" 
wrote:

>Didn't realize there was a new version of devcloud - thanks for the tip.
> Will try this out!
>
>
>On Wed, Apr 16, 2014 at 1:30 AM, Punith S  wrote:
>
>> hi,
>>
>> check whether you are using the new updated devcloud2(1.3GB) for 4.3
>> onwards!
>> ref - https://cwiki.apache.org/confluence/display/CLOUDSTACK/DevCloud
>>
>> and its recommended to use devcloud as host only mode.
>> thanks,
>>
>>
>>
>> On Wed, Apr 16, 2014 at 12:18 AM, David Grizzanti <
>> david.grizza...@sungard.com> wrote:
>>
>> > All,
>> >
>> > I am facing an issue when trying to get devcloud2 running with latest
>> code
>> > from 4.4 branch. There was a similar email to this a few weeks back on
>> > master, but I did not see any resolution.
>> >
>> > I'm running everything in side of devcloud2 (mgmt server, mysql, xen).
>> >
>> > Seeing the following errors when trying to deploy an initial zone.
>>Don't
>> > see any issues with creating the /opt/cloud/bin directory inside the
>>VM.
>> >
>> > WARN  [c.c.a.m.DirectAgentAttache] (DirectAgent-37:ctx-0d57a0bf) Seq
>> > 3-8906994163031998465: Exception Caught while executing command
>> > com.cloud.utils.exception.CloudRuntimeException: Cannot create
>>directory
>> > /opt/cloud/bin on XenServer hosts
>> > at
>> >
>> 
>>com.cloud.hypervisor.xen.resource.CitrixResourceBase.setupServer(CitrixRe
>>sourceBase.java:4842)
>> > at
>> >
>> 
>>com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResour
>>ceBase.java:4668)
>> > at
>> >
>> 
>>com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citri
>>xResourceBase.java:489)
>> > at
>> >
>> 
>>com.cloud.hypervisor.xen.resource.XcpOssResource.executeRequest(XcpOssRes
>>ource.java:176)
>> > at
>> >
>> 
>>com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentA
>>ttache.java:216)
>> > at
>> >
>> 
>>org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Manage
>>dContextRunnable.java:49)
>> > at
>> >
>> 
>>org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(D
>>efaultManagedContext.java:56)
>> > at
>> >
>> 
>>org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWith
>>Context(DefaultManagedContext.java:103)
>> > at
>> >
>> 
>>org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithC
>>ontext(DefaultManagedContext.java:53)
>> > at
>> >
>> 
>>org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedC
>>ontextRunnable.java:46)
>> > at
>> > 
>>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> > at
>> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>> > at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>> > at
>> >
>> 
>>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce
>>ss$201(ScheduledThreadPoolExecutor.java:178)
>> > at
>> >
>> 
>>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(
>>ScheduledThreadPoolExecutor.java:292)
>> > at
>> >
>> 
>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java
>>:1145)
>> > at
>> >
>> 
>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav
>>a:615)
>> > at java.lang.Thread.run(Thread.java:724)
>> > WARN  [c.c.h.x.d.XcpServerDiscoverer] (AgentTaskPool-13:ctx-5015bd03)
>> > Unable to setup agent 3 due to
>> > com.cloud.utils.exception.CloudRuntimeException: Cannot create
>>directory
>> > /opt/cloud/bin on XenServer hosts
>> > INFO  [c.c.u.e.CSExceptionErrorCode] (AgentTaskPool-13:ctx-5015bd03)
>> Could
>> > not find exception: com.cloud.exception.ConnectionException in error
>>code
>> > list for exceptions
>> > WARN  [c.c.a.m.AgentManagerImpl] (AgentTaskPool-13:ctx-5015bd03)
>>Monitor
>> > XcpServerDiscoverer says there is an error in the connect process for
>>3
>> due
>> > to Reinitialize agent after setup.
>> > INFO  [c.c.a.m.AgentManagerImpl] (AgentTaskPool-13:ctx-5015bd03) Host
>>3
>> is
>> > disconnecting with event AgentDisconnected
>> > WARN  [c.c.r.ResourceManagerImpl] (AgentTaskPool-13:ctx-5015bd03)
>>Unable
>> > to connect due to
>> > com.cloud.exception.ConnectionException: Reinitialize agent after
>>setup.
>> > at
>> >
>> 
>>com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.processConnect(Xc
>>pServerDiscoverer.java:658)
>> > at
>> >
>> 
>>com.cloud.agent.manager.AgentManagerImpl.notifyMonitorsOfConnection(Agent
>>ManagerImpl.java:514)
>> > at
>> >
>> 
>>com.cloud.agent.manager.AgentManagerImpl.handleDirectConnectAgent(AgentMa
>>nagerImpl.java:1428)
>> > at
>> >
>> 
>>com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManager
>>Impl.java:1767)
>> > at
>> >
>> 
>>com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManager
>>Im

[Merge]: marvin branch to master

Hi Team,

We would like to merge marvin branch changes to master. We did few changes as 
mentioned below. We rebased it against master and tested the changes we did. 

https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38570520


Thanks!
Santhosh

Re: [ACS4.5] move from xen 2 xenserver

2014-04-16 Thread Tim Mackey

Stephen,

I'm going to look into how to construct a test case for that, and here is
the wiki page covering the feature:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Convert+Xen+usage+to+XenServer

Please feel free to suggest additional test cases, and I'll add them to the
list.

-tim


On Wed, Apr 16, 2014 at 5:20 AM, Stephen Turner
wrote:

> Thanks, Tim, that's helpful. My question about API backwards compatibility
> was also whether any API arguments or return values are of the form "Xen"
> currently and would become "XenServer" after this change, for example
> because of changes in some parsing code.
>
> --
> Stephen Turner
>
>
> -Original Message-
> From: Tim Mackey [mailto:tmac...@gmail.com]
> Sent: 16 April 2014 01:31
> To: dev@cloudstack.apache.org
> Subject: Re: [ACS4.5] move from xen 2 xenserver
>
> This was a little more than a straight renaming, and I'll post all the
> changes to the wiki for review in the morning.  At a high level this patch
> did the following:
>
> - Move the old plugins/hypervisors/xen to /plugins/hypervisors/xenserver
> and change all namespaces to reflect the move (bulk of the work)
> - Change any DDL/DML containing "xen"/"Xen" to become "XenServer" (took
> care of both create and upgrade paths)
> - Change any display areas containing "Xen" to become "XenServer"
>
> iirc there was one API change in the network label.  It was
> xennetworklabel, and I updated it to become xenservernetworklabel.  Since I
> don't want to break backwards compatibility either, I'm open to how best to
> handle the situation.  Also would like to understand a test case I can use
> to validate.
>
> -tim
>
>
> On Tue, Apr 15, 2014 at 6:27 AM, Sebastien Goasguen  >wrote:
>
> >
> > On Apr 15, 2014, at 4:46 AM, Stephen Turner
> > 
> > wrote:
> >
> > > As I said in the previous threaed, I'm +1 on the principle. It will
> > avoid confusion between straight Xen and XenServer. It will also allow
> > us to offer a non-XenServer Xen implementation.
> > >
> > > Sebastien, as all the filenames have changed, it's not clear from
> > > the
> > diff whether this is just a straight renaming with no other changes.
> > Could you confirm that?
> > >
> >
> > That's what it looks like, basically it creates a 'xenserver' plugin I
> > know Tim has a prototype of Xen support as well, but it was not in
> > this commit it seems.
> >
> >
> > > Also, are there any backwards compatibility implications for the
> > > API? Or
> > did we already use "XenServer" instead of "Xen" there?
> > >
> >
> > In the CloudStack API ?
> >
> > We are probably using Xen as value in several api calls…so we will
> > need to check this carefully before any merge, we definitely don't
> > want to break backward compatibility, or if we do we will need to move
> > to 5.0
> >
> > > --
> > > Stephen Turner
> > >
> > >
> > > -Original Message-
> > > From: Sebastien Goasguen [mailto:run...@gmail.com]
> > > Sent: 15 April 2014 08:36
> > > To: dev@cloudstack.apache.org
> > > Subject: [ACS4.5] move from xen 2 xenserver
> > >
> > > Folks,
> > >
> > > I just applied a patch from Tim Mackey:
> > >
> > >
> > https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=74
> > 8b575af8a66c58b0d52e7457e4d4e1e875231f
> > >
> > > commit: 748b575af8a66c58b0d52e7457e4d4e1e875231f
> > >
> > > This followed a [PROPOSAL] thread [1]
> > >
> > > This was pushed into a separate branch: xen2server
> > >
> > > This is a significant change that we should get consensus on and
> > > merge
> > to master relatively quickly to avoid any conflicts later on.
> > >
> > > Basically, we have been treating xen and xenserver the same so far,
> > since the integration with Xen (i.e Xen Project) was/is done via xapi.
> > >
> > > There has been discussion to integrate with Xen using straight up
> > libvirt, by creating a new Xen agent probably based on the KVM agent
> > and there was some discussion to that effect in the Denver Hackathon.
> > >
> > > Making a clear split between Xen and Xenserver type of hypervisors
> > > will
> > help support different integration methods.
> > >
> > > I have asked Tim (in the review message) to create a wiki page,
> > discussing all of this, but I wanted to give a heads up that this just
> > hit the repo and that we should see a [MERGE] thread quickly.
> > >
> > > thoughts, flames ?
> > >
> > >
> > > [1] http://markmail.org/thread/yrl3ii7gqlaaexij
> > >
> > > -Sebastien
> > >
> >
> >
>

RE: [4.4]copy_vhd_from_secondarystorage is timing out

2014-04-16 Thread Anthony Xu

Just checked in a fix for this.
change xapitimeout to 600 second,
looks like we need to change some XAPI calls to Async before shorten the timeout

Anthony

From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
Sent: Wednesday, April 16, 2014 7:27 AM
To: Murali Reddy
Cc: Anthony Xu; dev@cloudstack.apache.org
Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out

This is a similar problem to what I sent an e-mail out about last night: 
XmlRpcException (Read timed out). For me it's happening when CitrixResourceBase 
issues SR.create.

This issue is currently blocking my testing progress and I'm not really sure 
who might be the right person to look into this.

Any thoughts on this anyone?

On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy 
mailto:murali.re...@citrix.com>> wrote:
System VM's are launching fine now after Anthony's fix. But user VM's are 
failing to get created with exception.

43275 2014-04-16 12:59:08,647 DEBUG [c.c.h.x.r.XenServerConnectionPool] 
(DirectAgent-137:ctx-4761cb0c) XmlRpcException for method: VDI.snapshot due to 
org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read timed out
43276 2014-04-16 12:59:08,647 WARN [c.c.h.x.r.XenServerStorageProcessor] 
(DirectAgent-137:ctx-4761cb0c) Catch Exception 
org.apache.xmlrpc.XmlRpcException for template + due to 
org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read timed out

org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read timed out
org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read timed out
at 
org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpcSunHttpTransport.java:99)
at 
org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:152)
at 
org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
at 
org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunHttpTransport.java:69)
at 
org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
at com.xensource.xenapi.Connection.dispatch(Connection.java:285)
at 
com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:456)
at com.xensource.xenapi.VDI.snapshot(VDI.java:1155)
at 
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:972)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:77)

From: Mike Tutkowski 
mailto:mike.tutkow...@solidfire.com>>
Date: Wednesday, 16 April 2014 12:35 AM
To: "dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Cc: Murali Reddy mailto:murali.re...@citrix.com>>

Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out

Hi Anthony,

Can you go into a bit more depth about copy_vhd_from_secondarystorage not being 
used with XenServer 6.2?

Does that mean "public Answer copyTemplateToPrimaryStorage(CopyCommand cmd)" in 
XenServerStorageProcessor is not called when XenServer 6.2 is in use?

I'm testing out a feature of mine for 4.4, but have only been using XenServer 
6.1 so far.

Thanks!
Mike

On Tue, Apr 15, 2014 at 12:44 PM, Anthony Xu 
mailto:xuefei...@citrix.com>> wrote:
Hi Murali,

It is caused by the commit, I tested the commit on XS 6.2 FOX, which doesn't 
use copy_vhd_from_secondarystorage, that's why I didn't see this issue.

Just disabled XAPI Event in 4.4 branch.

Thanks,
Anthony

-Original Message-
From: Murali Reddy
Sent: Tuesday, April 15, 2014 10:54 AM
To: dev@cloudstack.apache.org; Anthony Xu
Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out

I am still running into this issue. Alex reverted complete change replacing 
xapi.jar, which was also resulting XmlRpc exceptions but system VM's were 
launching fine after revert. I may be wrong but looking at the stack trace and 
recent commits, commit
9f44909e63a19b2b8034baa13b92e24ea2eb0227 (use event instead of poll for xapi 
async call in XS 6.2 and above to reduce the pressure on XAPI) may be causing 
this issue. Anthony can you please take a look?

On 14/04/14 8:12 AM, "Mike Tutkowski" 
mailto:mike.tutkow...@solidfire.com>> wrote:

>I was seeing a similar issue when XAPI was changed when I tried to
>create an SR.
>
>I wonder if that XAPI issue hasn't been fully resolved.
>
>
>On Sun, Apr 13, 2014 at 4:16 PM, Srikanteswararao Talluri <
>srikanteswararao.tall...@citrix.com>
> wrote:
>
>> Did anybody see this on latest 4.4?
>>
>>
>> 2014-04-14 00:01:34,305 DEBUG [c.c.h.x.r.XenServerConnectionPool]
>> (DirectAgent-71:ctx-12d9be59) XmlRpcException for method: even

RE: [4.4]copy_vhd_from_secondarystorage is timing out

2014-04-16 Thread Anthony Xu

I think you need to change value in DB configuration, changing the java code 
will not change the value in DB if the DB is already initialized.


+--+--+--+--+---+--+---+-+---++
| Advanced | DEFAULT  | AgentManager | xapiwait | 60| Time (in seconds) to 
wait for XAPI to return | NULL  | NULL| NULL  |  0 |

From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
Sent: Wednesday, April 16, 2014 11:09 AM
To: Anthony Xu
Cc: Murali Reddy; dev@cloudstack.apache.org
Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out

Thanks, Anthony

I will need to re-test. I changed that value from 60 to 600 last night and 
still saw an issue.

Maybe I'll just start over from scratch and see if all is well.

Thanks for the follow-up!

On Wed, Apr 16, 2014 at 12:05 PM, Anthony Xu 
mailto:xuefei...@citrix.com>> wrote:
Just checked in a fix for this.
change xapitimeout to 600 second,
looks like we need to change some XAPI calls to Async before shorten the timeout


Anthony

From: Mike Tutkowski 
[mailto:mike.tutkow...@solidfire.com]
Sent: Wednesday, April 16, 2014 7:27 AM
To: Murali Reddy
Cc: Anthony Xu; dev@cloudstack.apache.org

Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out

This is a similar problem to what I sent an e-mail out about last night: 
XmlRpcException (Read timed out). For me it's happening when CitrixResourceBase 
issues SR.create.

This issue is currently blocking my testing progress and I'm not really sure 
who might be the right person to look into this.

Any thoughts on this anyone?

On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy 
mailto:murali.re...@citrix.com>> wrote:
System VM's are launching fine now after Anthony's fix. But user VM's are 
failing to get created with exception.

43275 2014-04-16 12:59:08,647 DEBUG [c.c.h.x.r.XenServerConnectionPool] 
(DirectAgent-137:ctx-4761cb0c) XmlRpcException for method: VDI.snapshot due to 
org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read timed out
43276 2014-04-16 12:59:08,647 WARN [c.c.h.x.r.XenServerStorageProcessor] 
(DirectAgent-137:ctx-4761cb0c) Catch Exception 
org.apache.xmlrpc.XmlRpcException for template + due to 
org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read timed out

org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read timed out
org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read timed out
at 
org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpcSunHttpTransport.java:99)
at 
org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:152)
at 
org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
at 
org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunHttpTransport.java:69)
at 
org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
at com.xensource.xenapi.Connection.dispatch(Connection.java:285)
at 
com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:456)
at com.xensource.xenapi.VDI.snapshot(VDI.java:1155)
at 
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:972)
at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:77)

From: Mike Tutkowski 
mailto:mike.tutkow...@solidfire.com>>
Date: Wednesday, 16 April 2014 12:35 AM
To: "dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Cc: Murali Reddy mailto:murali.re...@citrix.com>>

Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out

Hi Anthony,

Can you go into a bit more depth about copy_vhd_from_secondarystorage not being 
used with XenServer 6.2?

Does that mean "public Answer copyTemplateToPrimaryStorage(CopyCommand cmd)" in 
XenServerStorageProcessor is not called when XenServer 6.2 is in use?

I'm testing out a feature of mine for 4.4, but have only been using XenServer 
6.1 so far.

Thanks!
Mike

On Tue, Apr 15, 2014 at 12:44 PM, Anthony Xu 
mailto:xuefei...@citrix.com>> wrote:
Hi Murali,

It is caused by the commit, I tested the commit on XS 6.2 FOX, which doesn't 
use copy_vhd_from_secondarystorage, that's why I didn't see this issue.

Just disabled XAPI Event in 4.4 branch.


Thanks,
Anthony






-Original Message-
From: Murali Reddy
Sent: Tuesday, April 15, 2014 10:54 AM
To: dev@cloudstack.apache.org; Anthony Xu
Subject: Re: [4.4]copy_vhd_from_secondarystorage is ti

Re: [4.4]copy_vhd_from_secondarystorage is timing out

Thanks, Anthony

I will need to re-test. I changed that value from 60 to 600 last night and
still saw an issue.

Maybe I'll just start over from scratch and see if all is well.

Thanks for the follow-up!


On Wed, Apr 16, 2014 at 12:05 PM, Anthony Xu  wrote:

>  Just checked in a fix for this.
>
> change xapitimeout to 600 second,
>
> looks like we need to change some XAPI calls to Async before shorten the
> timeout
>
>
>
>
>
> Anthony
>
>
>
> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
> *Sent:* Wednesday, April 16, 2014 7:27 AM
> *To:* Murali Reddy
> *Cc:* Anthony Xu; dev@cloudstack.apache.org
>
> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
>
>
>
> This is a similar problem to what I sent an e-mail out about last night:
> XmlRpcException (Read timed out). For me it's happening when
> CitrixResourceBase issues SR.create.
>
>
>
> This issue is currently blocking my testing progress and I'm not really
> sure who might be the right person to look into this.
>
>
>
> Any thoughts on this anyone?
>
>
>
> On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy 
> wrote:
>
> System VM's are launching fine now after Anthony's fix. But user VM's are
> failing to get created with exception.
>
>
>
> 43275 2014-04-16 12:59:08,647 DEBUG [c.c.h.x.r.XenServerConnectionPool]
> (DirectAgent-137:ctx-4761cb0c) XmlRpcException for method: VDI.snapshot due
> to org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
>
> 43276 2014-04-16 12:59:08,647 WARN [c.c.h.x.r.XenServerStorageProcessor]
> (DirectAgent-137:ctx-4761cb0c) Catch Exception
> org.apache.xmlrpc.XmlRpcException for template + due to
> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
>
>
>
> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
>
> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
>
> at
> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpcSunHttpTransport.java:99)
>
> at
> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:152)
>
> at
> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
>
> at
> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunHttpTransport.java:69)
>
> at
> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
>
> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
>
> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
>
> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
>
> at com.xensource.xenapi.Connection.dispatch(Connection.java:285)
>
> at
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:456)
>
> at com.xensource.xenapi.VDI.snapshot(VDI.java:1155)
>
> at
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:972)
>
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:77)
>
>
>
> *From: *Mike Tutkowski 
> *Date: *Wednesday, 16 April 2014 12:35 AM
> *To: *"dev@cloudstack.apache.org" 
> *Cc: *Murali Reddy 
>
>
> *Subject: *Re: [4.4]copy_vhd_from_secondarystorage is timing out
>
>
>
> Hi Anthony,
>
>
>
> Can you go into a bit more depth about copy_vhd_from_secondarystorage not
> being used with XenServer 6.2?
>
>
>
> Does that mean "public Answer copyTemplateToPrimaryStorage(CopyCommand
> cmd)" in XenServerStorageProcessor is not called when XenServer 6.2 is in
> use?
>
>
>
> I'm testing out a feature of mine for 4.4, but have only been using
> XenServer 6.1 so far.
>
>
>
> Thanks!
>
> Mike
>
>
>
> On Tue, Apr 15, 2014 at 12:44 PM, Anthony Xu  wrote:
>
> Hi Murali,
>
> It is caused by the commit, I tested the commit on XS 6.2 FOX, which
> doesn't use copy_vhd_from_secondarystorage, that's why I didn't see this
> issue.
>
> Just disabled XAPI Event in 4.4 branch.
>
>
> Thanks,
> Anthony
>
>
>
>
>
>
>
> -Original Message-
> From: Murali Reddy
> Sent: Tuesday, April 15, 2014 10:54 AM
> To: dev@cloudstack.apache.org; Anthony Xu
> Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out
>
>
> I am still running into this issue. Alex reverted complete change
> replacing xapi.jar, which was also resulting XmlRpc exceptions but system
> VM's were launching fine after revert. I may be wrong but looking at the
> stack trace and recent commits, commit
> 9f44909e63a19b2b8034baa13b92e24ea2eb0227 (use event instead of poll for
> xapi async call in XS 6.2 and above to reduce the pressure on XAPI) may be
> causing this issue. Anthony can you please take a look?
>
>
> On 14/04/14 8:12 AM, "Mike Tutkowski" 
> wrote:
>
> >I was seeing a similar issue when XAPI was changed when I tried to
> >create an SR.
> >
> >I wonder if that XAPI issue hasn't been fully resolved.
> >
> >
> >On Sun, Apr 13,

Re: [4.4]copy_vhd_from_secondarystorage is timing out

Ah, that's probably it. Thanks!


On Wed, Apr 16, 2014 at 12:11 PM, Anthony Xu  wrote:

>  I think you need to change value in DB configuration, changing the java
> code will not change the value in DB if the DB is already initialized.
>
>
>
>
>
>
> +--+--+--+--+---+--+---+-+---++
>
> | Advanced | DEFAULT  | AgentManager | xapiwait | 60| Time (in
> seconds) to wait for XAPI to return | NULL  | NULL| NULL
> |  0 |
>
>
>
> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
> *Sent:* Wednesday, April 16, 2014 11:09 AM
> *To:* Anthony Xu
> *Cc:* Murali Reddy; dev@cloudstack.apache.org
>
> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
>
>
>
> Thanks, Anthony
>
>
>
> I will need to re-test. I changed that value from 60 to 600 last night and
> still saw an issue.
>
>
>
> Maybe I'll just start over from scratch and see if all is well.
>
>
>
> Thanks for the follow-up!
>
>
>
> On Wed, Apr 16, 2014 at 12:05 PM, Anthony Xu  wrote:
>
> Just checked in a fix for this.
>
> change xapitimeout to 600 second,
>
> looks like we need to change some XAPI calls to Async before shorten the
> timeout
>
>
>
>
>
> Anthony
>
>
>
> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
> *Sent:* Wednesday, April 16, 2014 7:27 AM
> *To:* Murali Reddy
> *Cc:* Anthony Xu; dev@cloudstack.apache.org
>
>
> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
>
>
>
> This is a similar problem to what I sent an e-mail out about last night:
> XmlRpcException (Read timed out). For me it's happening when
> CitrixResourceBase issues SR.create.
>
>
>
> This issue is currently blocking my testing progress and I'm not really
> sure who might be the right person to look into this.
>
>
>
> Any thoughts on this anyone?
>
>
>
> On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy 
> wrote:
>
> System VM's are launching fine now after Anthony's fix. But user VM's are
> failing to get created with exception.
>
>
>
> 43275 2014-04-16 12:59:08,647 DEBUG [c.c.h.x.r.XenServerConnectionPool]
> (DirectAgent-137:ctx-4761cb0c) XmlRpcException for method: VDI.snapshot due
> to org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
>
> 43276 2014-04-16 12:59:08,647 WARN [c.c.h.x.r.XenServerStorageProcessor]
> (DirectAgent-137:ctx-4761cb0c) Catch Exception
> org.apache.xmlrpc.XmlRpcException for template + due to
> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
>
>
>
> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
>
> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
> timed out
>
> at
> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpcSunHttpTransport.java:99)
>
> at
> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:152)
>
> at
> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
>
> at
> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunHttpTransport.java:69)
>
> at
> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
>
> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
>
> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
>
> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
>
> at com.xensource.xenapi.Connection.dispatch(Connection.java:285)
>
> at
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:456)
>
> at com.xensource.xenapi.VDI.snapshot(VDI.java:1155)
>
> at
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:972)
>
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:77)
>
>
>
> *From: *Mike Tutkowski 
> *Date: *Wednesday, 16 April 2014 12:35 AM
> *To: *"dev@cloudstack.apache.org" 
> *Cc: *Murali Reddy 
>
>
> *Subject: *Re: [4.4]copy_vhd_from_secondarystorage is timing out
>
>
>
> Hi Anthony,
>
>
>
> Can you go into a bit more depth about copy_vhd_from_secondarystorage not
> being used with XenServer 6.2?
>
>
>
> Does that mean "public Answer copyTemplateToPrimaryStorage(CopyCommand
> cmd)" in XenServerStorageProcessor is not called when XenServer 6.2 is in
> use?
>
>
>
> I'm testing out a feature of mine for 4.4, but have only been using
> XenServer 6.1 so far.
>
>
>
> Thanks!
>
> Mike
>
>
>
> On Tue, Apr 15, 2014 at 12:44 PM, Anthony Xu  wrote:
>
> Hi Murali,
>
> It is caused by the commit, I tested the commit on XS 6.2 FOX, which
> doesn't use copy_vhd_from_secondarystorage, that's why I didn't see this
> issue.
>
> Just disabled XAPI Event in 4.4 branch.
>
>
> Thanks,
> Anthony
>
>
>
>
>
>
>
> -Original Message-
> From: Murali Reddy
> Sen

Re: [4.4]copy_vhd_from_secondarystorage is timing out

What I had done was change the xapiwait (or something like that) global
setting and then re-start my management server.


On Wed, Apr 16, 2014 at 12:19 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> Ah, that's probably it. Thanks!
>
>
> On Wed, Apr 16, 2014 at 12:11 PM, Anthony Xu  wrote:
>
>>  I think you need to change value in DB configuration, changing the java
>> code will not change the value in DB if the DB is already initialized.
>>
>>
>>
>>
>>
>>
>> +--+--+--+--+---+--+---+-+---++
>>
>> | Advanced | DEFAULT  | AgentManager | xapiwait | 60| Time (in
>> seconds) to wait for XAPI to return | NULL  | NULL| NULL
>> |  0 |
>>
>>
>>
>> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
>> *Sent:* Wednesday, April 16, 2014 11:09 AM
>> *To:* Anthony Xu
>> *Cc:* Murali Reddy; dev@cloudstack.apache.org
>>
>> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
>>
>>
>>
>> Thanks, Anthony
>>
>>
>>
>> I will need to re-test. I changed that value from 60 to 600 last night
>> and still saw an issue.
>>
>>
>>
>> Maybe I'll just start over from scratch and see if all is well.
>>
>>
>>
>> Thanks for the follow-up!
>>
>>
>>
>> On Wed, Apr 16, 2014 at 12:05 PM, Anthony Xu 
>> wrote:
>>
>> Just checked in a fix for this.
>>
>> change xapitimeout to 600 second,
>>
>> looks like we need to change some XAPI calls to Async before shorten the
>> timeout
>>
>>
>>
>>
>>
>> Anthony
>>
>>
>>
>> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
>> *Sent:* Wednesday, April 16, 2014 7:27 AM
>> *To:* Murali Reddy
>> *Cc:* Anthony Xu; dev@cloudstack.apache.org
>>
>>
>> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
>>
>>
>>
>> This is a similar problem to what I sent an e-mail out about last night:
>> XmlRpcException (Read timed out). For me it's happening when
>> CitrixResourceBase issues SR.create.
>>
>>
>>
>> This issue is currently blocking my testing progress and I'm not really
>> sure who might be the right person to look into this.
>>
>>
>>
>> Any thoughts on this anyone?
>>
>>
>>
>> On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy 
>> wrote:
>>
>> System VM's are launching fine now after Anthony's fix. But user VM's are
>> failing to get created with exception.
>>
>>
>>
>> 43275 2014-04-16 12:59:08,647 DEBUG [c.c.h.x.r.XenServerConnectionPool]
>> (DirectAgent-137:ctx-4761cb0c) XmlRpcException for method: VDI.snapshot due
>> to org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
>> timed out
>>
>> 43276 2014-04-16 12:59:08,647 WARN [c.c.h.x.r.XenServerStorageProcessor]
>> (DirectAgent-137:ctx-4761cb0c) Catch Exception
>> org.apache.xmlrpc.XmlRpcException for template + due to
>> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
>> timed out
>>
>>
>>
>> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
>> timed out
>>
>> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: Read
>> timed out
>>
>> at
>> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpcSunHttpTransport.java:99)
>>
>> at
>> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:152)
>>
>> at
>> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
>>
>> at
>> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunHttpTransport.java:69)
>>
>> at
>> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
>>
>> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
>>
>> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
>>
>> at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
>>
>> at com.xensource.xenapi.Connection.dispatch(Connection.java:285)
>>
>> at
>> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:456)
>>
>> at com.xensource.xenapi.VDI.snapshot(VDI.java:1155)
>>
>> at
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:972)
>>
>> at
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:77)
>>
>>
>>
>> *From: *Mike Tutkowski 
>> *Date: *Wednesday, 16 April 2014 12:35 AM
>> *To: *"dev@cloudstack.apache.org" 
>> *Cc: *Murali Reddy 
>>
>>
>> *Subject: *Re: [4.4]copy_vhd_from_secondarystorage is timing out
>>
>>
>>
>> Hi Anthony,
>>
>>
>>
>> Can you go into a bit more depth about copy_vhd_from_secondarystorage not
>> being used with XenServer 6.2?
>>
>>
>>
>> Does that mean "public Answer copyTemplateToPrimaryStorage(CopyCommand
>> cmd)" in XenServerStorageProcessor is not called when XenServer 6.2 is in
>> use?
>>
>>
>>
>> I'm testing out a feature of mine for 4.4, but have only been using
>> XenServer 6.1 so far.

Re: [4.4]copy_vhd_from_secondarystorage is timing out

Hi Anthony,

Would you be able to provide a bit more detail regarding what you were
talking about (below) with regards to copy_vhd_from_secondarystorage not
being used with XenServer 6.2?

Thanks!
Mike


On Tue, Apr 15, 2014 at 1:05 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> Hi Anthony,
>
> Can you go into a bit more depth about copy_vhd_from_secondarystorage not
> being used with XenServer 6.2?
>
> Does that mean "public Answer copyTemplateToPrimaryStorage(CopyCommand
> cmd)" in XenServerStorageProcessor is not called when XenServer 6.2 is in
> use?
>
> I'm testing out a feature of mine for 4.4, but have only been using
> XenServer 6.1 so far.
>
> Thanks!
> Mike
>
>
> On Tue, Apr 15, 2014 at 12:44 PM, Anthony Xu  wrote:
>
>> Hi Murali,
>>
>> It is caused by the commit, I tested the commit on XS 6.2 FOX, which
>> doesn't use copy_vhd_from_secondarystorage, that's why I didn't see this
>> issue.
>>
>> Just disabled XAPI Event in 4.4 branch.
>>
>>
>> Thanks,
>> Anthony
>>
>>
>>
>>
>>
>>
>> -Original Message-
>> From: Murali Reddy
>> Sent: Tuesday, April 15, 2014 10:54 AM
>> To: dev@cloudstack.apache.org; Anthony Xu
>> Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out
>>
>>
>> I am still running into this issue. Alex reverted complete change
>> replacing xapi.jar, which was also resulting XmlRpc exceptions but system
>> VM's were launching fine after revert. I may be wrong but looking at the
>> stack trace and recent commits, commit
>> 9f44909e63a19b2b8034baa13b92e24ea2eb0227 (use event instead of poll for
>> xapi async call in XS 6.2 and above to reduce the pressure on XAPI) may be
>> causing this issue. Anthony can you please take a look?
>>
>>
>> On 14/04/14 8:12 AM, "Mike Tutkowski" 
>> wrote:
>>
>> >I was seeing a similar issue when XAPI was changed when I tried to
>> >create an SR.
>> >
>> >I wonder if that XAPI issue hasn't been fully resolved.
>> >
>> >
>> >On Sun, Apr 13, 2014 at 4:16 PM, Srikanteswararao Talluri <
>> >srikanteswararao.tall...@citrix.com> wrote:
>> >
>> >> Did anybody see this on latest 4.4?
>> >>
>> >>
>> >> 2014-04-14 00:01:34,305 DEBUG [c.c.h.x.r.XenServerConnectionPool]
>> >> (DirectAgent-71:ctx-12d9be59) XmlRpcException for method: event.from
>> >>due to
>> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream:
>> >>Read  timed out
>> >>
>> >> 2014-04-14 00:01:34,305 WARN  [c.c.h.x.r.CitrixResourceBase]
>> >> (DirectAgent-71:ctx-12d9be59) callHostPlugin failed for cmd:
>> >> copy_vhd_from_secondarystorage with args mountpoint:
>> >>10.147.28.7:/export/home/talluri/psec/template/tmpl/1/1/,
>> >> sruuid: b3dd21aa-8e82-a923-ed29-ee58220d158b, namelabel:
>> >> cloud-8498d88f-be6b-41b6-bece-a58bbc1fbc32,  due to Failed to create
>> >>input
>> >> stream: Read timed out
>> >>
>> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream:
>> >> Read timed out
>> >>
>> >> at
>> >>
>> >>org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpcS
>> >>unH
>> >>ttpTransport.java:99)
>> >>
>> >> at
>> >>
>> >>org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStrea
>> >>mTr
>> >>ansport.java:152)
>> >>
>> >> at
>> >>
>> >>org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTra
>> >>nsp
>> >>ort.java:143)
>> >>
>> >> at
>> >>
>> >>org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSunH
>> >>ttp
>> >>Transport.java:69)
>> >>
>> >> at
>> >>
>> >>org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker
>> >>.ja
>> >>va:56)
>> >>
>> >> at
>> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
>> >>
>> >> at
>> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
>> >>
>> >> at
>> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
>> >>
>> >> at
>> >> com.xensource.xenapi.Connection.dispatch(Connection.java:285)
>> >>
>> >> at
>> >>
>> >>com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerCon
>> >>nec
>> >>tion.dispatch(XenServerConnectionPool.java:456)
>> >>
>> >> at com.xensource.xenapi.Event.properFrom(Event.java:310)
>> >>
>> >> at
>> >>
>> >>com.cloud.hypervisor.xen.resource.XenServer620Resource.waitForTask(Xen
>> >>Ser
>> >>ver620Resource.java:125)
>> >>
>> >> at
>> >>
>> >>com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPluginAsy
>> >>nc(
>> >>CitrixResourceBase.java:3558)
>> >>
>> >> at
>> >>
>> >>com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_f
>> >>rom
>> >>_secondarystorage(XenServerStorageProcessor.java:826)
>> >>
>> >> at
>> >>
>> >>com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTempla
>> >>teT
>> >>oPrimaryStorage(XenServerStorageProcessor.java:962)
>> >>
>> >> at
>> >>
>> >>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(
>> >>Sto
>> >>rageSubsystemCommandHandlerBase.java:77)
>> >>

RE: [4.4]copy_vhd_from_secondarystorage is timing out

2014-04-16 Thread Anthony Xu

Normally , SR.scan will not take too long, if SR.scan times out after 600 
seconds, I think there might be some problems with the SR,  I think you need to 
fix the SR issue first.
You can execute xe sr-scan in any XS hosts to see what's the problem.


Anthony

-Original Message-
From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] 
Sent: Wednesday, April 16, 2014 11:21 AM
To: Anthony Xu
Cc: Murali Reddy; dev@cloudstack.apache.org
Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out

What I had done was change the xapiwait (or something like that) global setting 
and then re-start my management server.


On Wed, Apr 16, 2014 at 12:19 PM, Mike Tutkowski < 
mike.tutkow...@solidfire.com> wrote:

> Ah, that's probably it. Thanks!
>
>
> On Wed, Apr 16, 2014 at 12:11 PM, Anthony Xu  wrote:
>
>>  I think you need to change value in DB configuration, changing the 
>> java code will not change the value in DB if the DB is already initialized.
>>
>>
>>
>>
>>
>>
>> +--+--+--+--+---+--+---+-+---++
>>
>> | Advanced | DEFAULT  | AgentManager | xapiwait | 60| Time (in
>> seconds) to wait for XAPI to return | NULL  | NULL| NULL
>> |  0 |
>>
>>
>>
>> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
>> *Sent:* Wednesday, April 16, 2014 11:09 AM
>> *To:* Anthony Xu
>> *Cc:* Murali Reddy; dev@cloudstack.apache.org
>>
>> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
>>
>>
>>
>> Thanks, Anthony
>>
>>
>>
>> I will need to re-test. I changed that value from 60 to 600 last 
>> night and still saw an issue.
>>
>>
>>
>> Maybe I'll just start over from scratch and see if all is well.
>>
>>
>>
>> Thanks for the follow-up!
>>
>>
>>
>> On Wed, Apr 16, 2014 at 12:05 PM, Anthony Xu 
>> wrote:
>>
>> Just checked in a fix for this.
>>
>> change xapitimeout to 600 second,
>>
>> looks like we need to change some XAPI calls to Async before shorten 
>> the timeout
>>
>>
>>
>>
>>
>> Anthony
>>
>>
>>
>> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
>> *Sent:* Wednesday, April 16, 2014 7:27 AM
>> *To:* Murali Reddy
>> *Cc:* Anthony Xu; dev@cloudstack.apache.org
>>
>>
>> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
>>
>>
>>
>> This is a similar problem to what I sent an e-mail out about last night:
>> XmlRpcException (Read timed out). For me it's happening when 
>> CitrixResourceBase issues SR.create.
>>
>>
>>
>> This issue is currently blocking my testing progress and I'm not 
>> really sure who might be the right person to look into this.
>>
>>
>>
>> Any thoughts on this anyone?
>>
>>
>>
>> On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy 
>> 
>> wrote:
>>
>> System VM's are launching fine now after Anthony's fix. But user VM's 
>> are failing to get created with exception.
>>
>>
>>
>> 43275 2014-04-16 12:59:08,647 DEBUG 
>> [c.c.h.x.r.XenServerConnectionPool]
>> (DirectAgent-137:ctx-4761cb0c) XmlRpcException for method: 
>> VDI.snapshot due to org.apache.xmlrpc.XmlRpcException: Failed to 
>> create input stream: Read timed out
>>
>> 43276 2014-04-16 12:59:08,647 WARN 
>> [c.c.h.x.r.XenServerStorageProcessor]
>> (DirectAgent-137:ctx-4761cb0c) Catch Exception 
>> org.apache.xmlrpc.XmlRpcException for template + due to
>> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: 
>> Read timed out
>>
>>
>>
>> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: 
>> Read timed out
>>
>> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: 
>> Read timed out
>>
>> at
>> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpc
>> SunHttpTransport.java:99)
>>
>> at
>> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStre
>> amTransport.java:152)
>>
>> at
>> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTr
>> ansport.java:143)
>>
>> at
>> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSun
>> HttpTransport.java:69)
>>
>> at
>> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorke
>> r.java:56)
>>
>> at 
>> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
>>
>> at 
>> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
>>
>> at 
>> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
>>
>> at com.xensource.xenapi.Connection.dispatch(Connection.java:285)
>>
>> at
>> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerCo
>> nnection.dispatch(XenServerConnectionPool.java:456)
>>
>> at com.xensource.xenapi.VDI.snapshot(VDI.java:1155)
>>
>> at
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTempl
>> ateToPrimaryStorage(XenServerStorageProcessor.java:972)
>>
>> at
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute
>> (StorageSubsystemCommandHandlerBase.java:77)
>>
>>
>>
>> *From: *Mike Tutkowski 
>> *Date: *Wedn

Re: [4.4]copy_vhd_from_secondarystorage is timing out

The interesting thing here is that this has always worked with my SAN until
I recently updated my CloudStack codebase.

Now SR.create actually seems to create the SR (as it did in the past), but
then it times out while doing a read.


On Wed, Apr 16, 2014 at 12:27 PM, Anthony Xu  wrote:

> Normally , SR.scan will not take too long, if SR.scan times out after 600
> seconds, I think there might be some problems with the SR,  I think you
> need to fix the SR issue first.
> You can execute xe sr-scan in any XS hosts to see what's the problem.
>
>
> Anthony
>
> -Original Message-
> From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
> Sent: Wednesday, April 16, 2014 11:21 AM
> To: Anthony Xu
> Cc: Murali Reddy; dev@cloudstack.apache.org
> Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out
>
> What I had done was change the xapiwait (or something like that) global
> setting and then re-start my management server.
>
>
> On Wed, Apr 16, 2014 at 12:19 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
> > Ah, that's probably it. Thanks!
> >
> >
> > On Wed, Apr 16, 2014 at 12:11 PM, Anthony Xu 
> wrote:
> >
> >>  I think you need to change value in DB configuration, changing the
> >> java code will not change the value in DB if the DB is already
> initialized.
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> +--+--+--+--+---+--+---+-+---++
> >>
> >> | Advanced | DEFAULT  | AgentManager | xapiwait | 60| Time (in
> >> seconds) to wait for XAPI to return | NULL  | NULL| NULL
> >> |  0 |
> >>
> >>
> >>
> >> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
> >> *Sent:* Wednesday, April 16, 2014 11:09 AM
> >> *To:* Anthony Xu
> >> *Cc:* Murali Reddy; dev@cloudstack.apache.org
> >>
> >> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
> >>
> >>
> >>
> >> Thanks, Anthony
> >>
> >>
> >>
> >> I will need to re-test. I changed that value from 60 to 600 last
> >> night and still saw an issue.
> >>
> >>
> >>
> >> Maybe I'll just start over from scratch and see if all is well.
> >>
> >>
> >>
> >> Thanks for the follow-up!
> >>
> >>
> >>
> >> On Wed, Apr 16, 2014 at 12:05 PM, Anthony Xu 
> >> wrote:
> >>
> >> Just checked in a fix for this.
> >>
> >> change xapitimeout to 600 second,
> >>
> >> looks like we need to change some XAPI calls to Async before shorten
> >> the timeout
> >>
> >>
> >>
> >>
> >>
> >> Anthony
> >>
> >>
> >>
> >> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
> >> *Sent:* Wednesday, April 16, 2014 7:27 AM
> >> *To:* Murali Reddy
> >> *Cc:* Anthony Xu; dev@cloudstack.apache.org
> >>
> >>
> >> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
> >>
> >>
> >>
> >> This is a similar problem to what I sent an e-mail out about last night:
> >> XmlRpcException (Read timed out). For me it's happening when
> >> CitrixResourceBase issues SR.create.
> >>
> >>
> >>
> >> This issue is currently blocking my testing progress and I'm not
> >> really sure who might be the right person to look into this.
> >>
> >>
> >>
> >> Any thoughts on this anyone?
> >>
> >>
> >>
> >> On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy
> >> 
> >> wrote:
> >>
> >> System VM's are launching fine now after Anthony's fix. But user VM's
> >> are failing to get created with exception.
> >>
> >>
> >>
> >> 43275 2014-04-16 12:59:08,647 DEBUG
> >> [c.c.h.x.r.XenServerConnectionPool]
> >> (DirectAgent-137:ctx-4761cb0c) XmlRpcException for method:
> >> VDI.snapshot due to org.apache.xmlrpc.XmlRpcException: Failed to
> >> create input stream: Read timed out
> >>
> >> 43276 2014-04-16 12:59:08,647 WARN
> >> [c.c.h.x.r.XenServerStorageProcessor]
> >> (DirectAgent-137:ctx-4761cb0c) Catch Exception
> >> org.apache.xmlrpc.XmlRpcException for template + due to
> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream:
> >> Read timed out
> >>
> >>
> >>
> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream:
> >> Read timed out
> >>
> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream:
> >> Read timed out
> >>
> >> at
> >> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpc
> >> SunHttpTransport.java:99)
> >>
> >> at
> >> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStre
> >> amTransport.java:152)
> >>
> >> at
> >> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTr
> >> ansport.java:143)
> >>
> >> at
> >> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSun
> >> HttpTransport.java:69)
> >>
> >> at
> >> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorke
> >> r.java:56)
> >>
> >> at
> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
> >>
> >> at
> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
> >>
> >> at
> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpc

[GitHub] cloudstack-docs-rn pull request: Update CS RelNotes 4.2.x to 4.3

Github user runseb commented on the pull request:

https://github.com/apache/cloudstack-docs-rn/pull/6#issuecomment-40636907
  
@simonfiddaman I presume that you have gone through the upgrade yourself 
step by step ?



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: [Merge]: marvin branch to master

2014-04-16 Thread David Nalley

You mention a change in ssh library? What did you change to?

--David

On Wed, Apr 16, 2014 at 1:48 PM, Santhosh Edukulla
 wrote:
> Hi Team,
>
> We would like to merge marvin branch changes to master. We did few changes as 
> mentioned below. We rebased it against master and tested the changes we did.
>
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38570520
>
>
> Thanks!
> Santhosh

[GitHub] cloudstack-docs-rn pull request: Update CS RelNotes 4.2.x to 4.3

Github user simonfiddaman commented on the pull request:

https://github.com/apache/cloudstack-docs-rn/pull/6#issuecomment-40637290

I've run through the 2.2.14, 4.0.1 and 4.1.1 upgrades. All suggestions were
based on this experience. I do have access to environments which can be
upgraded from 4.2.1 to 4.3.0, however.
On 16/04/2014 8:48 pm, "runseb"  wrote:

> @simonfiddaman  I presume that you have
> gone through the upgrade yourself step by step ?
>
> â
> Reply to this email directly or view it on 
GitHub
> .
>

---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack-docs-rn pull request: Update CS RelNotes 4.2.x to 4.3

Github user runseb commented on the pull request:

https://github.com/apache/cloudstack-docs-rn/pull/6#issuecomment-40637598
  
Did you test the 4.2.1 to 4.3.0 then ?

And I guess you are on ubuntu/Debian.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

RE: [Merge]: marvin branch to master

I mean marvin ssh module called sshClient.py.

Santhosh

From: David Nalley [da...@gnsa.us]
Sent: Wednesday, April 16, 2014 2:48 PM
To: dev@cloudstack.apache.org
Cc: Srikanteswararao Talluri
Subject: Re: [Merge]: marvin branch to master

You mention a change in ssh library? What did you change to?

--David

On Wed, Apr 16, 2014 at 1:48 PM, Santhosh Edukulla
 wrote:
> Hi Team,
>
> We would like to merge marvin branch changes to master. We did few changes as 
> mentioned below. We rebased it against master and tested the changes we did.
>
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38570520
>
>
> Thanks!
> Santhosh

[GitHub] cloudstack-docs-rn pull request: Update CS RelNotes 4.2.x to 4.3

Github user simonfiddaman commented on the pull request:

https://github.com/apache/cloudstack-docs-rn/pull/6#issuecomment-40638043
  
Not yet. Will run it in a test environment soon. 2.2.14 upgrade was CentOS,
4.x upgrades have been Ubuntu 12.04.
On 16/04/2014 8:54 pm, "runseb"  wrote:

> Did you test the 4.2.1 to 4.3.0 then ?
>
> And I guess you are on ubuntu/Debian.
>
> â
> Reply to this email directly or view it on 
GitHub
> .
>


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack-docs-rn pull request: Update CS RelNotes 4.2.x to 4.3

Github user runseb commented on the pull request:

https://github.com/apache/cloudstack-docs-rn/pull/6#issuecomment-40638561
  
Ok, I merged it. this pull request should get automatically closed once the 
github mirror gets updated.

thanks a lot for the patch, I am hoping you can keep on improving these 
upgrade instructions as they need lots of love.

Make sure to pull the latest once this commit has reached master, and 
submit anything in a fresh pull request.

thanks again


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack-docs-rn pull request: Update CS RelNotes 4.2.x to 4.3

Github user simonfiddaman commented on the pull request:

https://github.com/apache/cloudstack-docs-rn/pull/6#issuecomment-40638734
  
Thanks Seb, that's the plan (and the reason for the delay in submitting
this pull request). Simon
On 16/04/2014 9:02 pm, "runseb"  wrote:

> Ok, I merged it. this pull request should get automatically closed once
> the github mirror gets updated.
>
> thanks a lot for the patch, I am hoping you can keep on improving these
> upgrade instructions as they need lots of love.
>
> Make sure to pull the latest once this commit has reached master, and
> submit anything in a fresh pull request.
>
> thanks again
>
> â
> Reply to this email directly or view it on 
GitHub
> .
>


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack-docs-rn pull request: Update CS RelNotes 4.2.x to 4.3

Github user runseb commented on the pull request:

https://github.com/apache/cloudstack-docs-rn/pull/6#issuecomment-40638781
  
Oh and please watch out for trailing spaces...we actually need to fix all 
of those


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Review Request 20099: Domain-Account-User Sync Up Among Multiple Regions (Core Changes)

2014-04-16 Thread Alex Ough


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20099/
---

(Updated April 16, 2014, 7:06 p.m.)


Review request for cloudstack.


Changes
---

This is another update for core.


Repository: cloudstack-git


Description
---

This is the review request for the core changes related with #17790 that has 
only the new plugin codes.


Diffs (updated)
-

  api/src/com/cloud/event/EventTypes.java 39ef710 
  api/src/com/cloud/user/AccountService.java 7e37b38 
  api/src/org/apache/cloudstack/api/ApiConstants.java fdb4558 
  api/src/org/apache/cloudstack/api/BaseCmd.java f6f21ae 
  api/src/org/apache/cloudstack/api/command/admin/region/AddRegionCmd.java 
f6743ba 
  api/src/org/apache/cloudstack/api/command/admin/region/UpdateRegionCmd.java 
b08cbbb 
  api/src/org/apache/cloudstack/api/response/AccountResponse.java 2e50c51 
  api/src/org/apache/cloudstack/api/response/DomainResponse.java 0c0281e 
  api/src/org/apache/cloudstack/api/response/RegionResponse.java 6c74fa6 
  api/src/org/apache/cloudstack/api/response/UserResponse.java 40e1561 
  api/src/org/apache/cloudstack/region/Region.java df64e44 
  api/src/org/apache/cloudstack/region/RegionService.java afefcc7 
  api/test/org/apache/cloudstack/api/command/test/RegionCmdTest.java 10c3d85 
  client/pom.xml d8dbde7 
  
engine/schema/resources/META-INF/cloudstack/core/spring-engine-schema-core-daos-context.xml
 489b37d 
  engine/schema/src/org/apache/cloudstack/multiregion/RmapVO.java PRE-CREATION 
  engine/schema/src/org/apache/cloudstack/multiregion/RsyncVO.java PRE-CREATION 
  engine/schema/src/org/apache/cloudstack/multiregion/dao/RmapDao.java 
PRE-CREATION 
  engine/schema/src/org/apache/cloudstack/multiregion/dao/RmapDaoImpl.java 
PRE-CREATION 
  engine/schema/src/org/apache/cloudstack/multiregion/dao/RsyncDao.java 
PRE-CREATION 
  engine/schema/src/org/apache/cloudstack/multiregion/dao/RsyncDaoImpl.java 
PRE-CREATION 
  engine/schema/src/org/apache/cloudstack/region/RegionVO.java 608bd2b 
  
plugins/network-elements/juniper-contrail/test/org/apache/cloudstack/network/contrail/management/MockAccountManager.java
 957f708 
  plugins/pom.xml 9b391b8 
  
server/resources/META-INF/cloudstack/core/spring-server-core-managers-context.xml
 fc1c7e2 
  server/src/com/cloud/api/ApiDispatcher.java 95074e2 
  server/src/com/cloud/api/ApiResponseHelper.java 38f2f0b 
  server/src/com/cloud/api/dispatch/ParamProcessWorker.java e9bdd8b 
  server/src/com/cloud/api/query/dao/AccountJoinDaoImpl.java ecd97c7 
  server/src/com/cloud/api/query/dao/UserAccountJoinDaoImpl.java 923a238 
  server/src/com/cloud/event/ActionEventUtils.java 28e5680 
  server/src/com/cloud/multiregion/RsyncManager.java PRE-CREATION 
  server/src/com/cloud/multiregion/RsyncManagerImpl.java PRE-CREATION 
  server/src/com/cloud/projects/ProjectManagerImpl.java d10c059 
  server/src/com/cloud/user/AccountManager.java 03bf842 
  server/src/com/cloud/user/AccountManagerImpl.java 2070ee6 
  server/src/com/cloud/user/DomainManager.java f72b18a 
  server/src/com/cloud/user/DomainManagerImpl.java fbbe0c2 
  server/src/org/apache/cloudstack/region/RegionManager.java 6f25481 
  server/src/org/apache/cloudstack/region/RegionManagerImpl.java 8910714 
  server/src/org/apache/cloudstack/region/RegionServiceImpl.java 98cf500 
  server/test/com/cloud/api/dispatch/ParamProcessWorkerTest.java 12051a6 
  server/test/com/cloud/user/MockAccountManagerImpl.java f373cba 
  server/test/com/cloud/user/MockDomainManagerImpl.java 7dddefb 
  server/test/org/apache/cloudstack/networkoffering/ChildTestConfiguration.java 
22516c0 
  server/test/org/apache/cloudstack/region/RegionManagerTest.java d7bc537 
  setup/db/db/schema-440to450.sql 2bd5386 
  ui/scripts/regions.js 66dae8c 

Diff: https://reviews.apache.org/r/20099/diff/


Testing
---

1. Successfully tested real time synchronization as soon as resources are 
created/deleted/modified in one region.
2. Successfully tested full scans to synchronize resources that were missed 
during real time synchronization because of any reasons like network connection 
issues.
3. The tests were done manually and also automatically by randomly generating 
changes each region.


Thanks,

Alex Ough

Re: Review Request 17790: Domain-Account-User Sync Up Among Multiple Regions (New Plugin)

2014-04-16 Thread Alex Ough


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17790/
---

(Updated April 16, 2014, 7:07 p.m.)


Review request for cloudstack.


Changes
---

Another update for the new plugin.


Repository: cloudstack-git


Description
---

Currently, under the environment of cloudstack with multiple regions, each 
region has its own management server running with a separate database, which 
will cause data discrepancies when users create/update/delete 
domain/account/user data independently in each management server. So to support 
multiple regions and provide one point of entry for each customer, this 
implementation duplicates domain/account/user information of customers in one 
region to all of the regions independently whenever there is any change.

https://issues.apache.org/jira/browse/CLOUDSTACK-4992
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Domain-Account-User+Sync+Up+Among+Multiple+Regions


Diffs (updated)
-

  plugins/event-bus/multiregion/pom.xml PRE-CREATION 
  
plugins/event-bus/multiregion/resources/META-INF/cloudstack/spring-mom-multiregion-daos-context.xml
 PRE-CREATION 
  
plugins/event-bus/multiregion/resources/META-INF/cloudstack/system/spring-plugin-multiregion-system-context.xml
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/FullSyncer.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/InjectedCollection.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/MultiRegionEventBus.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/StringManipulator.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/api/AccountCaller.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/api/BaseCaller.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/api/DomainCaller.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/api/UserCaller.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/exception/APIFailureException.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/AccountFullSyncProcessor.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/AccountService.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/BaseService.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/DomainFullSyncProcessor.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/DomainService.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/FullScanner.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/FullSyncProcessor.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/LocalAccountManager.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/LocalDomainManager.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/LocalUserManager.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/RemoteAccountEventProcessor.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/RemoteDomainEventProcessor.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/RemoteEventProcessor.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/RemoteUserEventProcessor.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/UserFullSyncProcessor.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/service/UserService.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/simulator/SimulatorAccountLocalGenerator.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/simulator/SimulatorAccountLocalGeneratorEvent.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/simulator/SimulatorAutoGenerator.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/simulator/SimulatorDomainLocalGenerator.java
 PRE-CREATION 
  
plugins/event-bus/multiregion/src/org/apache/cloudstack/mom/multiregion/sim

Re: [DISCUSS]{BEHAVIORAL-CHANGE]Domain-Account-User Sync Up Among Multiple Regions

2014-04-16 Thread Alex Ough

Hi Alena,

It was a nice to actually meet you during the conference and I updated the
review requests, so please review them and let me know if there is anything
not expected.

Thanks
Alex Ough


On Thu, Apr 3, 2014 at 1:01 PM, Alex Ough  wrote:

> Well, I'm not sure about that because the help is about how to use @Inject
> in the Spring framework.
>
>
> On Thu, Apr 3, 2014 at 12:49 PM, Alena Prokharchyk <
> alena.prokharc...@citrix.com> wrote:
>
>>  Alex, please feel free to update Wiki docs related to the questions you
>> got Darren's help from. I think this info would be useful for all CS
>> committers.
>>
>>  Thank you,
>> Alena.
>>
>>   From: Alex Ough 
>> Date: Thursday, April 3, 2014 at 9:22 AM
>> To: Chiradeep Vittal , Alena Prokharchyk <
>> alena.prokharc...@citrix.com>, Darren Shepherd <
>> darren.sheph...@citrix.com>
>> Cc: "dev@cloudstack.apache.org" 
>>
>> Subject: Re: [DISCUSS]{BEHAVIORAL-CHANGE]Domain-Account-User Sync Up
>> Among Multiple Regions
>>
>>   Forgot to mention this, but it was a great help from Darren.
>> Thanks again, Darren!
>> Alex Ough
>>
>>
>> On Thu, Apr 3, 2014 at 11:56 AM, Alex Ough wrote:
>>
>>> All,
>>>
>>>  I updated the patches as per Alena's request.
>>>
>>>  Let me know if there is anything missing/incorrect.
>>> Thanks
>>>  Alex Ough
>>>
>>>
>>> On Wed, Mar 26, 2014 at 1:40 PM, Alex Ough wrote:
>>>
 Sorry, my bad. I mis-read your comment.

  Thanks for pointing it out.
  Alex Ough


 On Wed, Mar 26, 2014 at 12:25 PM, Chiradeep Vittal <
 chiradeep.vit...@citrix.com> wrote:

>  I didn't say "do not use auto wiring". I said the convention is to
> use @Inject which you didn't have.
>
>   From: Alena Prokharchyk 
> Date: Wednesday, March 26, 2014 at 7:39 AM
> To: Alex Ough , "dev@cloudstack.apache.org" <
> dev@cloudstack.apache.org>
> Cc: Chiradeep Vittal 
>
> Subject: Re: [DISCUSS]{BEHAVIORAL-CHANGE]Domain-Account-User Sync Up
> Among Multiple Regions
>
>   Alex, I'm attending a conference today, will review the patch
> tomorrow.
>
>  -Alena
>
>   From: Alex Ough 
> Date: Wednesday, March 26, 2014 at 6:35 AM
> To: Alena Prokharchyk 
> Cc: "dev@cloudstack.apache.org" ,
> Chiradeep Vittal 
> Subject: Re: [DISCUSS]{BEHAVIORAL-CHANGE]Domain-Account-User Sync Up
> Among Multiple Regions
>
>   Alena,
>
>  It took a little time to update the patch because I had a vacation
> last week.
> Now I uploaded the updated patch for review with below status, so
> please check them and let me know what you think.
> I hope it to be merged soon to wrap this up asap.
>
>  1. no change with waiting for comments on my recommendation.
>
>  2. The two things to turn on the sync-up among multiple regions is
> to change the class name of "eventNotificationBus" into
> "MultiRegionEventBus" from "RabbitMQEventBus" as below and change the 
> value
> of 'region.full.scan.interval' in Global Settings. And the new classes are
> never used unless the feature is turned on, so I'm not sure if auto wiring
> is necessary here and Chiradeep asked not to use @inject in his initial
> review, so I removed them.
>    class="org.apache.cloudstack.mom.rabbitmq.MultiRegionEventBus">
>
>  3. They are not adaptors, but inherited classes to process
> domain/account/user objects separately.
>
>  4. Done
>
>  5. Same
>
>  6. I removed 'domain path' from AccountResponse & UserResponse.
>
>  Thanks
> Alex Ough
>
>
> On Thu, Mar 13, 2014 at 9:48 PM, Alex Ough wrote:
>
>> What I think based on your comments are
>>
>>  1. Well, I have a different thought. I'd rather have separated
>> classes instead of having a class with lots of methods, which makes the
>> maintenance easier. And as you show as an example, it is possible to 
>> create
>> a method and merge them, but I think it is better to provide separate
>> methods that are exposed outside so that the callers can know what to 
>> call
>> with ease.
>>
>>  2. Let me look at that.
>>
>>  3. I'm not sure why you think they are adapters, but let me look at
>> that class.
>>
>>  4. OK, let me work on this.
>>
>>  5. The urls are stored in the region table along with username and
>> password. Please see 'RegionVO' under
>> 'engine/schema/src/org/apache/cloudstack/region'.
>>
>>  Thanks
>>  Alex Ough
>>
>>
>> On Thu, Mar 13, 2014 at 5:49 PM, Alena Prokharchyk <
>> alena.prokharc...@citrix.com> wrote:
>>
>>> Alex,
>>>
>>> There are so many classes, and it makes it hard to see/review the
>>> feature.
>>> Can you come up with some sort of visual diagram, so its easier to
>>> see
>>> which component is responsible for what task, and how they interact
>>> wi

Re: login API with MD5 is not working

2014-04-16 Thread Sebastien Goasguen


On Apr 16, 2014, at 12:56 PM, Demetrius Tsitrelis 
 wrote:

> One problem is that the API documentation 
> (https://cloudstack.apache.org/docs/api/apidocs-4.3/root_admin/login.html) 
> still says that the password should be hashed.  The docs are out of date; 
> send 
> the password in plain text.

Demetrius, can you give me the correct description for the apidoc ? 
I can make that change.

> 
> And - think about security.  DON'T use HTTP GET or the query parameters you 
> send will be saved in the caches of all intermediate servers.  Also DO use 
> HTTPS.
> 
> -Original Message-
> From: Tejas Gadaria [mailto:refond.g...@gmail.com]
> Sent: Tuesday, April 15, 2014 2:02 AM
> To: dev@cloudstack.apache.org
> Subject: login API with MD5 is not working
> 
> Hi,
> 
> I am trying to login in to CS 4.3 though login API.
> 
> I am passing MD5 hash (1st) in password that works fine with CS 4.0.2 but 
> same 
> doesn't works well with CS 4.3. Then I try to pass password in plain text ( 
> 2nd) & it worked, Is this a bug?
> 
> Both APIs are given below,
> 
> 
> 1)
> http://10.129.151.55:8080/client/api?&command=login&username=admin&password=5f4dcc3b5aa765d61d8327deb882cf99
> 
> 
> 2)
> http://10.129.151.55:8080/client/api?&command=login&username=admin&password=password
> 
> Regards,
> Tejas

Re: Review Request 19912: [CLOUDSTACK-6322] Fixed Contrail: Params validation is missing while launching a service instance thru cloudmonkey

2014-04-16 Thread Sachchidanand Vaidya

Yes. It's a bug. Also can the fix be committed to 4.4 as well.

Thanks & regards,
Sachin

From: daan Hoogland mailto:daan.hoogl...@gmail.com>>
Reply-To: daan Hoogland 
mailto:daan.hoogl...@gmail.com>>
Date: Wednesday, April 16, 2014 5:59 AM
To: daan Hoogland mailto:daan.hoogl...@gmail.com>>, 
Sachchidanand Vaidya mailto:vaidy...@juniper.net>>, 
cloudstack mailto:dev@cloudstack.apache.org>>
Subject: Re: Review Request 19912: [CLOUDSTACK-6322] Fixed Contrail: Params 
validation is missing while launching a service instance thru cloudmonkey

This is an automatically generated e-mail. To reply, visit: 
https://reviews.apache.org/r/19912/

On April 15th, 2014, 2:23 p.m. UTC, daan Hoogland wrote:

It would seem that this is a behavioral change that would break backwards 
compatibility, is it? Right now empty service names are accepted. What is the 
consequence and why change the behavior, can you shed light on the subject?

otherwise the change seems trivial enough and is applicable.

On April 15th, 2014, 8:33 p.m. UTC, Sachchidanand Vaidya wrote:

Hi Daan,

 If user passes "null" string during instance creation then it's an issue since 
we can't search service-instance with a null string as part of Fully Qualified 
Name lookup on Contrail Controller. Hence user can't delete a service-instance 
with "null" string. Passing empty string is functionally ok but we want to 
avoid both "null" and "empty" string since  it's not a good idea from 
usability/debugability point of view.

Thanks & Regards,
Sachin

ok, thanks. seems like a bug fix more then a behavioral change.

- daan

On April 2nd, 2014, 9:14 a.m. UTC, Sachchidanand Vaidya wrote:

Review request for cloudstack.
By Sachchidanand Vaidya.

Updated April 2, 2014, 9:14 a.m.

Repository: cloudstack-git
Description

Don't allow service instance creation with empty or null service-instance "name"

Testing

Unit tested for null and empty "name" parameter.

Diffs

  *   
plugins/network-elements/juniper-contrail/src/org/apache/cloudstack/network/contrail/api/command/CreateServiceInstanceCmd.java
 (d2cb4de)

View Diff

RE: login API with MD5 is not working

2014-04-16 Thread Demetrius Tsitrelis

There is already an open bug
(https://issues.apache.org/jira/browse/CLOUDSTACK-6311).  Essentially the
same wording for the password parameter should be used in login, CreateUser,
and UpdateUser: the password should be sent as clear text.

-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: Wednesday, April 16, 2014 12:16 PM
To: dev@cloudstack.apache.org
Subject: Re: login API with MD5 is not working


On Apr 16, 2014, at 12:56 PM, Demetrius Tsitrelis
 wrote:

> One problem is that the API documentation
> (https://cloudstack.apache.org/docs/api/apidocs-4.3/root_admin/login.h
> tml) still says that the password should be hashed.  The docs are out 
> of date; send the password in plain text.

Demetrius, can you give me the correct description for the apidoc ? 
I can make that change.

> 
> And - think about security.  DON'T use HTTP GET or the query 
> parameters you send will be saved in the caches of all intermediate 
> servers.  Also DO use HTTPS.
> 
> -Original Message-
> From: Tejas Gadaria [mailto:refond.g...@gmail.com]
> Sent: Tuesday, April 15, 2014 2:02 AM
> To: dev@cloudstack.apache.org
> Subject: login API with MD5 is not working
> 
> Hi,
> 
> I am trying to login in to CS 4.3 though login API.
> 
> I am passing MD5 hash (1st) in password that works fine with CS 4.0.2 
> but same doesn't works well with CS 4.3. Then I try to pass password 
> in plain text (
> 2nd) & it worked, Is this a bug?
> 
> Both APIs are given below,
> 
> 
> 1)
> http://10.129.151.55:8080/client/api?&command=login&username=admin&pas
> sword=5f4dcc3b5aa765d61d8327deb882cf99
> 
> 
> 2)
> http://10.129.151.55:8080/client/api?&command=login&username=admin&pas
> sword=password
> 
> Regards,
> Tejas



smime.p7s
Description: S/MIME cryptographic signature

[GitHub] cloudstack-docs-rn pull request: Update CS RelNotes 4.2.x to 4.3

2014-04-16 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack-docs-rn/pull/6


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: [DISCUSS]{BEHAVIORAL-CHANGE]Domain-Account-User Sync Up Among Multiple Regions

2014-04-16 Thread Alena Prokharchyk

Likewise, Alex.

Will review the patch tomorrow.

Thank you!
Alena.

On 4/16/14, 12:11 PM, "Alex Ough"  wrote:

>Hi Alena,
>
>
>It was a nice to actually meet you during the conference and I updated
>the review requests, so please review them and let me know if there is
>anything not expected.
>
>
>Thanks
>Alex Ough
>
>
>
>On Thu, Apr 3, 2014 at 1:01 PM, Alex Ough
> wrote:
>
>Well, I'm not sure about that because the help is about how to use
>@Inject in the Spring framework.
>
>
>On Thu, Apr 3, 2014 at 12:49 PM, Alena Prokharchyk
> wrote:
>
>Alex, please feel free to update Wiki docs related to the questions you
>got Darren’s help from. I think this info would be useful for all CS
>committers.
>
>
>Thank you, 
>Alena.
>
>
>From: Alex Ough 
>Date: Thursday, April 3, 2014 at 9:22 AM
>To: Chiradeep Vittal , Alena Prokharchyk
>,
> Darren Shepherd 
>Cc: "dev@cloudstack.apache.org" 
>
>Subject: Re: [DISCUSS]{BEHAVIORAL-CHANGE]Domain-Account-User Sync Up
>Among Multiple Regions
>
>
>
>
>
>Forgot to mention this, but it was a great help from Darren.
>Thanks again, Darren!
>Alex Ough
>
>
>
>On Thu, Apr 3, 2014 at 11:56 AM, Alex Ough
> wrote:
>
>All,
>
>
>I updated the patches as per Alena's request.
>
>
>Let me know if there is anything missing/incorrect.
>Thanks
>Alex Ough
>
>
>
>On Wed, Mar 26, 2014 at 1:40 PM, Alex Ough
> wrote:
>
>Sorry, my bad. I mis-read your comment.
>
>
>Thanks for pointing it out.
>Alex Ough
>
>
>
>On Wed, Mar 26, 2014 at 12:25 PM, Chiradeep Vittal
> wrote:
>
>I didn’t say “do not use auto wiring”. I said the convention is to use
>@Inject which you didn’t have.
>
>
>From: Alena Prokharchyk 
>Date: Wednesday, March 26, 2014 at 7:39 AM
>To: Alex Ough , "dev@cloudstack.apache.org"
>
>Cc: Chiradeep Vittal 
>
>Subject: Re: [DISCUSS]{BEHAVIORAL-CHANGE]Domain-Account-User Sync Up
>Among Multiple Regions
>
>
>
>
>
>Alex, I’m attending a conference today, will review the patch tomorrow.
>
>
>-Alena
>
>
>From: Alex Ough 
>Date: Wednesday, March 26, 2014 at 6:35 AM
>To: Alena Prokharchyk 
>Cc: "dev@cloudstack.apache.org" , Chiradeep
>Vittal 
>Subject: Re: [DISCUSS]{BEHAVIORAL-CHANGE]Domain-Account-User Sync Up
>Among Multiple Regions
>
>
>
>Alena,
>
>
>It took a little time to update the patch because I had a vacation last
>week.
>Now I uploaded the updated patch for review with below status, so please
>check them and let me know what you think.
>I hope it to be merged soon to wrap this up asap.
>
>
>1. no change with waiting for comments on my recommendation.
>
>
>2. The two things to turn on the sync-up among multiple regions is to
>change the class name of "eventNotificationBus" into
>"MultiRegionEventBus" from "RabbitMQEventBus" as below and change the
>value of 'region.full.scan.interval' in Global Settings. And
> the new classes are never used unless the feature is turned on, so I'm
>not sure if auto wiring is necessary here and Chiradeep asked not to use
>@inject in his initial review, so I removed them.
> class="org.apache.cloudstack.mom.rabbitmq.MultiRegionEventBus">
>
>
>
>3. They are not adaptors, but inherited classes to process
>domain/account/user objects separately.
>
>
>4. Done
>
>
>5. Same
>
>
>6. I removed 'domain path' from AccountResponse & UserResponse.
>
>
>Thanks
>Alex Ough
>
>
>
>
>
>On Thu, Mar 13, 2014 at 9:48 PM, Alex Ough
> wrote:
>
>What I think based on your comments are
>
>
>1. Well, I have a different thought. I'd rather have separated classes
>instead of having a class with lots of methods, which makes the
>maintenance easier. And as you show as an example, it is possible to
>create a method and merge them, but I think it is
> better to provide separate methods that are exposed outside so that the
>callers can know what to call with ease.
>
>
>2. Let me look at that.
>
>
>3. I'm not sure why you think they are adapters, but let me look at that
>class.
>
>
>4. OK, let me work on this.
>
>
>5. The urls are stored in the region table along with username and
>password. Please see 'RegionVO' under
>'engine/schema/src/org/apache/cloudstack/region'.
>
>
>Thanks
>Alex Ough
>
>
>
>On Thu, Mar 13, 2014 at 5:49 PM, Alena Prokharchyk
> wrote:
>
>Alex,
>
>There are so many classes, and it makes it hard to see/review the feature.
>Can you come up with some sort of visual diagram, so its easier to see
>which component is responsible for what task, and how they interact with
>each other.
>
>My suggestions:
>
>1) I think it would make sense to merge all the classes doing utils tasks
>(forming and sending Apis to CS) - UserInterface, AccountInterface,
>DomainInterface - to a single util class. They do return generic types
>anyway - JsonArray/JsonObject, and they do perform a generic util task -
>forming and sending the request to the CS. I would merge them all with the
>BaseInterface and name it with the name indicating that this class is
>responsible for sending API calls against CS. And this would be your util
>class.
>
>
>You should also come up with some generic method that for

java6 is installed instead of java7 when CloudStack rpm which build from master branch is installed with yum command.

2014-04-16 Thread Yoshikazu Nojima

Hi,

I found java6 is installed instead of java7 when CloudStack rpm which
build from master branch  is installed with yum command.

Rpm spec file specifies java 1.7.0 or later, but it doesn't work.
https://github.com/apache/cloudstack/commit/49a29

I confirmed my rpm has a requirement for java 1.7.0 or later.
I'm not familiar with rpm spec grammar, but I assume
requirement specification by virtual capability name doesn't accept
version specification. Is it accurate?

If my understanding is correct, I will create a patch to change
requirement from "java >= 1.7.0" to "java7".

===
yum install cloudstack-agent
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirror.keystealth.org
 * epel: mirrors.kernel.org
 * extras: mirror.keystealth.org
 * updates: mirror.keystealth.org
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package cloudstack-agent.x86_64 0:4.5.0-SNAPSHOT.el6 will be installed
--> Processing Dependency: java >= 1.7.0 for package:
cloudstack-agent-4.5.0-SNAPSHOT.el6.x86_64
--> Running transaction check
---> Package java-1.6.0-openjdk.x86_64 1:1.6.0.0-5.1.13.3.el6_5 will
be installed
--> Finished Dependency Resolution

Dependencies Resolved


 PackageArch   Version
Repository  Size

Installing:
 cloudstack-agent   x86_64 4.5.0-SNAPSHOT.el6
cloudstack  41 M
Installing for dependencies:
 java-1.6.0-openjdk x86_64 1:1.6.0.0-5.1.13.3.el6_5
updates 41 M

Transaction Summary

Install   2 Package(s)

Total download size: 82 M
Installed size: 122 M
Is this ok [y/N]:

===

rpm -qp --requires cloudstack-agent-4.5.0-SNAPSHOT.el6.x86_64.rpm
/bin/bash
/bin/sh
/bin/sh
/bin/sh
/usr/bin/python
bridge-utils
cloudstack-common = 4.5.0
config(cloudstack-agent) = 4.5.0-SNAPSHOT.el6
ebtables
ethtool
ipset
iptables
jakarta-commons-daemon
jakarta-commons-daemon-jsvc
java >= 1.7.0
jsvc
libvirt
libvirt-python
openssh-clients
perl
qemu-img
qemu-kvm
rpmlib(CompressedFileNames) <= 3.0.4-1
rpmlib(FileDigests) <= 4.6.0-1
rpmlib(PayloadFilesHavePrefix) <= 4.0-1
rpmlib(VersionedDependencies) <= 3.0.3-1
vconfig
rpmlib(PayloadIsXz) <= 5.2-1

Best practice: Do not use innerHtml() property or it's equivalent jQuery .html() method

2014-04-16 Thread Demetrius Tsitrelis

This property is used to dynamically insert HTML into the UI.  Unfortunately, 
it is easily abused because it accepts input such as

Jenkins build is back to normal : cloudstack-4.3-maven-build #522

See

Build failed in Jenkins: cloudstack-4.3-maven-build-noredist #416

See 


Changes:

[wido] CLOUDSTACK-4665: Depend on rados-java 0.1.4

[wido] CLOUDSTACK-4665: Check if a snapshot is protected before trying to 
unprotect

[wido] debian: Add JNA flag when starting agent

[wido] debian: cloudstack-management requires libmysql-java for SQL connection

[sheng.yang] CLOUDSTACK-6285: Fix savepassword.sh script for clear out old 
entries

--
[...truncated 3802 lines...]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResourceTest.testGetVmStat(LibvirtComputingResourceTest.java:423)

Running com.cloud.hypervisor.kvm.resource.LibvirtVifDriverTest
Tests run: 7, Failures: 0, Errors: 7, Skipped: 0, Time elapsed: 0.009 sec <<< 
FAILURE!
testDefaults(com.cloud.hypervisor.kvm.resource.LibvirtVifDriverTest)  Time 
elapsed: 0 sec  <<< ERROR!
java.lang.UnsupportedClassVersionError: com/ceph/rados/RadosException : 
Unsupported major.minor version 51.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
at 
com.cloud.hypervisor.kvm.resource.LibvirtVifDriverTest.setUp(LibvirtVifDriverTest.java:51)

testDefaultsWhenExplicitlySet(com.cloud.hypervisor.kvm.resource.LibvirtVifDriverTest)
  Time elapsed: 0 sec  <<< ERROR!
java.lang.UnsupportedClassVersionError: com/ceph/rados/RadosException : 
Unsupported major.minor version 51.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
at 
com.cloud.hypervisor.kvm.resource.LibvirtVifDriverTest.setUp(LibvirtVifDriverTest.java:51)

testWhenExplicitlySetDifferentDefault(com.cloud.hypervisor.kvm.resource.LibvirtVifDriverTest)
  Time elapsed: 0 sec  <<< ERROR!
java.lang.UnsupportedClassVersionError: com/ceph/rados/RadosException : 
Unsupported major.minor version 51.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
at 
com.cloud.hypervisor.kvm.resource.LibvirtVifDriverTest.setUp(LibvirtVifDriverTest.java:51)

testOverrideSomeTrafficTypes(com.cloud.hypervisor.kvm.resource.LibvirtVifDriverTest)
  Time elapsed: 0.001 sec  <<< ERROR!
java.lang.UnsupportedClassVersionError: com/ceph/rados/RadosException : 
Unsupported major.minor version 51.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLCla

Build failed in Jenkins: build-master #634

See 

--
[...truncated 1372 lines...]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
cloud-server ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 30 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ cloud-server 
---
[INFO] Compiling 360 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
cloud-server ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 29 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
cloud-server ---
[INFO] Compiling 85 source files to 

[INFO] 
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ cloud-server ---
[INFO] Surefire report directory: 


---
 T E S T S
---
Running com.cloud.event.EventControlsUnitTest
log4j:WARN No appenders could be found for logger 
(com.cloud.event.EventControlsUnitTest).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more 
info.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.691 sec
Running com.cloud.keystore.KeystoreTest
org.apache.cloudstack.api.response.UserVmResponse/null/{"id":"3","securitygroup":[],"nic":[],"tags":[],"affinitygroup":[]}
org.apache.cloudstack.api.response.AlertResponse/null/{"id":"100","description":"Hello"}
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.152 sec
Running com.cloud.alert.AlertControlsUnitTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.024 sec
Running com.cloud.capacity.CapacityManagerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.169 sec
Running com.cloud.resourcelimit.ResourceLimitManagerImplTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running com.cloud.network.firewall.FirewallManagerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.001 sec
Running com.cloud.network.UpdatePhysicalNetworkTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.226 sec
Running com.cloud.network.CreatePrivateNetworkTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.109 sec
Running com.cloud.network.NetworkModelTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.134 sec
Running com.cloud.network.security.SecurityGroupManagerImplTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.515 sec
Running com.cloud.network.security.SecurityGroupQueueTest
Total jobs dequeued = 10, num queued=1007 queue current size=997
Num Vms= 50 Queue size = 50
Num Vms= 2 Queue size = 2 time=573 ms
Num Vms= 5000 Queue size = 5000 time=1262 ms
Num Vms= 1 Queue size = 1 time=1 ms
Num Vms= 100 Queue size = 100 time=216 ms
Tests run: 4, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 2.497 sec <<< 
FAILURE!
Running com.cloud.network.vpc.VpcManagerImplTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec
Running com.cloud.network.DedicateGuestVlanRangesTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.055 sec
Running com.cloud.network.lb.AssignLoadBalancerTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.176 sec
Running com.cloud.network.dao.NetworkDaoTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running com.cloud.vm.DeploymentPlanningManagerImplTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.876 sec
Running com.cloud.vm.snapshot.VMSnapshotManagerTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.195 sec
Running com.cloud.vm.UserVmManagerTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.311 sec
Running com.cloud.configuration.ValidateIpRangeTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec
Running com.cloud.configuration.ConfigurationManagerTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec
Running com.cloud.server.ConfigurationServerImplTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec
Running com.cloud.template.TemplateManagerImplTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec
Running com.cloud.vpc.Site2SiteVpnTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.188 sec
Running com.cloud.vpc.NetworkACLServiceTest
T

Re: [4.4]copy_vhd_from_secondarystorage is timing out

Just to follow up on this, I wiped out all of my cached dependencies,
updated from upstream again, and ran

mvn -P developer,systemvm clean install -D noredist

and I am now able to create an SR.


On Wed, Apr 16, 2014 at 12:36 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> The interesting thing here is that this has always worked with my SAN
> until I recently updated my CloudStack codebase.
>
> Now SR.create actually seems to create the SR (as it did in the past), but
> then it times out while doing a read.
>
>
> On Wed, Apr 16, 2014 at 12:27 PM, Anthony Xu  wrote:
>
>> Normally , SR.scan will not take too long, if SR.scan times out after 600
>> seconds, I think there might be some problems with the SR,  I think you
>> need to fix the SR issue first.
>> You can execute xe sr-scan in any XS hosts to see what's the problem.
>>
>>
>> Anthony
>>
>> -Original Message-
>> From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
>> Sent: Wednesday, April 16, 2014 11:21 AM
>> To: Anthony Xu
>> Cc: Murali Reddy; dev@cloudstack.apache.org
>> Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out
>>
>> What I had done was change the xapiwait (or something like that) global
>> setting and then re-start my management server.
>>
>>
>> On Wed, Apr 16, 2014 at 12:19 PM, Mike Tutkowski <
>> mike.tutkow...@solidfire.com> wrote:
>>
>> > Ah, that's probably it. Thanks!
>> >
>> >
>> > On Wed, Apr 16, 2014 at 12:11 PM, Anthony Xu 
>> wrote:
>> >
>> >>  I think you need to change value in DB configuration, changing the
>> >> java code will not change the value in DB if the DB is already
>> initialized.
>> >>
>> >>
>> >>
>> >>
>> >>
>> >>
>> >>
>> +--+--+--+--+---+--+---+-+---++
>> >>
>> >> | Advanced | DEFAULT  | AgentManager | xapiwait | 60| Time (in
>> >> seconds) to wait for XAPI to return | NULL  | NULL| NULL
>> >> |  0 |
>> >>
>> >>
>> >>
>> >> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
>> >> *Sent:* Wednesday, April 16, 2014 11:09 AM
>> >> *To:* Anthony Xu
>> >> *Cc:* Murali Reddy; dev@cloudstack.apache.org
>> >>
>> >> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
>> >>
>> >>
>> >>
>> >> Thanks, Anthony
>> >>
>> >>
>> >>
>> >> I will need to re-test. I changed that value from 60 to 600 last
>> >> night and still saw an issue.
>> >>
>> >>
>> >>
>> >> Maybe I'll just start over from scratch and see if all is well.
>> >>
>> >>
>> >>
>> >> Thanks for the follow-up!
>> >>
>> >>
>> >>
>> >> On Wed, Apr 16, 2014 at 12:05 PM, Anthony Xu 
>> >> wrote:
>> >>
>> >> Just checked in a fix for this.
>> >>
>> >> change xapitimeout to 600 second,
>> >>
>> >> looks like we need to change some XAPI calls to Async before shorten
>> >> the timeout
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> Anthony
>> >>
>> >>
>> >>
>> >> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
>> >> *Sent:* Wednesday, April 16, 2014 7:27 AM
>> >> *To:* Murali Reddy
>> >> *Cc:* Anthony Xu; dev@cloudstack.apache.org
>> >>
>> >>
>> >> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out
>> >>
>> >>
>> >>
>> >> This is a similar problem to what I sent an e-mail out about last
>> night:
>> >> XmlRpcException (Read timed out). For me it's happening when
>> >> CitrixResourceBase issues SR.create.
>> >>
>> >>
>> >>
>> >> This issue is currently blocking my testing progress and I'm not
>> >> really sure who might be the right person to look into this.
>> >>
>> >>
>> >>
>> >> Any thoughts on this anyone?
>> >>
>> >>
>> >>
>> >> On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy
>> >> 
>> >> wrote:
>> >>
>> >> System VM's are launching fine now after Anthony's fix. But user VM's
>> >> are failing to get created with exception.
>> >>
>> >>
>> >>
>> >> 43275 2014-04-16 12:59:08,647 DEBUG
>> >> [c.c.h.x.r.XenServerConnectionPool]
>> >> (DirectAgent-137:ctx-4761cb0c) XmlRpcException for method:
>> >> VDI.snapshot due to org.apache.xmlrpc.XmlRpcException: Failed to
>> >> create input stream: Read timed out
>> >>
>> >> 43276 2014-04-16 12:59:08,647 WARN
>> >> [c.c.h.x.r.XenServerStorageProcessor]
>> >> (DirectAgent-137:ctx-4761cb0c) Catch Exception
>> >> org.apache.xmlrpc.XmlRpcException for template + due to
>> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream:
>> >> Read timed out
>> >>
>> >>
>> >>
>> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream:
>> >> Read timed out
>> >>
>> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream:
>> >> Read timed out
>> >>
>> >> at
>> >> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpc
>> >> SunHttpTransport.java:99)
>> >>
>> >> at
>> >> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStre
>> >> amTransport.java:152)
>> >>
>> >> at
>> >> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTr
>> >> ansport.java:143)
>> >

Re: [ACS4.4] Can't create an SR anymore (due to XmlRpcException)

I sent this info out on another e-mail thread, but figured I should follow
up here, as well:

Just to follow up on this, I wiped out all of my cached dependencies,
updated from upstream again, and ran

mvn -P developer,systemvm clean install -D noredist

and I am now able to create an SR.


On Tue, Apr 15, 2014 at 10:33 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> Just an FYI that this is not only a problem for managed storage (as I
> expected it wouldn't be).
>
> If you try to add primary storage to CloudStack for XenServer using an
> iSCSI target, it fails. You have to first create the SR from XenCenter (or
> xe) and then use the PreSetup "protocol" to introduce the storage to CS as
> primary storage.
>
> Is anyone else having trouble with XML RPC?
>
> Thanks
>
>
> On Tue, Apr 15, 2014 at 7:22 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> Hi,
>>
>> I have a problem that - at first - I thought was related to the XAPI
>> changes (although they were reverted and this problem seems to remain).
>>
>> I am no longer able to create an SR in CitrixResourceBase (getIscsiSR
>> method) as XmlRpcException is being thrown with the following text:
>>
>> Failed to create input stream: Read timed out
>> The "funny" part is that the SR does actually get created. However, due
>> to the exception being throw, an error is returned to CS by the XenServer
>> plug-in.
>>
>> Does anyone know anything about this?
>>
>> Thanks!
>>
>> --
>> *Mike Tutkowski*
>> *Senior CloudStack Developer, SolidFire Inc.*
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the 
>> cloud
>> *(tm)*
>>
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the 
> cloud
> *(tm)*
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*(tm)*

Jenkins build is back to normal : cloudstack-4.3-maven-build-noredist #417

See

Jenkins build is back to normal : build-master #635