date:20140623


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22807/#review46385
---


Commit bbcffbbab09905872a1b9c405a67734e457182fd in cloudstack's branch 
refs/heads/master from Anshul Gangwar
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=bbcffbb ]

CLOUDSTACK-6965: fixed the NullPointerException introduced by fix for cloudstack
6935 in AbstractStoragePoolAllocator#filter method for Zone Wide storage


- ASF Subversion and Git Services


On June 23, 2014, 5:30 a.m., Anshul Gangwar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22807/
> ---
> 
> (Updated June 23, 2014, 5:30 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh, Rajesh Battala, and Sateesh 
> Chodapuneedi.
> 
> 
> Bugs: CLOUDSTACK-6965
> https://issues.apache.org/jira/browse/CLOUDSTACK-6965
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Fix for CLOUDSTACK-6935 has introduced the NullPointerException in code. 
> Since ZoneWideStoragePoolAllocator's filter method has been removed it is 
> using AbstractStoragePoolAllocator's filter method.
> In the filter method there is check for cluster's hypervisor type and and 
> disk profile hypervisor type.
> But cluster is null for ZoneWideStoragePool and Hence the exception.
> 
> 
> Diffs
> -
> 
>   
> engine/storage/src/org/apache/cloudstack/storage/allocator/AbstractStoragePoolAllocator.java
>  2d958a6 
> 
> Diff: https://reviews.apache.org/r/22807/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Anshul Gangwar
> 
>

Re: Review Request 22808: CLOUDSTACK-6968: Allow Cluster scope volumes to attach to any VM


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22808/#review46384
---


Commit 6416de5770ad5579f78dc06ebc58bb0e4262c2c2 in cloudstack's branch 
refs/heads/master from Anshul Gangwar
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=6416de5 ]

CLOUDSTACK-6968: allowing cluster scope volumes to attach to any VM. If 
migration is
needed then first they will be migrated to appropriate cluster before attaching.


- ASF Subversion and Git Services


On June 23, 2014, 6:01 a.m., Anshul Gangwar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22808/
> ---
> 
> (Updated June 23, 2014, 6:01 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh, Rajesh Battala, and Sateesh 
> Chodapuneedi.
> 
> 
> Bugs: CLOUDSTACK-6968
> https://issues.apache.org/jira/browse/CLOUDSTACK-6968
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
>  allowing cluster scope volumes to attach to any VM. If migration is needed 
> then first they will be migrated to appropriate cluster before attaching
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/storage/VolumeApiServiceImpl.java 8a7b220 
> 
> Diff: https://reviews.apache.org/r/22808/diff/
> 
> 
> Testing
> ---
> 
> tested on my local setup
> 
> 
> Thanks,
> 
> Anshul Gangwar
> 
>

[ACS44] Cherry pick Request

2014-06-23 Thread Anshul Gangwar

Hi Daan/Hugo,



Can you please cherry-pick following commits from 4.4-forward to 4.4:


commit ef45f06f88c955dcf47f1fb69a3a0e87eb817e1d
Author: Anshul Gangwar 
Date:   Mon Jun 23 10:58:44 2014 +0530

CLOUDSTACK-6965: fixed the NullPointerException introduced by fix for 
cloudstack
6935 in AbstractStoragePoolAllocator#filter method for Zone Wide storage


commit e7ba46b5f7da21c4fc13dc3284aa802d177045f2
Author: Anshul Gangwar 
Date:   Fri Jun 20 16:35:06 2014 +0530

CLOUDSTACK-6968: Allowing cluster scope volumes to attach to any VM. If 
migration is
needed then first they will be migrated to appropriate cluster before 
attaching.

commit 64153a43711420224655bfbe248b4b87474a1f23
Author: Anshul Gangwar 
Date:   Fri Jun 20 14:32:05 2014 +0530

CLOUDSTACK-6830: Fixed [hyper-v] during VM migration, volumes on zone wide 
primary
store requires storage migration resulting in failure of VM migration. This 
also
improves the hostsformigration api. Firstly we were trying to list all 
hosts and
then finding suitable storage pools for all volumes and then we were 
checking
whether vm migration requires storage migration to that host. Now the 
process is
updated. We are checking for only those volumes which are not in zone wide 
primary
store. We are verifying by comparing volumes->poolid->clusterid to host 
clusterid.
If it uses local or clusterids are different then verifying whether host has
suitable storage pools for the volume of the vm to be migrated too.

Thanks,
Anshul

Re: Review Request 22807: CLOUDSTACK-6965: Fix for CLOUDSTACK-6935 introduces the NullPointerException in ZoneWideStorageAllocator filter method


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22807/#review46386
---


Commit 423c23af4052b29e908110d35978a4a720501448 in cloudstack's branch 
refs/heads/4.4 from Anshul Gangwar
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=423c23a ]

CLOUDSTACK-6965: fixed the NullPointerException introduced by fix for cloudstack
6935 in AbstractStoragePoolAllocator#filter method for Zone Wide storage

(cherry picked from commit ef45f06f88c955dcf47f1fb69a3a0e87eb817e1d)


- ASF Subversion and Git Services


On June 23, 2014, 5:30 a.m., Anshul Gangwar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22807/
> ---
> 
> (Updated June 23, 2014, 5:30 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh, Rajesh Battala, and Sateesh 
> Chodapuneedi.
> 
> 
> Bugs: CLOUDSTACK-6965
> https://issues.apache.org/jira/browse/CLOUDSTACK-6965
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Fix for CLOUDSTACK-6935 has introduced the NullPointerException in code. 
> Since ZoneWideStoragePoolAllocator's filter method has been removed it is 
> using AbstractStoragePoolAllocator's filter method.
> In the filter method there is check for cluster's hypervisor type and and 
> disk profile hypervisor type.
> But cluster is null for ZoneWideStoragePool and Hence the exception.
> 
> 
> Diffs
> -
> 
>   
> engine/storage/src/org/apache/cloudstack/storage/allocator/AbstractStoragePoolAllocator.java
>  2d958a6 
> 
> Diff: https://reviews.apache.org/r/22807/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Anshul Gangwar
> 
>

RE: Unable to delete virtual router

2014-06-23 Thread Suresh Sadhu

Yes.

-Original Message-
From: Tejas Gadaria [mailto:refond.g...@gmail.com] 
Sent: 23 June 2014 12:53
To: us...@cloudstack.apache.org
Cc: dev@cloudstack.apache.org
Subject: Re: Unable to delete virtual router

Hi,

Should I update the state in "networks" table in cloud db ?

Regards,
Tejas


On Mon, Jun 23, 2014 at 12:46 PM, Suresh Sadhu 
wrote:

>
> HI,
>
> It looks your network in stuck in transition state(implementing) as 
> log clearly says it should either implemented or allocate .
>
> You can  update the network state in db as implemented  and perform 
> again network restart with cleanup option.
>
> -sadhu
>
>
> -Original Message-
> From: Tejas Gadaria [mailto:refond.g...@gmail.com]
> Sent: 23 June 2014 12:10
> To: dev@cloudstack.apache.org
> Cc: us...@cloudstack.apache.org
> Subject: Re: Unable to delete virtual router
>
> Hi,
>
> After restarting the Network it says, "Network is not in the right 
> state to be restarted. Correct states are: Implemented, Setup"
>
>
> 2014-06-23 12:04:29,112 DEBUG [c.c.h.d.HostDaoImpl] 
> (ClusteredAgentManager
> Timer:ctx-993ca065) Completed acquiring hosts for clusters not owned 
> by any management server
> 2014-06-23 12:04:29,269 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-15:null) Ping from 3
> 2014-06-23 12:04:32,755 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-393:ctx-d0977fbe) Ping from 1(swiftproxy-xen1)
> 2014-06-23 12:04:33,101 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-11:ctx-dc604cdc) ===START===  192.168.160.192 -- GET
>
> command=restartNetwork&cleanup=true&id=099ff395-9196-43ab-a1e2-cd368db
> e3c75&cleanup=true&response=json&sessionkey=ecSt5VOMl2wgsZtnAYbNEfbh8%
> 2Bk%3D&_=1403505273057
> 2014-06-23 12:04:33,127 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-12:null) SeqA 4-91008: Processing Seq 4-91008:  
> { Cmd , MgmtId: -1, via: 4, Ver: v1, Flags: 11, 
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":3,
> "_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
> 2014-06-23 12:04:33,291 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-12:null) SeqA 4-91008: Sending Seq 4-91008:  { 
> Ans: ,
> MgmtId: 64342918221735, via: 4, Ver: v1, Flags: 100010, 
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] 
> }
> 2014-06-23 12:04:33,404 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
> (catalina-exec-11:ctx-dc604cdc ctx-6b97cb9e) submit async job-167, details:
> AsyncJobVO {id:167, userId: 2, accountId: 2, instanceType: None,
> instanceId: null, cmd:
> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd, cmdInfo:
>
> {"response":"json","id":"099ff395-9196-43ab-a1e2-cd368dbe3c75","sessio
> nkey":"ecSt5VOMl2wgsZtnAYbNEfbh8+k\u003d","cleanup":"true","cmdEventTy
> pe":"NETWORK.RESTART","ctxUserId":"2","httpmethod":"GET","_":"14035052
> 73057","ctxAccountId":"2","ctxStartEventId":"605"},
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 64342918221735, completeMsid: null, lastUpdated:
> null, lastPolled: null, created: null}
> 2014-06-23 12:04:33,405 INFO  [o.a.c.f.j.i.AsyncJobMonitor]
> (Job-Executor-11:ctx-587064a4) Add job-167 into job monitoring
> 2014-06-23 12:04:33,406 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Job-Executor-11:ctx-587064a4) Executing AsyncJobVO {id:167, userId: 
> 2,
> accountId: 2, instanceType: None, instanceId: null, cmd:
> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd, cmdInfo:
>
> {"response":"json","id":"099ff395-9196-43ab-a1e2-cd368dbe3c75","sessio
> nkey":"ecSt5VOMl2wgsZtnAYbNEfbh8+k\u003d","cleanup":"true","cmdEventTy
> pe":"NETWORK.RESTART","ctxUserId":"2","httpmethod":"GET","_":"14035052
> 73057","ctxAccountId":"2","ctxStartEventId":"605"},
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 64342918221735, completeMsid: null, lastUpdated:
> null, lastPolled: null, created: null}
> 2014-06-23 12:04:33,407 DEBUG [c.c.a.ApiServlet] 
> (catalina-exec-11:ctx-dc604cdc ctx-6b97cb9e) ===END===  
> 192.168.160.192 -- GET
>
> command=restartNetwork&cleanup=true&id=099ff395-9196-43ab-a1e2-cd368db
> e3c75&cleanup=true&response=json&sessionkey=ecSt5VOMl2wgsZtnAYbNEfbh8%
> 2Bk%3D&_=1403505273057
> 2014-06-23 12:04:33,538 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (Job-Executor-11:ctx-587064a4) Unexpected exception while executing 
> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
> com.cloud.exception.InvalidParameterValueException: Network is not in 
> the right state to be restarted. Correct states are: Implemented, Setup
> at
>
> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:1832)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>
> Regards,
> Tejas
>
>
> On Mon, Jun 23, 2014 at 12:03 PM, Tejas Gadaria 
> 
> wrote:
>
> > I am using CS 4.3.
> >
> > Before restarting the Guest network, Network state : Implementing I 
> > will post logs once i will restart the Netwo

Re: Review Request 22808: CLOUDSTACK-6968: Allow Cluster scope volumes to attach to any VM


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22808/#review46387
---


Commit 1b1a417bb43f507cf920b99b3c0d5ebca97c1724 in cloudstack's branch 
refs/heads/4.4 from Anshul Gangwar
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=1b1a417 ]

CLOUDSTACK-6968: Allowing cluster scope volumes to attach to any VM. If 
migration is
needed then first they will be migrated to appropriate cluster before attaching.

(cherry picked from commit e7ba46b5f7da21c4fc13dc3284aa802d177045f2)


- ASF Subversion and Git Services


On June 23, 2014, 6:01 a.m., Anshul Gangwar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22808/
> ---
> 
> (Updated June 23, 2014, 6:01 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh, Rajesh Battala, and Sateesh 
> Chodapuneedi.
> 
> 
> Bugs: CLOUDSTACK-6968
> https://issues.apache.org/jira/browse/CLOUDSTACK-6968
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
>  allowing cluster scope volumes to attach to any VM. If migration is needed 
> then first they will be migrated to appropriate cluster before attaching
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/storage/VolumeApiServiceImpl.java 8a7b220 
> 
> Diff: https://reviews.apache.org/r/22808/diff/
> 
> 
> Testing
> ---
> 
> tested on my local setup
> 
> 
> Thanks,
> 
> Anshul Gangwar
> 
>

Re: [ACS44] Cherry pick Request

On Mon, Jun 23, 2014 at 9:43 AM, Anshul Gangwar
 wrote:
...
> commit ef45f06f88c955dcf47f1fb69a3a0e87eb817e1d
is in

> commit e7ba46b5f7da21c4fc13dc3284aa802d177045f2
is in

> commit 64153a43711420224655bfbe248b4b87474a1f23
conflicts, will have a look in a minute

Build failed in Jenkins: build-master #1006

See 

Changes:

[Devdeep Singh] CLOUDSTACK-6968: allowing cluster scope volumes to attach to 
any VM. If migration is

[Devdeep Singh] CLOUDSTACK-6965: fixed the NullPointerException introduced by 
fix for cloudstack

--
[...truncated 21803 lines...]
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
cloud-plugin-hypervisor-ovm ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ 
cloud-plugin-hypervisor-ovm ---
[INFO] Surefire report directory: 


---
 T E S T S
---

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Plugin - Open vSwitch 4.5.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ 
cloud-plugin-network-ovs ---
[INFO] Deleting 

 (includes = [target, dist], excludes = [])
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-plugin-network-ovs ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-plugin-network-ovs ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
cloud-plugin-network-ovs ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ 
cloud-plugin-network-ovs ---
[INFO] Compiling 33 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
cloud-plugin-network-ovs ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
cloud-plugin-network-ovs ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ 
cloud-plugin-network-ovs ---
[INFO] Surefire report directory: 


---
 T E S T S
---

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Plugin - Hypervisor XenServer 4.5.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ 
cloud-plugin-hypervisor-xenserver ---
[INFO] Deleting 

 (includes = [target, dist], excludes = [])
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-plugin-hypervisor-xenserver ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-plugin-hypervisor-xenserver ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
cloud-plugin-hypervisor-xenserver ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 4 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ 
cloud-plugin-hypervisor-xenserver ---
[INFO] Compiling 24 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
cloud-plugin-hypervisor-xenserver ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
cloud-plugin-hypervisor-xenserver ---
[INFO] C

Re: Unable to delete virtual router

2014-06-23 Thread Tejas Gadaria

Hi,

I am getting the similar log after deleting the Network it says "Unable to
destroy network because of virtual router" & VR is in expunging state.

2014-06-23 13:02:21,589 WARN  [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Job-Executor-16:ctx-011048ba ctx-55af37fa) Unable to apply ip association,
virtual router is not in the right state Expunging
2014-06-23 13:02:21,594 DEBUG [c.c.n.IpAddressManagerImpl]
(Job-Executor-16:ctx-011048ba ctx-55af37fa) Resource is not available:
VirtualRouter
com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1]
is unreachable: Unable to apply ip association, virtual router is not in
the right state
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3928)

2014-06-23 13:02:21,595 WARN  [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-16:ctx-011048ba ctx-55af37fa) Unable to apply ip address
associations for Ntwk[207|Guest|17] as a part of shutdownNetworkRules
2014-06-23 13:02:21,595 WARN  [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-16:ctx-011048ba ctx-55af37fa) Failed to cleanup network
id=207 resources as a part of shutdownNetwork
2014-06-23 13:02:21,599 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-16:ctx-011048ba ctx-55af37fa) Sending network shutdown to
VirtualRouter
2014-06-23 13:02:21,601 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Job-Executor-16:ctx-011048ba ctx-55af37fa) Stopping router
VM[DomainRouter|r-27-VM]
2014-06-23 13:02:21,604 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-16:ctx-011048ba ctx-55af37fa) Stopped called on
VM[DomainRouter|r-27-VM] but the state is Expunging
2014-06-23 13:02:21,606 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-16:ctx-011048ba ctx-55af37fa) Network id=207 is shutdown
successfully, cleaning up corresponding resources now.
2014-06-23 13:02:21,654 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-16:ctx-011048ba ctx-55af37fa) Lock is released for network
Ntwk[207|Guest|17] as a part of network shutdown

2014-06-23 13:02:22,045 WARN  [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-16:ctx-011048ba ctx-55af37fa) Unable to complete destroy of
the network due to element: VirtualRouter

After this logs I changed VR status in 'vm_instance' made it 'stopped' &
tried to delete the router..but it has thrown exception,

2014-06-23 13:16:51,878 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-18:ctx-b2b5bc61 ctx-82406597) VM state transitted from
:Stopped to Expunging with event: ExpungeOperationvm's original host id:
null new host id: 6 host id before state transition: 6
2014-06-23 13:16:51,878 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-18:ctx-b2b5bc61 ctx-82406597) Destroying vm
VM[DomainRouter|r-27-VM]
2014-06-23 13:16:51,878 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-18:ctx-b2b5bc61 ctx-82406597) Cleaning up NICS
2014-06-23 13:16:51,878 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-18:ctx-b2b5bc61 ctx-82406597) Cleaning network for vm: 27
2014-06-23 13:16:51,881 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-18:ctx-b2b5bc61 ctx-82406597) Cleaning up hypervisor data
structures (ex. SRs in XenServer) for managed storage
2014-06-23 13:16:51,900 ERROR [c.c.a.ApiAsyncJobDispatcher]
(Job-Executor-18:ctx-b2b5bc61) Unexpected exception while executing
org.apache.cloudstack.api.command.admin.router.DestroyRouterCmd
java.lang.NullPointerException
at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.disconnectVolumesFromHost(VolumeOrchestrator.java:885)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:513)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2014-06-23 13:16:51,912 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-18:ctx-b2b5bc61) Complete async job-174, jobStatus: FAILED,
resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530}
2014-06-23 13:16:51,966 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-18:ctx-b2b5bc61) Done executing
org.apache.cloudstack.api.command.admin.router.DestroyRouterCmd for job-174
2014-06-23 13:16:51,989 INFO  [o.a.c.f.j.i.AsyncJobMonitor]
(Job-Executor-18:ctx-b2b5bc61) Remove job-174 from job monitoring

Regards,
Tejas

On Mon, Jun 23, 2014 at 12:52 PM, Tejas Gadaria 
wrote:

> Hi,
>
> Should I update the state in "networks" table in cloud db ?
>
> Regards,
> Tejas
>
>
> On Mon, Jun 23, 2014 at 12:46 PM, Suresh Sadhu 
> wrote:
>
>>
>> HI,
>>
>> It looks your network in stuck in transition state(implementing) as log
>> clearly says it should either implemented or allocate .
>>
>> You can  update the network state in db as implemented  and perform again
>> network restart with cleanup option.
>>
>> -sadhu
>>
>>
>> -Original Message-
>> From: Tejas Gadaria [mailto:refond.g...@gmail.com]
>> Sent: 23 June 2014 12:10
>> To: dev@cloudstack.apache.org

Re: Review Request 22256: CLOUDSTACK-6830 :[hyper-v] fixed vm migration failing between different clusters if volumes are on zone wide primary store


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22256/#review46388
---


Commit af37ade9e3ff4c686883b2218e309c30b2d192ac in cloudstack's branch 
refs/heads/4.4 from Anshul Gangwar
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=af37ade ]

CLOUDSTACK-6830: Fixed [hyper-v] during VM migration, volumes on zone wide 
primary
store requires storage migration resulting in failure of VM migration. This also
improves the hostsformigration api. Firstly we were trying to list all hosts and
then finding suitable storage pools for all volumes and then we were checking
whether vm migration requires storage migration to that host. Now the process is
updated. We are checking for only those volumes which are not in zone wide 
primary
store. We are verifying by comparing volumes->poolid->clusterid to host 
clusterid.
If it uses local or clusterids are different then verifying whether host has
suitable storage pools for the volume of the vm to be migrated too.

(cherry picked from commit 64153a43711420224655bfbe248b4b87474a1f23)

Conflicts:
engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java


- ASF Subversion and Git Services


On June 20, 2014, 10:21 a.m., Anshul Gangwar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22256/
> ---
> 
> (Updated June 20, 2014, 10:21 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh, Rajesh Battala, and Sateesh 
> Chodapuneedi.
> 
> 
> Bugs: CLOUDSTACK-6830
> https://issues.apache.org/jira/browse/CLOUDSTACK-6830
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> fixed vm migration failing between different clusters if volumes are on zone 
> primary store. During VM migration, volumes on zone wide primary store 
> requiring storage migration resulting in failure of VM migration
> 
> This also improves the hostsformigration api. Firstly we were ttrying to 
> list all hosts and then finding suitable storage pools for all volumes
> and then we were checking for whether vm migration requires storage 
> migration
> Now the process is reversed, We are checking for only those volumes which 
> are not in zone wide primary store and only verifying
> that volumes->poolid->clusterid is different from host clusterid and 
> usesLocal then only it requires storage migration
> 
> 
> Diffs
> -
> 
>   engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java 
> 4502365 
>   server/src/com/cloud/server/ManagementServerImpl.java dd4ce0f 
> 
> Diff: https://reviews.apache.org/r/22256/diff/
> 
> 
> Testing
> ---
> 
> tested following scenarios on my local setup.
> 1. VM migration for volumes on zone wide primary store is working fine
> 2. VM migration for volumes on cluster wide primary store is working fine
> 3. VM migration for volumes on local storage is working fine
> 
> 
> Thanks,
> 
> Anshul Gangwar
> 
>

Re: [ACS44] Cherry pick Request

On Mon, Jun 23, 2014 at 9:52 AM, Daan Hoogland  wrote:
>> commit 64153a43711420224655bfbe248b4b87474a1f23
> conflicts, will have a look in a minute


seemed simple, please check

-- 
Daan

Re: Review Request 22807: CLOUDSTACK-6965: Fix for CLOUDSTACK-6935 introduces the NullPointerException in ZoneWideStorageAllocator filter method

2014-06-23 Thread Devdeep Singh


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22807/#review46389
---

Ship it!


Ship It!

- Devdeep Singh


On June 23, 2014, 5:30 a.m., Anshul Gangwar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22807/
> ---
> 
> (Updated June 23, 2014, 5:30 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh, Rajesh Battala, and Sateesh 
> Chodapuneedi.
> 
> 
> Bugs: CLOUDSTACK-6965
> https://issues.apache.org/jira/browse/CLOUDSTACK-6965
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Fix for CLOUDSTACK-6935 has introduced the NullPointerException in code. 
> Since ZoneWideStoragePoolAllocator's filter method has been removed it is 
> using AbstractStoragePoolAllocator's filter method.
> In the filter method there is check for cluster's hypervisor type and and 
> disk profile hypervisor type.
> But cluster is null for ZoneWideStoragePool and Hence the exception.
> 
> 
> Diffs
> -
> 
>   
> engine/storage/src/org/apache/cloudstack/storage/allocator/AbstractStoragePoolAllocator.java
>  2d958a6 
> 
> Diff: https://reviews.apache.org/r/22807/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Anshul Gangwar
> 
>

Re: Review Request 22808: CLOUDSTACK-6968: Allow Cluster scope volumes to attach to any VM

2014-06-23 Thread Devdeep Singh


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22808/#review46390
---

Ship it!


Ship It!

- Devdeep Singh


On June 23, 2014, 6:01 a.m., Anshul Gangwar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22808/
> ---
> 
> (Updated June 23, 2014, 6:01 a.m.)
> 
> 
> Review request for cloudstack, Devdeep Singh, Rajesh Battala, and Sateesh 
> Chodapuneedi.
> 
> 
> Bugs: CLOUDSTACK-6968
> https://issues.apache.org/jira/browse/CLOUDSTACK-6968
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
>  allowing cluster scope volumes to attach to any VM. If migration is needed 
> then first they will be migrated to appropriate cluster before attaching
> 
> 
> Diffs
> -
> 
>   server/src/com/cloud/storage/VolumeApiServiceImpl.java 8a7b220 
> 
> Diff: https://reviews.apache.org/r/22808/diff/
> 
> 
> Testing
> ---
> 
> tested on my local setup
> 
> 
> Thanks,
> 
> Anshul Gangwar
> 
>

Build failed in Jenkins: cloudstack-4.4-maven-build #361

See 

Changes:

[Daan Hoogland] CLOUDSTACK-6965: fixed the NullPointerException introduced by 
fix for cloudstack

[Daan Hoogland] CLOUDSTACK-6968: Allowing cluster scope volumes to attach to 
any VM. If migration is

[Daan Hoogland] CLOUDSTACK-6830: Fixed [hyper-v] during VM migration, volumes 
on zone wide primary

--
[...truncated 2529 lines...]
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-plugin-hypervisor-ovm ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
cloud-plugin-hypervisor-ovm ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 4 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ 
cloud-plugin-hypervisor-ovm ---
[INFO] Compiling 18 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
cloud-plugin-hypervisor-ovm ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
cloud-plugin-hypervisor-ovm ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ 
cloud-plugin-hypervisor-ovm ---
[INFO] Surefire report directory: 


---
 T E S T S
---

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Plugin - Open vSwitch 4.4.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ 
cloud-plugin-network-ovs ---
[INFO] Deleting 

 (includes = [target, dist], excludes = [])
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-plugin-network-ovs ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-plugin-network-ovs ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
cloud-plugin-network-ovs ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ 
cloud-plugin-network-ovs ---
[INFO] Compiling 33 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
cloud-plugin-network-ovs ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
cloud-plugin-network-ovs ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ 
cloud-plugin-network-ovs ---
[INFO] Surefire report directory: 


---
 T E S T S
---

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Plugin - Hypervisor Xen 4.4.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ 
cloud-plugin-hypervisor-xen ---
[INFO] Deleting 

 (includes = [target, dist], excludes = [])
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-plugin-hypervisor-xen

RE: [ACS44] Cherry pick Request

2014-06-23 Thread Anshul Gangwar

Looks good 

-Original Message-
From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] 
Sent: Monday, June 23, 2014 1:27 PM
To: Anshul Gangwar
Cc: dev@cloudstack.apache.org
Subject: Re: [ACS44] Cherry pick Request

On Mon, Jun 23, 2014 at 9:52 AM, Daan Hoogland  wrote:
>> commit 64153a43711420224655bfbe248b4b87474a1f23
> conflicts, will have a look in a minute


seemed simple, please check

-- 
Daan

[cloudmonkey] 431: Unable to execute API command listnics due to invalid value

Hi,

I'm trying to list the nics of my virtualmachines (searching for some IP 
address) and for many of them I get this error:

"cloudmonkey list nics virtualmachineid=913303d6-6243-4b1a-8acb-254086d123b3
431: Unable to execute API command listnics due to invalid value. Invalid 
parameter virtualmachineid value=913303d6-6243-4b1a-8acb-254086d123b3 due to 
incorrect long value format, or entity does not exist or due to incorrect 
parameter annotation for the field in api cmd class."

The management server log shows:

Object entity uuid = 913303d6-6243-4b1a-8acb-254086d123b3 does not exist in the 
database.
Unable to execute API command listnics due to invalid value. Invalid parameter 
virtualmachineid value=913303d6-6243-4b1a-8acb-254086d123b3 due to incorrect 
long value format, or entity does not exist or due to incorrect parameter 
annotation for the field in api cmd class.

The UI however lists the said VM and its nics (and IPs) just fine. Anyone knows 
what could be going on?

This is ACS 4.3 KVM.

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

RE: S3 use with simulator

The error message is from the simulator storage plugin, not sure why you are 
getting it even after setting provider types as S3.
I tried the same on a 4.4-forward setup and got a different error (as below).
"You can only add new image stores from the same provider NFS already added"

This error is there as the simulator storage provider doesn't support migration 
to object store. Once I fixed it, the image store got added successfully and 
the NFS store was converted to a cache store.
This is the change I made

diff --git 
a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
 
b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
index edf1e28..537c7bd 100644
--- 
a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
+++ 
b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
@@ -133,7 +133,7 @@ public class SimulatorImageStoreLifeCycleImpl implements 
ImageStoreLifeCycle {
  */
 @Override
 public boolean migrateToObjectStore(DataStore store) {
-return false;
+return imageStoreHelper.convertToStagingStore(store);
 }
 
 }

-Original Message-
From: Min Chen [mailto:min.c...@citrix.com] 
Sent: Saturday, 21 June 2014 3:44 AM
To: dev@cloudstack.apache.org
Subject: Re: S3 use with simulator

Got it. The error seems from simulator, maybe Koushik has better idea on that. 
I didn't use that on simulator env though.

Thanks
-min

On 6/20/14 11:05 AM, "Sebastien Goasguen"  wrote:

>I already have an Nsf secondary storage. I understood that i could not 
>add a second secondary storage that is s3 based, and that the only way 
>was to use the updatecloud Api
>
>-Sebastien
>
>> On 20 Jun 2014, at 18:49, Min Chen  wrote:
>> 
>> Hi Sebastien,
>> 
>>I am curious why you are using updateCloudToUseObjectStore api to 
>>add S3  as a secondary store in your data center? To set up a data 
>>center using  S3, you need to use addImageStore api.
>> 
>>Thanks
>>-min
>> 
>>> On 6/20/14 7:47 AM, "Sebastien Goasguen"  wrote:
>>> 
>>> I switch to provider=S3 but I get:
>>> 
 530: Failed to add data store: DataCenter id is null, and simulator 
 image store has to be associated with a data center
>>> 
>>> 
 On Jun 20, 2014, at 7:07 AM, Koushik Das 
wrote:
 
 As per the code the following are the supported image store 
 provider types
 
   // constants for provider names
   static final String NFS_IMAGE = "NFS";
   static final String S3_IMAGE = "S3";
   static final String SWIFT_IMAGE = "Swift";
   static final String SAMPLE_IMAGE = "Sample";
   static final String SMB = "NFS";
   static final String DEFAULT_PRIMARY = "DefaultPrimary";
 
 Try passing S3 in the provider.
 BTW when you setup simulator the image provider is NFS.
 
 -Original Message-
 From: Sebastien Goasguen [mailto:run...@gmail.com]
 Sent: Thursday, 19 June 2014 5:08 PM
 To: dev@cloudstack.apache.org
 Subject: S3 use with simulator
 
 Hi,
 
 I am using the simulator and started a basic zone.
 I have an S3 object store locally (riakCS), and I am trying to add 
 it to the infra using the 'cloudtouseobjectstore' api with cloudmonkey.
 
 I tried with:
 
> update cloudtouseobjectstore url=http://localhost:9081/riak-cs 
> name=riak provider=riakcs
> 
>details[0].key=accesskey&details[0].value=STU6Z-ZMK1TPMDAXL9I1&deta
>ils
>[1
> 
>].key=secretkey&details[1].value=8OuY3mHDXihu0Tdb2aVJ4vuYZLBAl5Z7Ni
>WKs
>g=
> =
 530: Failed to add data store: DataCenter id is null, and simulator 
 image store has to be associated with a data center
 
 I am not sure if the arguments are right, has anyone done this 
before ?
 
 thanks,
 
 -sebastien
>>

Re: [ACS44] Cherry pick Request

except that it doesn't build :( this seems to be related to the
libvirt pom again, not your commit :)

On Mon, Jun 23, 2014 at 10:16 AM, Anshul Gangwar
 wrote:
> Looks good
>
> -Original Message-
> From: Daan Hoogland [mailto:daan.hoogl...@gmail.com]
> Sent: Monday, June 23, 2014 1:27 PM
> To: Anshul Gangwar
> Cc: dev@cloudstack.apache.org
> Subject: Re: [ACS44] Cherry pick Request
>
> On Mon, Jun 23, 2014 at 9:52 AM, Daan Hoogland  
> wrote:
>>> commit 64153a43711420224655bfbe248b4b87474a1f23
>> conflicts, will have a look in a minute
>
>
> seemed simple, please check
>
> --
> Daan



-- 
Daan

Re: [cloudmonkey] 431: Unable to execute API command listnics due to invalid value

Ok, my bad, sory for the noise.
I was running a batch job with "cloudmonkey listvirtualmachines" and using the 
"id" from there, but only now noticed there are 2 "id" fields, one for the 
machine and one for the nic. 

Please ignore. :)

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro


- Original Message -
From: "Nux!" 
To: dev@cloudstack.apache.org
Sent: Monday, 23 June, 2014 9:27:38 AM
Subject: [cloudmonkey] 431: Unable to execute API command listnics due to 
invalid value

Hi,

I'm trying to list the nics of my virtualmachines (searching for some IP 
address) and for many of them I get this error:

"cloudmonkey list nics virtualmachineid=913303d6-6243-4b1a-8acb-254086d123b3
431: Unable to execute API command listnics due to invalid value. Invalid 
parameter virtualmachineid value=913303d6-6243-4b1a-8acb-254086d123b3 due to 
incorrect long value format, or entity does not exist or due to incorrect 
parameter annotation for the field in api cmd class."

The management server log shows:

Object entity uuid = 913303d6-6243-4b1a-8acb-254086d123b3 does not exist in the 
database.
Unable to execute API command listnics due to invalid value. Invalid parameter 
virtualmachineid value=913303d6-6243-4b1a-8acb-254086d123b3 due to incorrect 
long value format, or entity does not exist or due to incorrect parameter 
annotation for the field in api cmd class.

The UI however lists the said VM and its nics (and IPs) just fine. Anyone knows 
what could be going on?

This is ACS 4.3 KVM.

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

RE: 431: Unable to execute API command listnics due to invalid value

2014-06-23 Thread Saksham Srivastava

Works on  ACS 4.4 (Make sure you are passing the correct vm id):

#list nics virtualmachineid=d6c6b69c-d162-4fe8-a5cc-fd09ea32d525
count = 1
nic:
id = 8f15c1a0-d6b2-4eae-849e-1496747b22d9
deviceid = 0
gateway = 10.0.64.1
ipaddress = 10.0.65.178
isdefault = True
macaddress = 02:00:6e:f1:00:01
netmask = 255.255.240.0
networkid = e6e9ba59-2779-469b-9a1a-82dccd55d7f3
virtualmachineid = d6c6b69c-d162-4fe8-a5cc-fd09ea32d525


-Saksham

-Original Message-
From: Nux! [mailto:n...@li.nux.ro] 
Sent: Monday, June 23, 2014 1:58 PM
To: dev@cloudstack.apache.org
Subject: [cloudmonkey] 431: Unable to execute API command listnics due to 
invalid value

Hi,

I'm trying to list the nics of my virtualmachines (searching for some IP 
address) and for many of them I get this error:

"cloudmonkey list nics virtualmachineid=913303d6-6243-4b1a-8acb-254086d123b3
431: Unable to execute API command listnics due to invalid value. Invalid 
parameter virtualmachineid value=913303d6-6243-4b1a-8acb-254086d123b3 due to 
incorrect long value format, or entity does not exist or due to incorrect 
parameter annotation for the field in api cmd class."

The management server log shows:

Object entity uuid = 913303d6-6243-4b1a-8acb-254086d123b3 does not exist in the 
database.
Unable to execute API command listnics due to invalid value. Invalid parameter 
virtualmachineid value=913303d6-6243-4b1a-8acb-254086d123b3 due to incorrect 
long value format, or entity does not exist or due to incorrect parameter 
annotation for the field in api cmd class.

The UI however lists the said VM and its nics (and IPs) just fine. Anyone knows 
what could be going on?

This is ACS 4.3 KVM.

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

[ACS4.4]older issue

LS,

I started marking issues that have not been touched for months and
were marked fix-version 4.4.0 to be fixed in 'future'. at the moment I
was thinking of making the line december, but am considdering moving
the line.

please try and hit me

-- 
Daan

Re: [ACS4.4]older issue

also I notice a lot of issue assigned to people who are not even a
watcher on the issue. I will add them as watcher.

On Mon, Jun 23, 2014 at 10:48 AM, Daan Hoogland  wrote:
> LS,
>
> I started marking issues that have not been touched for months and
> were marked fix-version 4.4.0 to be fixed in 'future'. at the moment I
> was thinking of making the line december, but am considdering moving
> the line.
>
> please try and hit me
>
> --
> Daan



-- 
Daan

Review Request 22863: First code drop for Brocade Network plugin to orchestrate Brocade VDX switches for L2 connectivity.


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22863/
---

Review request for cloudstack.


Bugs: CLOUDSTACK-6823
https://issues.apache.org/jira/browse/CLOUDSTACK-6823


Repository: cloudstack-git


Description
---

First code drop for Brocade Network plugin to orchestrate Brocade VDX switches 
for L2 connectivity.


Diffs
-

  api/src/com/cloud/network/Network.java b5e8173 
  api/src/com/cloud/network/Networks.java 3159f6e 
  api/src/com/cloud/network/PhysicalNetwork.java 5d38b50 
  build/replace.properties 265f335 
  client/pom.xml 3995f6e 
  plugins/pom.xml 4f7805a 
  setup/db/create-schema.sql 55cb4cc 
  ui/scripts/system.js 0c56baf 
  utils/conf/db.properties e1b5fe9 

Diff: https://reviews.apache.org/r/22863/diff/


Testing
---

•   Create an isolated network; verify that the port-profile is created on 
the Brocade switch.
•   Attach a VM to the network; verify that the VMs MAC address is 
associated with the port profile of the network on the Brocade switch.
•   Delete VMs for an isolated network; verify that the VMs MAC address is 
disassociated with the port profile of the network on the Brocade switch.
•   Delete the isolated network; verify that the port-profile is deleted 
from the Brocade switch.


File Attachments


Diff for the existing cloudstack code
  
https://reviews.apache.org/media/uploaded/files/2014/06/23/8fc3cfb1-7a21-4714-98f3-6514cf54ba84__diff
Patch for the plugin code
  
https://reviews.apache.org/media/uploaded/files/2014/06/23/fbb2b949-a42c-4b22-afa7-60e691c778df__brocade-vcs.patch


Thanks,

Ritu  Sabharwal

Re: Review Request 22863: First code drop for Brocade Network plugin to orchestrate Brocade VDX switches for L2 connectivity.


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22863/
---

(Updated June 23, 2014, 10:15 a.m.)


Review request for cloudstack.


Bugs: CLOUDSTACK-6823
https://issues.apache.org/jira/browse/CLOUDSTACK-6823


Repository: cloudstack-git


Description
---

First code drop for Brocade Network plugin to orchestrate Brocade VDX switches 
for L2 connectivity.


Diffs
-

  api/src/com/cloud/network/Network.java b5e8173 
  api/src/com/cloud/network/Networks.java 3159f6e 
  api/src/com/cloud/network/PhysicalNetwork.java 5d38b50 
  build/replace.properties 265f335 
  client/pom.xml 3995f6e 
  plugins/pom.xml 4f7805a 
  setup/db/create-schema.sql 55cb4cc 
  ui/scripts/system.js 0c56baf 
  utils/conf/db.properties e1b5fe9 

Diff: https://reviews.apache.org/r/22863/diff/


Testing
---

•   Create an isolated network; verify that the port-profile is created on 
the Brocade switch.
•   Attach a VM to the network; verify that the VMs MAC address is 
associated with the port profile of the network on the Brocade switch.
•   Delete VMs for an isolated network; verify that the VMs MAC address is 
disassociated with the port profile of the network on the Brocade switch.
•   Delete the isolated network; verify that the port-profile is deleted 
from the Brocade switch.


File Attachments


Diff for the existing cloudstack code
  
https://reviews.apache.org/media/uploaded/files/2014/06/23/8fc3cfb1-7a21-4714-98f3-6514cf54ba84__diff
Patch for the plugin code
  
https://reviews.apache.org/media/uploaded/files/2014/06/23/fbb2b949-a42c-4b22-afa7-60e691c778df__brocade-vcs.patch


Thanks,

Ritu  Sabharwal

Re: Review Request 22863: CLOUDSTACK-6823 : First code drop for Brocade Network plugin to orchestrate Brocade VDX switches for L2 connectivity.


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22863/
---

(Updated June 23, 2014, 10:18 a.m.)


Review request for cloudstack.


Changes
---

Updated the JIRA Bug id on Summary.


Summary (updated)
-

CLOUDSTACK-6823 : First code drop for Brocade Network plugin to orchestrate 
Brocade VDX switches for L2 connectivity.


Bugs: CLOUDSTACK-6823
https://issues.apache.org/jira/browse/CLOUDSTACK-6823


Repository: cloudstack-git


Description
---

First code drop for Brocade Network plugin to orchestrate Brocade VDX switches 
for L2 connectivity.


Diffs
-

  api/src/com/cloud/network/Network.java b5e8173 
  api/src/com/cloud/network/Networks.java 3159f6e 
  api/src/com/cloud/network/PhysicalNetwork.java 5d38b50 
  build/replace.properties 265f335 
  client/pom.xml 3995f6e 
  plugins/pom.xml 4f7805a 
  setup/db/create-schema.sql 55cb4cc 
  ui/scripts/system.js 0c56baf 
  utils/conf/db.properties e1b5fe9 

Diff: https://reviews.apache.org/r/22863/diff/


Testing
---

•   Create an isolated network; verify that the port-profile is created on 
the Brocade switch.
•   Attach a VM to the network; verify that the VMs MAC address is 
associated with the port profile of the network on the Brocade switch.
•   Delete VMs for an isolated network; verify that the VMs MAC address is 
disassociated with the port profile of the network on the Brocade switch.
•   Delete the isolated network; verify that the port-profile is deleted 
from the Brocade switch.


File Attachments


Diff for the existing cloudstack code
  
https://reviews.apache.org/media/uploaded/files/2014/06/23/8fc3cfb1-7a21-4714-98f3-6514cf54ba84__diff
Patch for the plugin code
  
https://reviews.apache.org/media/uploaded/files/2014/06/23/fbb2b949-a42c-4b22-afa7-60e691c778df__brocade-vcs.patch


Thanks,

Ritu  Sabharwal

[security] The case of the open dns resolver

Hi,

Today I've been bitten again by the $subject and complaints were sent to my 
hoster's abuse email address; apparently someone used my VR in a DDOS attack.
It is my fault as I knew about this issue, but I'd like to throw the blame on 
Cloudstack. :)

So, the VR is accepting DNS requests from everybody on the interwebs and this 
should be changed, imho.

I see there are already iptables rules concerning port 8080 of the VR and only 
the public IP ranges are allowed. Why isn't this the case for port 53 as well?

I have placed this script in my VR's rc.local, but it's not kosher at all.

# disallows global DNS traffic and only allows it from the cloud public subnets
for i in `iptables-save |grep 8080|awk '{print $4}'`; do iptables -I INPUT -s 
$i -p tcp -m tcp --dport 53 -j ACCEPT; iptables -I INPUT -s $i -p udp -m udp 
--dport 53 -j ACCEPT; done
iptables -D INPUT -i eth0 -p udp -m udp --dport 53 -j ACCEPT
iptables -D INPUT -i eth0 -p tcp -m tcp --dport 53 -j ACCEPT

This could be greatly improved and added in the official tree.
Currently I'm getting the subnets by checking which IPs the 8080 rules apply, 
how can I retrieve this information in a more elegant way?

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

Re: S3 use with simulator

2014-06-23 Thread Sebastien Goasguen

Hi Koushik, thanks for the hint, I checked out 4.4-forward and made that small 
change.

I still add the same error:

> update cloudtouseobjectstore url=http://localhost:9081/riak-cs name=riakcs 
> provider=s3 details[0].key=accesskey details[0].value=ZMJD6-90S2MST4NZMK1Z 
> details[1].key=secretkey 
> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
530: Failed to add data store: DataCenter id is null, and simulator image store 
has to be associated with a data center

However this actually *removed* the NFS store (from the simulated basic zone).

I was then able to add:

> add imagestore name=riakcs provider=S3 url=http://localhost:9081/riak-cs 
> details[0].key=accesskey details[0].value=ZMJD6-90S2MST4NZMK1Z 
> details[1].key=secretkey 
> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
imagestore:
name = riakcs
id = 1a60d62a-c1e9-4d1c-8b35-d5cd687f6de4
details:
+---+--+
|name   |  value   |
+---+--+
| secretkey | ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q== |
| accesskey |   ZMJD6-90S2MST4NZMK1Z   |
+---+--+
protocol = http
providername = S3
scope = REGION
url = http://localhost:9081/riak-cs

Apparently successfully, even though the removal of the NFS store entirely is a 
bit worrisome.

On Jun 23, 2014, at 4:32 AM, Koushik Das  wrote:

> The error message is from the simulator storage plugin, not sure why you are 
> getting it even after setting provider types as S3.
> I tried the same on a 4.4-forward setup and got a different error (as below).
> "You can only add new image stores from the same provider NFS already added"
> 
> This error is there as the simulator storage provider doesn't support 
> migration to object store. Once I fixed it, the image store got added 
> successfully and the NFS store was converted to a cache store.
> This is the change I made
> 
> diff --git 
> a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>  
> b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
> index edf1e28..537c7bd 100644
> --- 
> a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
> +++ 
> b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
> @@ -133,7 +133,7 @@ public class SimulatorImageStoreLifeCycleImpl implements 
> ImageStoreLifeCycle {
>  */
> @Override
> public boolean migrateToObjectStore(DataStore store) {
> -return false;
> +return imageStoreHelper.convertToStagingStore(store);
> }
> 
> }
> 
> -Original Message-
> From: Min Chen [mailto:min.c...@citrix.com] 
> Sent: Saturday, 21 June 2014 3:44 AM
> To: dev@cloudstack.apache.org
> Subject: Re: S3 use with simulator
> 
> Got it. The error seems from simulator, maybe Koushik has better idea on 
> that. I didn't use that on simulator env though.
> 
> Thanks
> -min
> 
> On 6/20/14 11:05 AM, "Sebastien Goasguen"  wrote:
> 
>> I already have an Nsf secondary storage. I understood that i could not 
>> add a second secondary storage that is s3 based, and that the only way 
>> was to use the updatecloud Api
>> 
>> -Sebastien
>> 
>>> On 20 Jun 2014, at 18:49, Min Chen  wrote:
>>> 
>>> Hi Sebastien,
>>> 
>>>   I am curious why you are using updateCloudToUseObjectStore api to 
>>> add S3  as a secondary store in your data center? To set up a data 
>>> center using  S3, you need to use addImageStore api.
>>> 
>>>   Thanks
>>>   -min
>>> 
 On 6/20/14 7:47 AM, "Sebastien Goasguen"  wrote:
 
 I switch to provider=S3 but I get:
 
> 530: Failed to add data store: DataCenter id is null, and simulator 
> image store has to be associated with a data center
 
 
> On Jun 20, 2014, at 7:07 AM, Koushik Das 
> wrote:
> 
> As per the code the following are the supported image store 
> provider types
> 
>  // constants for provider names
>  static final String NFS_IMAGE = "NFS";
>  static final String S3_IMAGE = "S3";
>  static final String SWIFT_IMAGE = "Swift";
>  static final String SAMPLE_IMAGE = "Sample";
>  static final String SMB = "NFS";
>  static final String DEFAULT_PRIMARY = "DefaultPrimary";
> 
> Try passing S3 in the provider.
> BTW when you setup simulator the image provider is NFS.
> 
> -Original Message-
> From: Sebastien Goasguen [mailto:run...@gmail.com]
> Sent: Thursday, 19 June 2014 5:08 PM
> To: dev@cloudstack.apache.org
> Subject: S3 use with simulator
> 
> Hi,
> 
> I am using the simulator and started a basic zone.
> I have an S3 object store locally (riakCS), and I am try

Build failed in Jenkins: build-master #1007

See 

Changes:

[Daan Hoogland] CLOUDSTACK-6967: Initial OVM3 drop

[Daan Hoogland] CLOUDSTACK-6967: Now with module!

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on cloudstack-buildslave-centos6-cb6 
(cloudstack-buildslave-centos6) in workspace 

Fetching changes from the remote Git repository
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/cloudstack.git
Checking out Revision 189972bc7c9e73abff392429eda298f9f837992e (origin/master)
[copy-to-slave] Copying 'settings.xml', excluding nothing, from 
'file:/var/lib/jenkins/userContent/' on the master to 
' on 
'cloudstack-buildslave-centos6-cb6'.
[build-master] $ 
/jenkins/tools/hudson.tasks.Maven_MavenInstallation/maven-3.1.1/bin/mvn -s 
 
-Psystemvm,awsapi clean test
[INFO] Scanning for projects...
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]   
[ERROR]   The project 
org.apache.cloudstack:cloud-plugin-hypervisor-ovm3:4.4.0-SNAPSHOT 
(
 has 1 error
[ERROR] Non-resolvable parent POM: Could not find artifact 
org.apache.cloudstack:cloudstack-plugins:pom:4.4.0-SNAPSHOT and 
'parent.relativePath' points at wrong local POM @ line 23, column 11 -> [Help 2]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] 
http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException
Build step 'Invoke top-level Maven targets' marked build as failure
Recording test results

Regarding CLOUDSTACK-4751

2014-06-23 Thread Namita Chaudhari

Hi All,

I am working on CLOUDSTACK-4751: Cannot add single network multiple times
to a VM.

I had query regarding this bug. If a network is already configured on VM, then
why do we have to add same network again to the VM? Is there any specific
purpose behind doing so? Can anyone please help me in this?

Thanks and Regards.
-- 

*Namita Chaudhari* ● Engineer - Product Development ● SunGard Availability
Services, India. ● 2nd Floor, Wing 4, Cluster D, MIDC Kharadi Knowledge
Park, Pune - 411 014 ● Email: namita.chaudh...@sungardas.com
 ● www.sungardas.in



[image: Description: cid:image019.png@01CF48EC.6617C7F0]  [image:
Description: cid:image020.png@01CF48EC.6617C7F0]  [image: Description:
cid:image021.png@01CF48EC.6617C7F0]  [image: Description:
cid:image022.png@01CF48EC.6617C7F0]  [image: Description:
cid:image023.png@01CF48EC.6617C7F0]  [image: Description:
cid:image024.png@01CF48EC.6617C7F0]

Re: S3 use with simulator

inline

On 23-Jun-2014, at 4:05 PM, Sebastien Goasguen  wrote:

> Hi Koushik, thanks for the hint, I checked out 4.4-forward and made that 
> small change.
> 
> I still add the same error:
> 
>> update cloudtouseobjectstore url=http://localhost:9081/riak-cs name=riakcs 
>> provider=s3 details[0].key=accesskey details[0].value=ZMJD6-90S2MST4NZMK1Z 
>> details[1].key=secretkey 
>> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
> 530: Failed to add data store: DataCenter id is null, and simulator image 
> store has to be associated with a data center
> 
> However this actually *removed* the NFS store (from the simulated basic zone).
> 

I verified using advanced zone, not sure if there are any issues with basic 
zone. The API response I get is the following:
55b7e6f7-ec27-4da8-b4a0-b209a3e3d825testhttp://localhost:1234/testhttpS3REGIONsecretkeydummyaccesskeydummy

Also in the image_store table the entries look like below, note that the 'role' 
of NFS store changed to 'ImageCache'.

'1', 'nfs://10.147.28.6:/export/home/sandbox/secondary', 'NFS', 'nfs', 
'nfs://10.147.28.6:/export/home/sandbox/secondary', '1', 'ZONE', 'ImageCache', 
'8eb3e701-7e2b-4925-87f8-f8ea5f97b863', 
'/mnt/05b33ef7-da6a-33eb-9981-b4efb90ed99b/', '2014-06-23 06:27:58', NULL, 
NULL, NULL
'2', 'test', 'S3', 'http', 'http://localhost:1234/test', NULL, 'REGION', 
'Image', '55b7e6f7-ec27-4da8-b4a0-b209a3e3d825', NULL, '2014-06-23 07:37:55', 
NULL, NULL, NULL


> I was then able to add:
> 
>> add imagestore name=riakcs provider=S3 url=http://localhost:9081/riak-cs 
>> details[0].key=accesskey details[0].value=ZMJD6-90S2MST4NZMK1Z 
>> details[1].key=secretkey 
>> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
> imagestore:
> name = riakcs
> id = 1a60d62a-c1e9-4d1c-8b35-d5cd687f6de4
> details:
> +---+--+
> |name   |  value   |
> +---+--+
> | secretkey | ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q== |
> | accesskey |   ZMJD6-90S2MST4NZMK1Z   |
> +---+--+
> protocol = http
> providername = S3
> scope = REGION
> url = http://localhost:9081/riak-cs
> 
> Apparently successfully, even though the removal of the NFS store entirely is 
> a bit worrisome.
> 
> On Jun 23, 2014, at 4:32 AM, Koushik Das  wrote:
> 
>> The error message is from the simulator storage plugin, not sure why you are 
>> getting it even after setting provider types as S3.
>> I tried the same on a 4.4-forward setup and got a different error (as below).
>> "You can only add new image stores from the same provider NFS already added"
>> 
>> This error is there as the simulator storage provider doesn't support 
>> migration to object store. Once I fixed it, the image store got added 
>> successfully and the NFS store was converted to a cache store.
>> This is the change I made
>> 
>> diff --git 
>> a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>>  
>> b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>> index edf1e28..537c7bd 100644
>> --- 
>> a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>> +++ 
>> b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>> @@ -133,7 +133,7 @@ public class SimulatorImageStoreLifeCycleImpl implements 
>> ImageStoreLifeCycle {
>> */
>>@Override
>>public boolean migrateToObjectStore(DataStore store) {
>> -return false;
>> +return imageStoreHelper.convertToStagingStore(store);
>>}
>> 
>> }
>> 
>> -Original Message-
>> From: Min Chen [mailto:min.c...@citrix.com] 
>> Sent: Saturday, 21 June 2014 3:44 AM
>> To: dev@cloudstack.apache.org
>> Subject: Re: S3 use with simulator
>> 
>> Got it. The error seems from simulator, maybe Koushik has better idea on 
>> that. I didn't use that on simulator env though.
>> 
>> Thanks
>> -min
>> 
>> On 6/20/14 11:05 AM, "Sebastien Goasguen"  wrote:
>> 
>>> I already have an Nsf secondary storage. I understood that i could not 
>>> add a second secondary storage that is s3 based, and that the only way 
>>> was to use the updatecloud Api
>>> 
>>> -Sebastien
>>> 
 On 20 Jun 2014, at 18:49, Min Chen  wrote:
 
 Hi Sebastien,
 
  I am curious why you are using updateCloudToUseObjectStore api to 
 add S3  as a secondary store in your data center? To set up a data 
 center using  S3, you need to use addImageStore api.
 
  Thanks
  -min
 
> On 6/20/14 7:47 AM, "Sebastien Goasguen"  wrote:
> 
> I switch to provider=S3 but I get:
> 
>> 530: Failed to add data store: DataCenter id is null, and simulator 
>> image store has to be a

Review Request 22865: [Automation] test_01_primary_storage_iscsi failed on "test_primary_storage.py" - Wrong iscsi path format - it should be /targetIQN/LUN

2014-06-23 Thread Damodar Reddy Talakanti


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22865/
---

Review request for cloudstack, daan Hoogland and Koushik Das.


Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-6444

https://issues.apache.org/jira/browse/https://issues.apache.org/jira/browse/CLOUDSTACK-6444


Repository: cloudstack-git


Description
---

Due to the changes done to fix the findbug tool issues, we introduced the iSCSI 
path format issue by replacing the first "/" with empty string. Fixed the same 
by removing the replacement string part.


Diffs
-

  
plugins/storage/volume/default/src/org/apache/cloudstack/storage/datastore/lifecycle/CloudStackPrimaryDataStoreLifeCycleImpl.java
 3c1b76a 

Diff: https://reviews.apache.org/r/22865/diff/


Testing
---

Tested with iSCSI primary storage with XenServer


Thanks,

Damodar Reddy Talakanti

Review Request 22866: Fixed DatabaseAccessObject failing unit test

2014-06-23 Thread Santhosh Edukulla


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22866/
---

Review request for cloudstack and daan Hoogland.


Bugs: coverity
https://issues.apache.org/jira/browse/coverity


Repository: cloudstack-git


Description
---

After fixing coverity resource leak issues, few DatabaseAccessObject unit tests 
were failing. Fixed them now.


Diffs
-

  engine/schema/src/com/cloud/upgrade/dao/DatabaseAccessObject.java 4cc88bd 

Diff: https://reviews.apache.org/r/22866/diff/


Testing
---

Ran the build, using mvn  -Pdeveloper  clean install, deployed db and a 
datacenter.


Thanks,

Santhosh Edukulla

Re: S3 use with simulator

2014-06-23 Thread sebgoa


On Jun 23, 2014, at 12:51 PM, Koushik Das  wrote:

> inline
> 
> On 23-Jun-2014, at 4:05 PM, Sebastien Goasguen  wrote:
> 
>> Hi Koushik, thanks for the hint, I checked out 4.4-forward and made that 
>> small change.
>> 
>> I still add the same error:
>> 
>>> update cloudtouseobjectstore url=http://localhost:9081/riak-cs name=riakcs 
>>> provider=s3 details[0].key=accesskey details[0].value=ZMJD6-90S2MST4NZMK1Z 
>>> details[1].key=secretkey 
>>> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>> 530: Failed to add data store: DataCenter id is null, and simulator image 
>> store has to be associated with a data center
>> 
>> However this actually *removed* the NFS store (from the simulated basic 
>> zone).
>> 
> 
> I verified using advanced zone, not sure if there are any issues with basic 
> zone. The API response I get is the following:
>  cloud-stack-version="4.4.0-SNAPSHOT">55b7e6f7-ec27-4da8-b4a0-b209a3e3d825testhttp://localhost:1234/testhttpS3REGIONsecretkeydummyaccesskeydummy
> 

Hum, strange. I just checked with an advanced zone from setup/dev/advanced.cfg 
and I get the same error 'datacenter id is null'.

Can you send the exact request that you sent ?

> Also in the image_store table the entries look like below, note that the 
> 'role' of NFS store changed to 'ImageCache'.
> 
> '1', 'nfs://10.147.28.6:/export/home/sandbox/secondary', 'NFS', 'nfs', 
> 'nfs://10.147.28.6:/export/home/sandbox/secondary', '1', 'ZONE', 
> 'ImageCache', '8eb3e701-7e2b-4925-87f8-f8ea5f97b863', 
> '/mnt/05b33ef7-da6a-33eb-9981-b4efb90ed99b/', '2014-06-23 06:27:58', NULL, 
> NULL, NULL
> '2', 'test', 'S3', 'http', 'http://localhost:1234/test', NULL, 'REGION', 
> 'Image', '55b7e6f7-ec27-4da8-b4a0-b209a3e3d825', NULL, '2014-06-23 07:37:55', 
> NULL, NULL, NULL
> 

Yes I can confirm this. It gets listed in the UI under 'secondary staging 
store', and it's in the db.

> 
>> I was then able to add:
>> 
>>> add imagestore name=riakcs provider=S3 url=http://localhost:9081/riak-cs 
>>> details[0].key=accesskey details[0].value=ZMJD6-90S2MST4NZMK1Z 
>>> details[1].key=secretkey 
>>> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>> imagestore:
>> name = riakcs
>> id = 1a60d62a-c1e9-4d1c-8b35-d5cd687f6de4
>> details:
>> +---+--+
>> |name   |  value   |
>> +---+--+
>> | secretkey | ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q== |
>> | accesskey |   ZMJD6-90S2MST4NZMK1Z   |
>> +---+--+
>> protocol = http
>> providername = S3
>> scope = REGION
>> url = http://localhost:9081/riak-cs
>> 
>> Apparently successfully, even though the removal of the NFS store entirely 
>> is a bit worrisome.
>> 
>> On Jun 23, 2014, at 4:32 AM, Koushik Das  wrote:
>> 
>>> The error message is from the simulator storage plugin, not sure why you 
>>> are getting it even after setting provider types as S3.
>>> I tried the same on a 4.4-forward setup and got a different error (as 
>>> below).
>>> "You can only add new image stores from the same provider NFS already added"
>>> 
>>> This error is there as the simulator storage provider doesn't support 
>>> migration to object store. Once I fixed it, the image store got added 
>>> successfully and the NFS store was converted to a cache store.
>>> This is the change I made
>>> 
>>> diff --git 
>>> a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>>>  
>>> b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>>> index edf1e28..537c7bd 100644
>>> --- 
>>> a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>>> +++ 
>>> b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>>> @@ -133,7 +133,7 @@ public class SimulatorImageStoreLifeCycleImpl 
>>> implements ImageStoreLifeCycle {
>>>*/
>>>   @Override
>>>   public boolean migrateToObjectStore(DataStore store) {
>>> -return false;
>>> +return imageStoreHelper.convertToStagingStore(store);
>>>   }
>>> 
>>> }
>>> 
>>> -Original Message-
>>> From: Min Chen [mailto:min.c...@citrix.com] 
>>> Sent: Saturday, 21 June 2014 3:44 AM
>>> To: dev@cloudstack.apache.org
>>> Subject: Re: S3 use with simulator
>>> 
>>> Got it. The error seems from simulator, maybe Koushik has better idea on 
>>> that. I didn't use that on simulator env though.
>>> 
>>> Thanks
>>> -min
>>> 
>>> On 6/20/14 11:05 AM, "Sebastien Goasguen"  wrote:
>>> 
 I already have an Nsf secondary storage. I understood that i could not 
 add a second secondary storage that is s3 based, and that the only way 
 was to use the updatecloud Api
 
 -Sebastien
 
> On 20 Jun 2014,

RE: S3 use with simulator

This is the request

http://localhost:8096/api?command=updateCloudToUseObjectStore&url=http://localhost:1234/test&name=test&provider=S3&details[0].key=accesskey&details[0].value=dummy&details[1].key=secretkey&details[1].value=dummy


-Original Message-
From: sebgoa [mailto:run...@gmail.com] 
Sent: Monday, 23 June 2014 4:40 PM
To: dev@cloudstack.apache.org
Subject: Re: S3 use with simulator


On Jun 23, 2014, at 12:51 PM, Koushik Das  wrote:

> inline
> 
> On 23-Jun-2014, at 4:05 PM, Sebastien Goasguen  wrote:
> 
>> Hi Koushik, thanks for the hint, I checked out 4.4-forward and made that 
>> small change.
>> 
>> I still add the same error:
>> 
>>> update cloudtouseobjectstore url=http://localhost:9081/riak-cs 
>>> name=riakcs provider=s3 details[0].key=accesskey 
>>> details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
>>> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>> 530: Failed to add data store: DataCenter id is null, and simulator 
>> image store has to be associated with a data center
>> 
>> However this actually *removed* the NFS store (from the simulated basic 
>> zone).
>> 
> 
> I verified using advanced zone, not sure if there are any issues with basic 
> zone. The API response I get is the following:
>  cloud-stack-version="4.4.0-SNAPSHOT">55b7e6f7-ec27-4da
> 8-b4a0-b209a3e3d825testhttp://localhost:1234/te
> sthttpS3 >REGIONsecretkeydummy tails>accesskeydummy magestore>
> 

Hum, strange. I just checked with an advanced zone from setup/dev/advanced.cfg 
and I get the same error 'datacenter id is null'.

Can you send the exact request that you sent ?

> Also in the image_store table the entries look like below, note that the 
> 'role' of NFS store changed to 'ImageCache'.
> 
> '1', 'nfs://10.147.28.6:/export/home/sandbox/secondary', 'NFS', 'nfs', 
> 'nfs://10.147.28.6:/export/home/sandbox/secondary', '1', 'ZONE', 
> 'ImageCache', '8eb3e701-7e2b-4925-87f8-f8ea5f97b863', 
> '/mnt/05b33ef7-da6a-33eb-9981-b4efb90ed99b/', '2014-06-23 06:27:58', 
> NULL, NULL, NULL '2', 'test', 'S3', 'http', 
> 'http://localhost:1234/test', NULL, 'REGION', 'Image', 
> '55b7e6f7-ec27-4da8-b4a0-b209a3e3d825', NULL, '2014-06-23 07:37:55', 
> NULL, NULL, NULL
> 

Yes I can confirm this. It gets listed in the UI under 'secondary staging 
store', and it's in the db.

> 
>> I was then able to add:
>> 
>>> add imagestore name=riakcs provider=S3 
>>> url=http://localhost:9081/riak-cs details[0].key=accesskey 
>>> details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
>>> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>> imagestore:
>> name = riakcs
>> id = 1a60d62a-c1e9-4d1c-8b35-d5cd687f6de4
>> details:
>> +---+--+
>> |name   |  value   |
>> +---+--+
>> | secretkey | ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q== |
>> | accesskey |   ZMJD6-90S2MST4NZMK1Z   |
>> +---+--+
>> protocol = http
>> providername = S3
>> scope = REGION
>> url = http://localhost:9081/riak-cs
>> 
>> Apparently successfully, even though the removal of the NFS store entirely 
>> is a bit worrisome.
>> 
>> On Jun 23, 2014, at 4:32 AM, Koushik Das  wrote:
>> 
>>> The error message is from the simulator storage plugin, not sure why you 
>>> are getting it even after setting provider types as S3.
>>> I tried the same on a 4.4-forward setup and got a different error (as 
>>> below).
>>> "You can only add new image stores from the same provider NFS already added"
>>> 
>>> This error is there as the simulator storage provider doesn't support 
>>> migration to object store. Once I fixed it, the image store got added 
>>> successfully and the NFS store was converted to a cache store.
>>> This is the change I made
>>> 
>>> diff --git 
>>> a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/da
>>> tastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java 
>>> b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/da
>>> tastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>>> index edf1e28..537c7bd 100644
>>> --- 
>>> a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/da
>>> tastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>>> +++ b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storag
>>> +++ e/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
>>> @@ -133,7 +133,7 @@ public class SimulatorImageStoreLifeCycleImpl 
>>> implements ImageStoreLifeCycle {
>>>*/
>>>   @Override
>>>   public boolean migrateToObjectStore(DataStore store) {
>>> -return false;
>>> +return imageStoreHelper.convertToStagingStore(store);
>>>   }
>>> 
>>> }
>>> 
>>> -Original Message-
>>> From: Min Chen [mailto:min.c...@citrix.com]
>>> Sent: Saturday, 21 June 2014 3:44 AM
>>> To: dev@cloudstack.apache.org
>>> Subject: Re: S3 use with simulator
>>> 
>>> Got it. The error

Re: [security] The case of the open dns resolver

2014-06-23 Thread Wido den Hollander




On 06/23/2014 12:31 PM, Nux! wrote:

Hi,

Today I've been bitten again by the $subject and complaints were sent to my 
hoster's abuse email address; apparently someone used my VR in a DDOS attack.
It is my fault as I knew about this issue, but I'd like to throw the blame on 
Cloudstack. :)

So, the VR is accepting DNS requests from everybody on the interwebs and this 
should be changed, imho.

I see there are already iptables rules concerning port 8080 of the VR and only 
the public IP ranges are allowed. Why isn't this the case for port 53 as well?



I see no reason why this shouldn't be the case. DNS is only meant for 
the Instances and not for the rest of the internet in this case.



I have placed this script in my VR's rc.local, but it's not kosher at all.

# disallows global DNS traffic and only allows it from the cloud public subnets
for i in `iptables-save |grep 8080|awk '{print $4}'`; do iptables -I INPUT -s 
$i -p tcp -m tcp --dport 53 -j ACCEPT; iptables -I INPUT -s $i -p udp -m udp 
--dport 53 -j ACCEPT; done
iptables -D INPUT -i eth0 -p udp -m udp --dport 53 -j ACCEPT
iptables -D INPUT -i eth0 -p tcp -m tcp --dport 53 -j ACCEPT

This could be greatly improved and added in the official tree.
Currently I'm getting the subnets by checking which IPs the 8080 rules apply, 
how can I retrieve this information in a more elegant way?

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

Error in listHosts - Infrastructure Tab in UI

2014-06-23 Thread Mark van der Meulen

Hi,

Does anyone know where I can start looking to resolve this error? It occurs
whenever we visit the Infrastructure page in the CS UI ever since we removed
a host(which was apparently successful). It means we can¹t add more hosts or
perform any functions which would be performed from the Infrastructure
section of the UI.

Thanks,

Mark


2014-06-23 17:41:45,279 DEBUG [c.c.a.q.QueryManagerImpl]
(catalina-exec-18:ctx-5ee0ee17 ctx-51f50f45) >>>Searching for hosts>>>
2014-06-23 17:41:45,301 DEBUG [c.c.a.q.QueryManagerImpl]
(catalina-exec-18:ctx-5ee0ee17 ctx-51f50f45) >>>Generating Response>>>
2014-06-23 17:41:45,312 ERROR [c.c.a.ApiServer]
(catalina-exec-18:ctx-5ee0ee17 ctx-51f50f45) unhandled exception executing
api command: listHosts
java.lang.NullPointerException
at 
com.cloud.storage.StorageManagerImpl.isLocalStorageActiveOnHost(StorageManag
erImpl.java:359)
at 
com.cloud.api.ApiDBUtils.isLocalStorageActiveOnHost(ApiDBUtils.java:735)
at 
com.cloud.api.query.dao.HostJoinDaoImpl.newHostResponse(HostJoinDaoImpl.java
:166)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57
)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:43)
at java.lang.reflect.Method.invoke(Method.java:622)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopU
tils.java:317)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint
(ReflectiveMethodInvocation.java:183)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflect
iveMethodInvocation.java:150)
at 
com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextIn
terceptor.java:33)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflect
iveMethodInvocation.java:161)
at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(Expos
eInvocationInterceptor.java:91)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflect
iveMethodInvocation.java:172)
at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopPro
xy.java:204)
at com.sun.proxy.$Proxy262.newHostResponse(Unknown Source)
at com.cloud.api.ApiDBUtils.newHostResponse(ApiDBUtils.java:1540)
at 
com.cloud.api.query.ViewResponseHelper.createHostResponse(ViewResponseHelper
.java:236)
at 
com.cloud.api.query.QueryManagerImpl.searchForServers(QueryManagerImpl.java:
1530)
at 
org.apache.cloudstack.api.command.admin.host.ListHostsCmd.execute(ListHostsC
md.java:179)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:531)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:374)
at 
com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:323)
at com.cloud.api.ApiServlet.access$000(ApiServlet.java:53)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:115)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(Defa
ultManagedContext.java:56)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithCon
text(DefaultManagedContext.java:103)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithCont
ext(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:112)
at com.cloud.api.ApiServlet.doGet(ApiServlet.java:74)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application
FilterChain.java:290)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh
ain.java:206)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.ja
va:233)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.ja
va:191)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127
)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102
)
at 
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:615)
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java
:109)
at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at 
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:
889)
at 
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(H
ttp11NioProtocol.java:744)
at 
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:
2282)
at 
java.util.concurren

Re: S3 use with simulator

2014-06-23 Thread Sebastien Goasguen


On Jun 23, 2014, at 7:14 AM, Koushik Das  wrote:

> This is the request
> 
> http://localhost:8096/api?command=updateCloudToUseObjectStore&url=http://localhost:1234/test&name=test&provider=S3&details[0].key=accesskey&details[0].value=dummy&details[1].key=secretkey&details[1].value=dummy

Any chance you can try with a signed api request ?

It looks like it's not finding a zoneId …hence dcId is null….

> 
> 
> -Original Message-
> From: sebgoa [mailto:run...@gmail.com] 
> Sent: Monday, 23 June 2014 4:40 PM
> To: dev@cloudstack.apache.org
> Subject: Re: S3 use with simulator
> 
> 
> On Jun 23, 2014, at 12:51 PM, Koushik Das  wrote:
> 
>> inline
>> 
>> On 23-Jun-2014, at 4:05 PM, Sebastien Goasguen  wrote:
>> 
>>> Hi Koushik, thanks for the hint, I checked out 4.4-forward and made that 
>>> small change.
>>> 
>>> I still add the same error:
>>> 
 update cloudtouseobjectstore url=http://localhost:9081/riak-cs 
 name=riakcs provider=s3 details[0].key=accesskey 
 details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
 details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>>> 530: Failed to add data store: DataCenter id is null, and simulator 
>>> image store has to be associated with a data center
>>> 
>>> However this actually *removed* the NFS store (from the simulated basic 
>>> zone).
>>> 
>> 
>> I verified using advanced zone, not sure if there are any issues with basic 
>> zone. The API response I get is the following:
>> > cloud-stack-version="4.4.0-SNAPSHOT">55b7e6f7-ec27-4da
>> 8-b4a0-b209a3e3d825testhttp://localhost:1234/te
>> sthttpS3>> REGIONsecretkeydummy> tails>accesskeydummy> magestore>
>> 
> 
> Hum, strange. I just checked with an advanced zone from 
> setup/dev/advanced.cfg and I get the same error 'datacenter id is null'.
> 
> Can you send the exact request that you sent ?
> 
>> Also in the image_store table the entries look like below, note that the 
>> 'role' of NFS store changed to 'ImageCache'.
>> 
>> '1', 'nfs://10.147.28.6:/export/home/sandbox/secondary', 'NFS', 'nfs', 
>> 'nfs://10.147.28.6:/export/home/sandbox/secondary', '1', 'ZONE', 
>> 'ImageCache', '8eb3e701-7e2b-4925-87f8-f8ea5f97b863', 
>> '/mnt/05b33ef7-da6a-33eb-9981-b4efb90ed99b/', '2014-06-23 06:27:58', 
>> NULL, NULL, NULL '2', 'test', 'S3', 'http', 
>> 'http://localhost:1234/test', NULL, 'REGION', 'Image', 
>> '55b7e6f7-ec27-4da8-b4a0-b209a3e3d825', NULL, '2014-06-23 07:37:55', 
>> NULL, NULL, NULL
>> 
> 
> Yes I can confirm this. It gets listed in the UI under 'secondary staging 
> store', and it's in the db.
> 
>> 
>>> I was then able to add:
>>> 
 add imagestore name=riakcs provider=S3 
 url=http://localhost:9081/riak-cs details[0].key=accesskey 
 details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
 details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>>> imagestore:
>>> name = riakcs
>>> id = 1a60d62a-c1e9-4d1c-8b35-d5cd687f6de4
>>> details:
>>> +---+--+
>>> |name   |  value   |
>>> +---+--+
>>> | secretkey | ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q== |
>>> | accesskey |   ZMJD6-90S2MST4NZMK1Z   |
>>> +---+--+
>>> protocol = http
>>> providername = S3
>>> scope = REGION
>>> url = http://localhost:9081/riak-cs
>>> 
>>> Apparently successfully, even though the removal of the NFS store entirely 
>>> is a bit worrisome.
>>> 
>>> On Jun 23, 2014, at 4:32 AM, Koushik Das  wrote:
>>> 
 The error message is from the simulator storage plugin, not sure why you 
 are getting it even after setting provider types as S3.
 I tried the same on a 4.4-forward setup and got a different error (as 
 below).
 "You can only add new image stores from the same provider NFS already 
 added"
 
 This error is there as the simulator storage provider doesn't support 
 migration to object store. Once I fixed it, the image store got added 
 successfully and the NFS store was converted to a cache store.
 This is the change I made
 
 diff --git 
 a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/da
 tastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java 
 b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/da
 tastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
 index edf1e28..537c7bd 100644
 --- 
 a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/da
 tastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
 +++ b/plugins/hypervisors/simulator/src/org/apache/cloudstack/storag
 +++ e/datastore/lifecycle/SimulatorImageStoreLifeCycleImpl.java
 @@ -133,7 +133,7 @@ public class SimulatorImageStoreLifeCycleImpl 
 implements ImageStoreLifeCycle {
   */
  @Override
  public boolean migrateToObjectStore(DataStore store) {
 -return fa

RE: S3 use with simulator

This has nothing to do with the zoneId. If you search the source code for the 
error message "Failed to add data store: DataCenter id is null, and simulator 
image store has to be associated with a data center", it points to 
SimulatorImageStoreLifeCycleImpl.initialize() method. This indicates that 
somehow the image store provider for Simulator is getting picked up. For S3 
provider type, the S3ImageStoreLifeCycleImpl should get invoked and in that the 
zoneId is not used so there won't be issues.


-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: Monday, 23 June 2014 5:47 PM
To: dev@cloudstack.apache.org
Subject: Re: S3 use with simulator


On Jun 23, 2014, at 7:14 AM, Koushik Das  wrote:

> This is the request
> 
> http://localhost:8096/api?command=updateCloudToUseObjectStore&url=http
> ://localhost:1234/test&name=test&provider=S3&details[0].key=accesskey&
> details[0].value=dummy&details[1].key=secretkey&details[1].value=dummy

Any chance you can try with a signed api request ?

It looks like it's not finding a zoneId ...hence dcId is null

> 
> 
> -Original Message-
> From: sebgoa [mailto:run...@gmail.com]
> Sent: Monday, 23 June 2014 4:40 PM
> To: dev@cloudstack.apache.org
> Subject: Re: S3 use with simulator
> 
> 
> On Jun 23, 2014, at 12:51 PM, Koushik Das  wrote:
> 
>> inline
>> 
>> On 23-Jun-2014, at 4:05 PM, Sebastien Goasguen  wrote:
>> 
>>> Hi Koushik, thanks for the hint, I checked out 4.4-forward and made that 
>>> small change.
>>> 
>>> I still add the same error:
>>> 
 update cloudtouseobjectstore url=http://localhost:9081/riak-cs 
 name=riakcs provider=s3 details[0].key=accesskey 
 details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
 details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>>> 530: Failed to add data store: DataCenter id is null, and simulator 
>>> image store has to be associated with a data center
>>> 
>>> However this actually *removed* the NFS store (from the simulated basic 
>>> zone).
>>> 
>> 
>> I verified using advanced zone, not sure if there are any issues with basic 
>> zone. The API response I get is the following:
>> > cloud-stack-version="4.4.0-SNAPSHOT">55b7e6f7-ec27-4d
>> a 
>> 8-b4a0-b209a3e3d825testhttp://localhost:1234/t
>> e 
>> sthttpS3> e
>>> REGIONsecretkeydummy>> e
>> tails>accesskeydummy> tails>i
>> magestore>
>> 
> 
> Hum, strange. I just checked with an advanced zone from 
> setup/dev/advanced.cfg and I get the same error 'datacenter id is null'.
> 
> Can you send the exact request that you sent ?
> 
>> Also in the image_store table the entries look like below, note that the 
>> 'role' of NFS store changed to 'ImageCache'.
>> 
>> '1', 'nfs://10.147.28.6:/export/home/sandbox/secondary', 'NFS', 
>> 'nfs', 'nfs://10.147.28.6:/export/home/sandbox/secondary', '1', 
>> 'ZONE', 'ImageCache', '8eb3e701-7e2b-4925-87f8-f8ea5f97b863',
>> '/mnt/05b33ef7-da6a-33eb-9981-b4efb90ed99b/', '2014-06-23 06:27:58', 
>> NULL, NULL, NULL '2', 'test', 'S3', 'http', 
>> 'http://localhost:1234/test', NULL, 'REGION', 'Image', 
>> '55b7e6f7-ec27-4da8-b4a0-b209a3e3d825', NULL, '2014-06-23 07:37:55', 
>> NULL, NULL, NULL
>> 
> 
> Yes I can confirm this. It gets listed in the UI under 'secondary staging 
> store', and it's in the db.
> 
>> 
>>> I was then able to add:
>>> 
 add imagestore name=riakcs provider=S3 
 url=http://localhost:9081/riak-cs details[0].key=accesskey 
 details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
 details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>>> imagestore:
>>> name = riakcs
>>> id = 1a60d62a-c1e9-4d1c-8b35-d5cd687f6de4
>>> details:
>>> +---+--+
>>> |name   |  value   |
>>> +---+--+
>>> | secretkey | ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q== |
>>> | accesskey |   ZMJD6-90S2MST4NZMK1Z   |
>>> +---+--+
>>> protocol = http
>>> providername = S3
>>> scope = REGION
>>> url = http://localhost:9081/riak-cs
>>> 
>>> Apparently successfully, even though the removal of the NFS store entirely 
>>> is a bit worrisome.
>>> 
>>> On Jun 23, 2014, at 4:32 AM, Koushik Das  wrote:
>>> 
 The error message is from the simulator storage plugin, not sure why you 
 are getting it even after setting provider types as S3.
 I tried the same on a 4.4-forward setup and got a different error (as 
 below).
 "You can only add new image stores from the same provider NFS already 
 added"
 
 This error is there as the simulator storage provider doesn't support 
 migration to object store. Once I fixed it, the image store got added 
 successfully and the NFS store was converted to a cache store.
 This is the change I made
 
 diff --git
 a/plugins/hypervisors/simulator/src/org/apache/cloudstack/storage/d
 a tastore/l

RE: Review Request 22814: The OVM3 module itself

2014-06-23 Thread Funs Kessen

Hi Ian,

I've built it so that it should be able to deal with a "default" install.. By 
default the agent password is asked at install time, and I don't know how to 
insert that at install time when it's a headless install. I do know that we can 
change it locally quite simple, and we could leverage the insertion of the 
plugin for it. Although it would be nice if we could set it at install time of 
the image.

Does that still make sense ?

Cheers,

Funs

> -Original Message-
> From: Ian Duffy [mailto:i...@ianduffy.ie]
> Sent: Friday, June 20, 2014 9:06 PM
> To: CloudStack Dev; Sebastien Goasguen
> Cc: Funs Kessen
> Subject: Re: Review Request 22814: The OVM3 module itself
> 
> Is there any initial setup to be done on OVM Server or is it as simple as
> selecting OVM on cloudstack with the username / password?
> 
> 
> On 20 June 2014 14:30, Sebastien Goasguen  wrote:
> 
> >
> > ---
> > This is an automatically generated e-mail. To reply, visit:
> > https://reviews.apache.org/r/22814/#review46271
> > ---
> >
> > Ship it!
> >
> >
> > committed to ovmsupport
> 1516b041bc762535b8f2e74bcb1e6594e5657f86
> >
> > - Sebastien Goasguen
> >
> >
> > On June 20, 2014, 1:19 p.m., Funs Kessen wrote:
> > >
> > > ---
> > > This is an automatically generated e-mail. To reply, visit:
> > > https://reviews.apache.org/r/22814/
> > > ---
> > >
> > > (Updated June 20, 2014, 1:19 p.m.)
> > >
> > >
> > > Review request for cloudstack.
> > >
> > >
> > > Repository: cloudstack-git
> > >
> > >
> > > Description
> > > ---
> > >
> > > I forgot the module itself =)
> > >
> > >
> > > Diffs
> > > -
> > >
> > >   plugins/hypervisors/ovm3 bd64f2d
> > >   plugins/hypervisors/ovm3/pom.xml PRE-CREATION
> > >
> > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> compute/mo
> > dule.properties
> > PRE-CREATION
> > >
> > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> compute/sp
> > ring-ovm3-compute-context.xml
> > PRE-CREATION
> > >
> > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> discoverer
> > /module.properties
> > PRE-CREATION
> > >
> > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> discoverer
> > /spring-ovm3-discoverer-context.xml
> > PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/clean_master.sh PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/clean_slave.sh PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/create_pool_cluster.py PRE-
> CREATION
> > >   plugins/hypervisors/ovm3/scripts/info.py PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/ovs_agent_plugin/cloudstack.py
> > PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/password.py PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/repo_pool.py PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/simple_pool.py PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/socat.sh PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/tail.sh PRE-CREATION
> > >   plugins/hypervisors/ovm3/src/com/cloud/ha/Ovm3Investigator.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> m3
> > Discoverer.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> m3
> > Fencer.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> m3
> > Guru.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> m3
> > Helper.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> m3
> > ResourceBase.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/CloudSt
> a
> > ckPlugin.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Cluster.
> > java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Commo
> n.j
> > ava
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Connect
> i
> > on.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Linux.ja
> > va
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Network
> .
> > java
> > PRE-CREATION
> > >
> > >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Ntp.ja
> > > va
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/OvmObj
> ec
> > t.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Pool.jav
> > a
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/PoolOC
> FS
> > 2.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/s

How to pass custom rootdisksize through UI

2014-06-23 Thread Gaurav Aradhye

Hello,

I was wondering how to pass the custom rootdisksize parameter through UI
(KVM setup) while deploying VM? I am aware of how to pass it through API. I
want to validate one possible product issue.

Quick response appreciated.

Regards,
Gaurav

Re: Review Request 22814: The OVM3 module itself

OK, Thanks Funs. Will give it a go sometime later this week.


On 23 June 2014 13:32, Funs Kessen  wrote:

> Hi Ian,
>
> I've built it so that it should be able to deal with a "default" install..
> By default the agent password is asked at install time, and I don't know
> how to insert that at install time when it's a headless install. I do know
> that we can change it locally quite simple, and we could leverage the
> insertion of the plugin for it. Although it would be nice if we could set
> it at install time of the image.
>
> Does that still make sense ?
>
> Cheers,
>
> Funs
>
> > -Original Message-
> > From: Ian Duffy [mailto:i...@ianduffy.ie]
> > Sent: Friday, June 20, 2014 9:06 PM
> > To: CloudStack Dev; Sebastien Goasguen
> > Cc: Funs Kessen
> > Subject: Re: Review Request 22814: The OVM3 module itself
> >
> > Is there any initial setup to be done on OVM Server or is it as simple as
> > selecting OVM on cloudstack with the username / password?
> >
> >
> > On 20 June 2014 14:30, Sebastien Goasguen  wrote:
> >
> > >
> > > ---
> > > This is an automatically generated e-mail. To reply, visit:
> > > https://reviews.apache.org/r/22814/#review46271
> > > ---
> > >
> > > Ship it!
> > >
> > >
> > > committed to ovmsupport
> > 1516b041bc762535b8f2e74bcb1e6594e5657f86
> > >
> > > - Sebastien Goasguen
> > >
> > >
> > > On June 20, 2014, 1:19 p.m., Funs Kessen wrote:
> > > >
> > > > ---
> > > > This is an automatically generated e-mail. To reply, visit:
> > > > https://reviews.apache.org/r/22814/
> > > > ---
> > > >
> > > > (Updated June 20, 2014, 1:19 p.m.)
> > > >
> > > >
> > > > Review request for cloudstack.
> > > >
> > > >
> > > > Repository: cloudstack-git
> > > >
> > > >
> > > > Description
> > > > ---
> > > >
> > > > I forgot the module itself =)
> > > >
> > > >
> > > > Diffs
> > > > -
> > > >
> > > >   plugins/hypervisors/ovm3 bd64f2d
> > > >   plugins/hypervisors/ovm3/pom.xml PRE-CREATION
> > > >
> > > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> > compute/mo
> > > dule.properties
> > > PRE-CREATION
> > > >
> > > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> > compute/sp
> > > ring-ovm3-compute-context.xml
> > > PRE-CREATION
> > > >
> > > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> > discoverer
> > > /module.properties
> > > PRE-CREATION
> > > >
> > > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> > discoverer
> > > /spring-ovm3-discoverer-context.xml
> > > PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/clean_master.sh PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/clean_slave.sh PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/create_pool_cluster.py PRE-
> > CREATION
> > > >   plugins/hypervisors/ovm3/scripts/info.py PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/ovs_agent_plugin/cloudstack.py
> > > PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/password.py PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/repo_pool.py PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/simple_pool.py PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/socat.sh PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/tail.sh PRE-CREATION
> > > >   plugins/hypervisors/ovm3/src/com/cloud/ha/Ovm3Investigator.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> > m3
> > > Discoverer.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> > m3
> > > Fencer.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> > m3
> > > Guru.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> > m3
> > > Helper.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> > m3
> > > ResourceBase.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/CloudSt
> > a
> > > ckPlugin.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Cluster.
> > > java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Commo
> > n.j
> > > ava
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Connect
> > i
> > > on.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Linux.ja
> > > va
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Network
> > .
> > > java
> > > PRE-CREATION
> > > >
> > > >
> > plugins/hypervisors/ovm3/src/com

Re: How to pass custom rootdisksize through UI

2014-06-23 Thread Gaurav Aradhye

I am looking for relevant option on template selection screen, nothing
there, and no option on other screens too. So how do we pass custom root
disk size?

Regards,
Gaurav

On Mon, Jun 23, 2014 at 6:07 PM, Gaurav Aradhye 
wrote:

> Hello,
>
> I was wondering how to pass the custom rootdisksize parameter through UI
> (KVM setup) while deploying VM? I am aware of how to pass it through API. I
> want to validate one possible product issue.
>
> Quick response appreciated.
>
> Regards,
> Gaurav
>

Re: S3 use with simulator

2014-06-23 Thread sebgoa


On Jun 23, 2014, at 2:30 PM, Koushik Das  wrote:

> This has nothing to do with the zoneId. If you search the source code for the 
> error message "Failed to add data store: DataCenter id is null, and simulator 
> image store has to be associated with a data center", it points 
> toSimulatorImageStoreLifeCycleImpl.initialize() method. This indicates that 
> somehow the image store provider for Simulator is getting picked up. For S3 
> provider type, the S3ImageStoreLifeCycleImpl should get invoked and in that 
> the zoneId is not used so there won't be issues.

Happy to discuss it on IRC, if you could join.

in SimulatorImageStoreLifeCycleImpl.initialize() on 4.4-forward I see:

 Long dcId = (Long)dsInfos.get("zoneId");
String url = (String)dsInfos.get("url");
String name = (String)dsInfos.get("name");
if (name == null) {
name = url;
}
 ...

if (dcId == null) {
throw new InvalidParameterValueException("DataCenter id is null, 
and simulator image store has to be associated with a data center");
}

So my non Java expertise tells me that dcId is null because zoneId is not set 
???


> 
> 
> -Original Message-
> From: Sebastien Goasguen [mailto:run...@gmail.com] 
> Sent: Monday, 23 June 2014 5:47 PM
> To: dev@cloudstack.apache.org
> Subject: Re: S3 use with simulator
> 
> 
> On Jun 23, 2014, at 7:14 AM, Koushik Das  wrote:
> 
>> This is the request
>> 
>> http://localhost:8096/api?command=updateCloudToUseObjectStore&url=http
>> ://localhost:1234/test&name=test&provider=S3&details[0].key=accesskey&
>> details[0].value=dummy&details[1].key=secretkey&details[1].value=dummy
> 
> Any chance you can try with a signed api request ?
> 
> It looks like it's not finding a zoneId ...hence dcId is null
> 
>> 
>> 
>> -Original Message-
>> From: sebgoa [mailto:run...@gmail.com]
>> Sent: Monday, 23 June 2014 4:40 PM
>> To: dev@cloudstack.apache.org
>> Subject: Re: S3 use with simulator
>> 
>> 
>> On Jun 23, 2014, at 12:51 PM, Koushik Das  wrote:
>> 
>>> inline
>>> 
>>> On 23-Jun-2014, at 4:05 PM, Sebastien Goasguen  wrote:
>>> 
 Hi Koushik, thanks for the hint, I checked out 4.4-forward and made that 
 small change.
 
 I still add the same error:
 
> update cloudtouseobjectstore url=http://localhost:9081/riak-cs 
> name=riakcs provider=s3 details[0].key=accesskey 
> details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
 530: Failed to add data store: DataCenter id is null, and simulator 
 image store has to be associated with a data center
 
 However this actually *removed* the NFS store (from the simulated basic 
 zone).
 
>>> 
>>> I verified using advanced zone, not sure if there are any issues with basic 
>>> zone. The API response I get is the following:
>>> >> cloud-stack-version="4.4.0-SNAPSHOT">55b7e6f7-ec27-4d
>>> a 
>>> 8-b4a0-b209a3e3d825testhttp://localhost:1234/t
>>> e 
>>> sthttpS3>> e
 REGIONsecretkeydummy>>> e
>>> tails>accesskeydummy>> tails>i
>>> magestore>
>>> 
>> 
>> Hum, strange. I just checked with an advanced zone from 
>> setup/dev/advanced.cfg and I get the same error 'datacenter id is null'.
>> 
>> Can you send the exact request that you sent ?
>> 
>>> Also in the image_store table the entries look like below, note that the 
>>> 'role' of NFS store changed to 'ImageCache'.
>>> 
>>> '1', 'nfs://10.147.28.6:/export/home/sandbox/secondary', 'NFS', 
>>> 'nfs', 'nfs://10.147.28.6:/export/home/sandbox/secondary', '1', 
>>> 'ZONE', 'ImageCache', '8eb3e701-7e2b-4925-87f8-f8ea5f97b863',
>>> '/mnt/05b33ef7-da6a-33eb-9981-b4efb90ed99b/', '2014-06-23 06:27:58', 
>>> NULL, NULL, NULL '2', 'test', 'S3', 'http', 
>>> 'http://localhost:1234/test', NULL, 'REGION', 'Image', 
>>> '55b7e6f7-ec27-4da8-b4a0-b209a3e3d825', NULL, '2014-06-23 07:37:55', 
>>> NULL, NULL, NULL
>>> 
>> 
>> Yes I can confirm this. It gets listed in the UI under 'secondary staging 
>> store', and it's in the db.
>> 
>>> 
 I was then able to add:
 
> add imagestore name=riakcs provider=S3 
> url=http://localhost:9081/riak-cs details[0].key=accesskey 
> details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
 imagestore:
 name = riakcs
 id = 1a60d62a-c1e9-4d1c-8b35-d5cd687f6de4
 details:
 +---+--+
 |name   |  value   |
 +---+--+
 | secretkey | ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q== |
 | accesskey |   ZMJD6-90S2MST4NZMK1Z   |
 +---+--+
 protocol = http
 providername = S3
 scope = REGION
 url = http://localhost:9081/riak-cs
 
 Apparently successfully, even though the removal o

Re: How to pass custom rootdisksize through UI

Hello,

This option is not yet in the UI and you'll need version 4.4 to use it anyway.
More details here:
https://issues.apache.org/jira/browse/CLOUDSTACK-6181 (search for 
details[0].rootdisksize)

HTH
Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro


- Original Message -
From: "Gaurav Aradhye" 
To: dev@cloudstack.apache.org
Sent: Monday, 23 June, 2014 1:37:57 PM
Subject: How to pass custom rootdisksize through UI

Hello,

I was wondering how to pass the custom rootdisksize parameter through UI
(KVM setup) while deploying VM? I am aware of how to pass it through API. I
want to validate one possible product issue.

Quick response appreciated.

Regards,
Gaurav

RE: Review Request 22814: The OVM3 module itself

2014-06-23 Thread Funs Kessen

Hi Ian,

Looked at the src-rpm just now, but it seems like they don’t “allow” setting of 
the password from there. The cli does allow for setting of the password by 
simply invoking “ovs-agent-passwd oracle ” would that suffice ?

Cheers,

Funs

From: Ian Duffy [mailto:i...@ianduffy.ie]
Sent: Monday, June 23, 2014 2:42 PM
To: Funs Kessen
Cc: CloudStack Dev; Sebastien Goasguen; Funs Kessen
Subject: Re: Review Request 22814: The OVM3 module itself

OK, Thanks Funs. Will give it a go sometime later this week.

On 23 June 2014 13:32, Funs Kessen 
mailto:fkes...@schubergphilis.com>> wrote:
Hi Ian,

I've built it so that it should be able to deal with a "default" install.. By 
default the agent password is asked at install time, and I don't know how to 
insert that at install time when it's a headless install. I do know that we can 
change it locally quite simple, and we could leverage the insertion of the 
plugin for it. Although it would be nice if we could set it at install time of 
the image.

Does that still make sense ?

Cheers,

Funs

> -Original Message-
> From: Ian Duffy [mailto:i...@ianduffy.ie]
> Sent: Friday, June 20, 2014 9:06 PM
> To: CloudStack Dev; Sebastien Goasguen
> Cc: Funs Kessen
> Subject: Re: Review Request 22814: The OVM3 module itself
>
> Is there any initial setup to be done on OVM Server or is it as simple as
> selecting OVM on cloudstack with the username / password?
>
>
> On 20 June 2014 14:30, Sebastien Goasguen 
> mailto:run...@gmail.com>> wrote:
>
> >
> > ---
> > This is an automatically generated e-mail. To reply, visit:
> > https://reviews.apache.org/r/22814/#review46271
> > ---
> >
> > Ship it!
> >
> >
> > committed to ovmsupport
> 1516b041bc762535b8f2e74bcb1e6594e5657f86
> >
> > - Sebastien Goasguen
> >
> >
> > On June 20, 2014, 1:19 p.m., Funs Kessen wrote:
> > >
> > > ---
> > > This is an automatically generated e-mail. To reply, visit:
> > > https://reviews.apache.org/r/22814/
> > > ---
> > >
> > > (Updated June 20, 2014, 1:19 p.m.)
> > >
> > >
> > > Review request for cloudstack.
> > >
> > >
> > > Repository: cloudstack-git
> > >
> > >
> > > Description
> > > ---
> > >
> > > I forgot the module itself =)
> > >
> > >
> > > Diffs
> > > -
> > >
> > >   plugins/hypervisors/ovm3 bd64f2d
> > >   plugins/hypervisors/ovm3/pom.xml PRE-CREATION
> > >
> > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> compute/mo
> > dule.properties
> > PRE-CREATION
> > >
> > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> compute/sp
> > ring-ovm3-compute-context.xml
> > PRE-CREATION
> > >
> > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> discoverer
> > /module.properties
> > PRE-CREATION
> > >
> > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> discoverer
> > /spring-ovm3-discoverer-context.xml
> > PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/clean_master.sh PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/clean_slave.sh PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/create_pool_cluster.py PRE-
> CREATION
> > >   plugins/hypervisors/ovm3/scripts/info.py PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/ovs_agent_plugin/cloudstack.py
> > PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/password.py PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/repo_pool.py PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/simple_pool.py PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/socat.sh PRE-CREATION
> > >   plugins/hypervisors/ovm3/scripts/tail.sh PRE-CREATION
> > >   plugins/hypervisors/ovm3/src/com/cloud/ha/Ovm3Investigator.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> m3
> > Discoverer.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> m3
> > Fencer.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> m3
> > Guru.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> m3
> > Helper.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> m3
> > ResourceBase.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/CloudSt
> a
> > ckPlugin.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Cluster.
> > java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Commo
> n.j
> > ava
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/object/Connect
> i
> > on.java
> > PRE-CREATION
> > >
> >
> plugins/hypervisors/ovm3/src/com/cloud/hypervis

Build failed in Jenkins: build-master #1008

See 

Changes:

[Daan Hoogland] raw immage for ovm

--
[...truncated 197 lines...]
16/18 KB   
18/18 KB   
   
Downloaded: 
http://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.pom
 (18 KB at 1281.0 KB/sec)
Downloading: 
http://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/5/commons-parent-5.pom
3/16 KB
7/16 KB   
11/16 KB   
15/16 KB   
16/16 KB   
   
Downloaded: 
http://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/5/commons-parent-5.pom
 (16 KB at 921.5 KB/sec)
Downloading: 
http://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.3/commons-codec-1.3.pom
4/6 KB 
6/6 KB   
 
Downloaded: 
http://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.3/commons-codec-1.3.pom
 (6 KB at 541.9 KB/sec)
Downloading: 
http://repo.maven.apache.org/maven2/org/apache/axis2/axis2-aar-maven-plugin/1.6.2/axis2-aar-maven-plugin-1.6.2.jar
Downloading: 
http://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/2.2/maven-archiver-2.2.jar
Downloading: 
http://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/1.0-alpha-7/plexus-archiver-1.0-alpha-7.jar
Downloading: 
http://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/1.4.9/plexus-utils-1.4.9.jar
Downloading: 
http://repo.maven.apache.org/maven2/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
3/21 KB   
7/21 KB   
7/21 KB   4/298 KB   
7/21 KB   8/298 KB   
7/21 KB   3/200 KB   8/298 KB   
7/21 KB   7/200 KB   8/298 KB   4/10 KB   
7/21 KB   11/200 KB   8/298 KB   4/10 KB   
11/21 KB   4/139 KB   11/200 KB   8/298 KB   4/10 KB   
11/21 KB   4/139 KB   15/200 KB   8/298 KB   4/10 KB   
15/21 KB   4/139 KB   15/200 KB   8/298 KB   4/10 KB   
7/21 KB   7/200 KB   8/298 KB   4/10 KB   
15/21 KB   4/139 KB   19/200 KB   8/298 KB   4/10 KB   
15/21 KB   4/139 KB   19/200 KB   8/298 KB   8/10 KB   
15/21 KB   4/139 KB   23/200 KB   8/298 KB   8/10 KB   
15/21 KB   4/139 KB   23/200 KB   8/298 KB   10/10 KB   
7/21 KB   4/139 KB   11/200 KB   8/298 KB   4/10 KB   
15/21 KB   4/139 KB   23/200 KB   12/298 KB   10/10 KB   
15/21 KB   8/139 KB   23/200 KB   12/298 KB   10/10 KB   
15/21 KB   8/139 KB   23/200 KB   16/298 KB   10/10 KB   
15/21 KB   12/139 KB   23/200 KB   16/298 KB   10/10 KB   
15/21 KB   12/139 KB   23/200 KB   20/298 KB   10/10 KB   
15/21 KB   16/139 KB   23/200 KB   20/298 KB   10/10 KB   
15/21 KB   16/139 KB   23/200 KB   24/298 KB   10/10 KB   
15/21 KB   20/139 KB   23/200 KB   28/298 KB   10/10 KB   
19/21 KB   20/139 KB   23/200 KB   28/298 KB   10/10 KB   
19/21 KB   20/139 KB   23/200 KB   32/298 KB   10/10 KB   
21/21 KB   20/139 KB   23/200 KB   32/298 KB   10/10 KB   
15/21 KB   20/139 KB   23/200 KB   24/298 KB   10/10 KB   
  
21/21 KB   20/139 KB   27/200 KB   36/298 KB   10/10 KB   
21/21 KB   24/139 KB   27/200 KB   36/298 KB  
21/21 KB   24/139 KB   31/200 KB   36/298 KB   
21/21 KB   20/139 KB   23/200 KB   36/298 KB   10/10 KB   
21/21 KB   28/139 KB   31/200 KB   36/298 KB   
Downloaded: 
http://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/2.2/maven-archiver-2.2.jar
 (10 KB at 425.4 KB/sec)
21/21 KB   28/139 KB   35/200 KB   40/298 KB   
21/21 KB   28/139 KB   35/200 KB   36/298 KB   
21/21 KB   32/139 KB   35/200 KB   40/298 KB   
21/21 KB   32/139 KB   35/200 KB   44/298 KB   
Downloading: 
http://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar
21/21 KB   36/139 KB   39/200 KB   44/298 KB   
21/21 KB   32/139 KB   39/200 KB   44/298 KB   
21/21 KB   40/139 KB   39/200 KB   48/298 KB   
21/21 KB   36/139 KB   39/200 KB   48/298 KB   
   
Downloaded: 
http://repo.maven.apache.org/maven2/org/apache/axis2/axis2-aar-maven-plugin/1.6.2/axis2-aar-maven-plugin-1.6.2.jar
 (21 KB at 730.2 KB/sec)
21/21 KB   40/139 KB   43/200 KB   48/298 KB   
44/139 KB   43/200 KB   48/298 KB  
44/139 KB   43/200 KB   52/298 KB   
44/139 KB   47/200 KB   52/298 KB   
48/139 KB   47/200 KB   52/298 KB   
48/139 KB   47/200 KB   56/298 KB   
48/139 KB   51/200 KB   56/298 KB   
52/139 KB   51/200 KB   56/298 KB   
Downloading: 
http://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.3/commons-codec-1.3.jar
52/139 KB   51/200 KB   60/298 KB   
52/139 KB   51/200 KB   60/298 KB   3/60 KB   
56/139 KB   55/200 KB   60/298 KB   3/60 KB   
56/139 KB   55/200 KB   60/298 KB   7/60 KB   
56/139 KB   55/200 KB   64/298 KB   7/60 KB   
60/139 KB   55/200 KB   64/298 KB   7/60 KB   
60/139 KB   55/200 KB   68/298 KB   11/60 KB   
60/139 KB   55/200 KB   68/298 KB   11/60 KB   
64/139 KB   55/200 KB   68/298 KB   11/60 KB   
64/139 KB   55/200 KB   72/298 KB   11/60 KB   
64/139 KB   55/200 KB   72/298 KB

Re: How to pass custom rootdisksize through UI

2014-06-23 Thread Gaurav Aradhye

Thanks!

Regards,
Gaurav


On Mon, Jun 23, 2014 at 6:18 PM, Nux!  wrote:

> Hello,
>
> This option is not yet in the UI and you'll need version 4.4 to use it
> anyway.
> More details here:
> https://issues.apache.org/jira/browse/CLOUDSTACK-6181 (search for
> details[0].rootdisksize)
>
> HTH
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>
>
> - Original Message -
> From: "Gaurav Aradhye" 
> To: dev@cloudstack.apache.org
> Sent: Monday, 23 June, 2014 1:37:57 PM
> Subject: How to pass custom rootdisksize through UI
>
> Hello,
>
> I was wondering how to pass the custom rootdisksize parameter through UI
> (KVM setup) while deploying VM? I am aware of how to pass it through API. I
> want to validate one possible product issue.
>
> Quick response appreciated.
>
> Regards,
> Gaurav
>

Re: Review Request 22814: The OVM3 module itself

> Looked at the src-rpm just now, but it seems like they don’t “allow”
setting of the password from there. The cli does allow for setting of the
password by simply invoking “ovs-agent-passwd oracle ” would that
suffice ?

Sounds perfect!

Thanks again.


On 23 June 2014 14:04, Funs Kessen  wrote:

> Hi Ian,
>
> Looked at the src-rpm just now, but it seems like they don’t “allow”
> setting of the password from there. The cli does allow for setting of the
> password by simply invoking “ovs-agent-passwd oracle ” would that
> suffice ?
>
> Cheers,
>
> Funs
>
> From: Ian Duffy [mailto:i...@ianduffy.ie]
> Sent: Monday, June 23, 2014 2:42 PM
> To: Funs Kessen
> Cc: CloudStack Dev; Sebastien Goasguen; Funs Kessen
> Subject: Re: Review Request 22814: The OVM3 module itself
>
> OK, Thanks Funs. Will give it a go sometime later this week.
>
> On 23 June 2014 13:32, Funs Kessen  fkes...@schubergphilis.com>> wrote:
> Hi Ian,
>
> I've built it so that it should be able to deal with a "default" install..
> By default the agent password is asked at install time, and I don't know
> how to insert that at install time when it's a headless install. I do know
> that we can change it locally quite simple, and we could leverage the
> insertion of the plugin for it. Although it would be nice if we could set
> it at install time of the image.
>
> Does that still make sense ?
>
> Cheers,
>
> Funs
>
> > -Original Message-
> > From: Ian Duffy [mailto:i...@ianduffy.ie]
> > Sent: Friday, June 20, 2014 9:06 PM
> > To: CloudStack Dev; Sebastien Goasguen
> > Cc: Funs Kessen
> > Subject: Re: Review Request 22814: The OVM3 module itself
> >
> > Is there any initial setup to be done on OVM Server or is it as simple as
> > selecting OVM on cloudstack with the username / password?
> >
> >
> > On 20 June 2014 14:30, Sebastien Goasguen  run...@gmail.com>> wrote:
> >
> > >
> > > ---
> > > This is an automatically generated e-mail. To reply, visit:
> > > https://reviews.apache.org/r/22814/#review46271
> > > ---
> > >
> > > Ship it!
> > >
> > >
> > > committed to ovmsupport
> > 1516b041bc762535b8f2e74bcb1e6594e5657f86
> > >
> > > - Sebastien Goasguen
> > >
> > >
> > > On June 20, 2014, 1:19 p.m., Funs Kessen wrote:
> > > >
> > > > ---
> > > > This is an automatically generated e-mail. To reply, visit:
> > > > https://reviews.apache.org/r/22814/
> > > > ---
> > > >
> > > > (Updated June 20, 2014, 1:19 p.m.)
> > > >
> > > >
> > > > Review request for cloudstack.
> > > >
> > > >
> > > > Repository: cloudstack-git
> > > >
> > > >
> > > > Description
> > > > ---
> > > >
> > > > I forgot the module itself =)
> > > >
> > > >
> > > > Diffs
> > > > -
> > > >
> > > >   plugins/hypervisors/ovm3 bd64f2d
> > > >   plugins/hypervisors/ovm3/pom.xml PRE-CREATION
> > > >
> > > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> > compute/mo
> > > dule.properties
> > > PRE-CREATION
> > > >
> > > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> > compute/sp
> > > ring-ovm3-compute-context.xml
> > > PRE-CREATION
> > > >
> > > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> > discoverer
> > > /module.properties
> > > PRE-CREATION
> > > >
> > > plugins/hypervisors/ovm3/resources/META-INF/cloudstack/ovm3-
> > discoverer
> > > /spring-ovm3-discoverer-context.xml
> > > PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/clean_master.sh PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/clean_slave.sh PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/create_pool_cluster.py PRE-
> > CREATION
> > > >   plugins/hypervisors/ovm3/scripts/info.py PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/ovs_agent_plugin/cloudstack.py
> > > PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/password.py PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/repo_pool.py PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/simple_pool.py PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/socat.sh PRE-CREATION
> > > >   plugins/hypervisors/ovm3/scripts/tail.sh PRE-CREATION
> > > >   plugins/hypervisors/ovm3/src/com/cloud/ha/Ovm3Investigator.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> > m3
> > > Discoverer.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> > m3
> > > Fencer.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> > m3
> > > Guru.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hypervisor/Ov
> > m3
> > > Helper.java
> > > PRE-CREATION
> > > >
> > >
> > plugins/hypervisors/ovm3/src/com/cloud/hypervisor/ovm3/hyperv

Jenkins build is back to normal : build-master #1009

See

Re: S3 use with simulator

2014-06-23 Thread Prasanna Santhanam

Be advised that advanced.cfg might be adding the NFS store as
secondary storage as opposed to cacheStorage that the S3 image store
needs it to be. At least that's how it was the last time I ran it.

On Mon, Jun 23, 2014 at 02:45:55PM +0200, sebgoa wrote:
> 
> On Jun 23, 2014, at 2:30 PM, Koushik Das  wrote:
> 
> > This has nothing to do with the zoneId. If you search the source code for 
> > the error message "Failed to add data store: DataCenter id is null, and 
> > simulator image store has to be associated with a data center", it points 
> > toSimulatorImageStoreLifeCycleImpl.initialize() method. This indicates that 
> > somehow the image store provider for Simulator is getting picked up. For S3 
> > provider type, the S3ImageStoreLifeCycleImpl should get invoked and in that 
> > the zoneId is not used so there won't be issues.
> 
> Happy to discuss it on IRC, if you could join.
> 
> in SimulatorImageStoreLifeCycleImpl.initialize() on 4.4-forward I see:
> 
>  Long dcId = (Long)dsInfos.get("zoneId");
> String url = (String)dsInfos.get("url");
> String name = (String)dsInfos.get("name");
> if (name == null) {
> name = url;
> }
>  ...
> 
> if (dcId == null) {
> throw new InvalidParameterValueException("DataCenter id is null, 
> and simulator image store has to be associated with a data center");
> }
> 
> So my non Java expertise tells me that dcId is null because zoneId is not set 
> ???
> 
> 
> > 
> > 
> > -Original Message-
> > From: Sebastien Goasguen [mailto:run...@gmail.com] 
> > Sent: Monday, 23 June 2014 5:47 PM
> > To: dev@cloudstack.apache.org
> > Subject: Re: S3 use with simulator
> > 
> > 
> > On Jun 23, 2014, at 7:14 AM, Koushik Das  wrote:
> > 
> >> This is the request
> >> 
> >> http://localhost:8096/api?command=updateCloudToUseObjectStore&url=http
> >> ://localhost:1234/test&name=test&provider=S3&details[0].key=accesskey&
> >> details[0].value=dummy&details[1].key=secretkey&details[1].value=dummy
> > 
> > Any chance you can try with a signed api request ?
> > 
> > It looks like it's not finding a zoneId ...hence dcId is null
> > 
> >> 
> >> 
> >> -Original Message-
> >> From: sebgoa [mailto:run...@gmail.com]
> >> Sent: Monday, 23 June 2014 4:40 PM
> >> To: dev@cloudstack.apache.org
> >> Subject: Re: S3 use with simulator
> >> 
> >> 
> >> On Jun 23, 2014, at 12:51 PM, Koushik Das  wrote:
> >> 
> >>> inline
> >>> 
> >>> On 23-Jun-2014, at 4:05 PM, Sebastien Goasguen  wrote:
> >>> 
>  Hi Koushik, thanks for the hint, I checked out 4.4-forward and made that 
>  small change.
>  
>  I still add the same error:
>  
> > update cloudtouseobjectstore url=http://localhost:9081/riak-cs 
> > name=riakcs provider=s3 details[0].key=accesskey 
> > details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
> > details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>  530: Failed to add data store: DataCenter id is null, and simulator 
>  image store has to be associated with a data center
>  
>  However this actually *removed* the NFS store (from the simulated basic 
>  zone).
>  
> >>> 
> >>> I verified using advanced zone, not sure if there are any issues with 
> >>> basic zone. The API response I get is the following:
> >>>  >>> cloud-stack-version="4.4.0-SNAPSHOT">55b7e6f7-ec27-4d
> >>> a 
> >>> 8-b4a0-b209a3e3d825testhttp://localhost:1234/t
> >>> e 
> >>> sthttpS3 >>> e
>  REGIONsecretkeydummy  e
> >>> tails>accesskeydummy >>> tails>i
> >>> magestore>
> >>> 
> >> 
> >> Hum, strange. I just checked with an advanced zone from 
> >> setup/dev/advanced.cfg and I get the same error 'datacenter id is null'.
> >> 
> >> Can you send the exact request that you sent ?
> >> 
> >>> Also in the image_store table the entries look like below, note that the 
> >>> 'role' of NFS store changed to 'ImageCache'.
> >>> 
> >>> '1', 'nfs://10.147.28.6:/export/home/sandbox/secondary', 'NFS', 
> >>> 'nfs', 'nfs://10.147.28.6:/export/home/sandbox/secondary', '1', 
> >>> 'ZONE', 'ImageCache', '8eb3e701-7e2b-4925-87f8-f8ea5f97b863',
> >>> '/mnt/05b33ef7-da6a-33eb-9981-b4efb90ed99b/', '2014-06-23 06:27:58', 
> >>> NULL, NULL, NULL '2', 'test', 'S3', 'http', 
> >>> 'http://localhost:1234/test', NULL, 'REGION', 'Image', 
> >>> '55b7e6f7-ec27-4da8-b4a0-b209a3e3d825', NULL, '2014-06-23 07:37:55', 
> >>> NULL, NULL, NULL
> >>> 
> >> 
> >> Yes I can confirm this. It gets listed in the UI under 'secondary staging 
> >> store', and it's in the db.
> >> 
> >>> 
>  I was then able to add:
>  
> > add imagestore name=riakcs provider=S3 
> > url=http://localhost:9081/riak-cs details[0].key=accesskey 
> > details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
> > details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>  imagestore:
>  name = riakcs
>  id = 1a60d62a-c1e9-4d1c-8b35-d5cd687f6de4
>  details:
>  +---

Re: Review Request 22861: CLOUDSTACK-6976: Added support for SecStorageFirewallCfgCommand to simulator


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22861/#review46398
---


Commit 76f72d3624e8fcbf2ba9d7c200f0f83c197ca967 in cloudstack's branch 
refs/heads/4.4-forward from Santhosh Edukulla
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=76f72d3 ]

CLOUDSTACK-6976: Added the support for SecStorageFirewallCfgCommand

Signed-off-by: Daan Hoogland 


- ASF Subversion and Git Services


On June 23, 2014, 7:21 a.m., Santhosh Edukulla wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22861/
> ---
> 
> (Updated June 23, 2014, 7:21 a.m.)
> 
> 
> Review request for cloudstack and daan Hoogland.
> 
> 
> Bugs: CLOUDSTACK-6976
> https://issues.apache.org/jira/browse/CLOUDSTACK-6976
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added support for "SecStorageFirewallCfgCommand" to simulator
> 
> 
> Diffs
> -
> 
>   
> plugins/hypervisors/simulator/src/com/cloud/agent/manager/SimulatorManagerImpl.java
>  3bc689e 
> 
> Diff: https://reviews.apache.org/r/22861/diff/
> 
> 
> Testing
> ---
> 
> Ran a build with simulator skipping tests, and deployed a datacenter
> 
> 
> Thanks,
> 
> Santhosh Edukulla
> 
>

Re: S3 use with simulator

2014-06-23 Thread Prasanna Santhanam

There is an s3.cfg under setup/dev that might do the job for you:

commit c79b8270a8eeda0c2f594cc84736f62df79d52c1
Author: Prasanna Santhanam 
Date:   Tue Jul 16 22:53:29 2013 +0530

Adding a sample configuration for the s3 enabled store

This sample marvin configuration can be used to add an s3 backed object
store to cloudstack. You will have to replace the ACCESS_KEY/SECRET_KEY
and bucket endpoint (if not using aws) to match your credentials.

On Mon, Jun 23, 2014 at 07:03:28PM +0530, Prasanna Santhanam wrote:
> Be advised that advanced.cfg might be adding the NFS store as
> secondary storage as opposed to cacheStorage that the S3 image store
> needs it to be. At least that's how it was the last time I ran it.
> 
-- 
Prasanna.,

Powered by BigRock.com

Re: S3 use with simulator

2014-06-23 Thread sebgoa


On Jun 23, 2014, at 3:33 PM, Prasanna Santhanam  wrote:

> Be advised that advanced.cfg might be adding the NFS store as
> secondary storage as opposed to cacheStorage that the S3 image store
> needs it to be. At least that's how it was the last time I ran it.

Thanks. 

That's exactly what I am trying to figure out. Can we migrate from a NFS 
secondary storage to an object store.

If I move the NFS to be a cache store then I can add a new ImageStore. But the 
updatecloudstoobjectstore which is supposed to do everything at once, does not 
work for me.

> 
> On Mon, Jun 23, 2014 at 02:45:55PM +0200, sebgoa wrote:
>> 
>> On Jun 23, 2014, at 2:30 PM, Koushik Das  wrote:
>> 
>>> This has nothing to do with the zoneId. If you search the source code for 
>>> the error message "Failed to add data store: DataCenter id is null, and 
>>> simulator image store has to be associated with a data center", it points 
>>> toSimulatorImageStoreLifeCycleImpl.initialize() method. This indicates that 
>>> somehow the image store provider for Simulator is getting picked up. For S3 
>>> provider type, the S3ImageStoreLifeCycleImpl should get invoked and in that 
>>> the zoneId is not used so there won't be issues.
>> 
>> Happy to discuss it on IRC, if you could join.
>> 
>> in SimulatorImageStoreLifeCycleImpl.initialize() on 4.4-forward I see:
>> 
>> Long dcId = (Long)dsInfos.get("zoneId");
>>String url = (String)dsInfos.get("url");
>>String name = (String)dsInfos.get("name");
>>if (name == null) {
>>name = url;
>>}
>> ...
>> 
>>if (dcId == null) {
>>throw new InvalidParameterValueException("DataCenter id is null, 
>> and simulator image store has to be associated with a data center");
>>}
>> 
>> So my non Java expertise tells me that dcId is null because zoneId is not 
>> set ???
>> 
>> 
>>> 
>>> 
>>> -Original Message-
>>> From: Sebastien Goasguen [mailto:run...@gmail.com] 
>>> Sent: Monday, 23 June 2014 5:47 PM
>>> To: dev@cloudstack.apache.org
>>> Subject: Re: S3 use with simulator
>>> 
>>> 
>>> On Jun 23, 2014, at 7:14 AM, Koushik Das  wrote:
>>> 
 This is the request
 
 http://localhost:8096/api?command=updateCloudToUseObjectStore&url=http
 ://localhost:1234/test&name=test&provider=S3&details[0].key=accesskey&
 details[0].value=dummy&details[1].key=secretkey&details[1].value=dummy
>>> 
>>> Any chance you can try with a signed api request ?
>>> 
>>> It looks like it's not finding a zoneId ...hence dcId is null
>>> 
 
 
 -Original Message-
 From: sebgoa [mailto:run...@gmail.com]
 Sent: Monday, 23 June 2014 4:40 PM
 To: dev@cloudstack.apache.org
 Subject: Re: S3 use with simulator
 
 
 On Jun 23, 2014, at 12:51 PM, Koushik Das  wrote:
 
> inline
> 
> On 23-Jun-2014, at 4:05 PM, Sebastien Goasguen  wrote:
> 
>> Hi Koushik, thanks for the hint, I checked out 4.4-forward and made that 
>> small change.
>> 
>> I still add the same error:
>> 
>>> update cloudtouseobjectstore url=http://localhost:9081/riak-cs 
>>> name=riakcs provider=s3 details[0].key=accesskey 
>>> details[0].value=ZMJD6-90S2MST4NZMK1Z details[1].key=secretkey 
>>> details[1].value=ecJlaZebrYKj_qYaIfzlRR_1izojGVWjBRFx0Q==
>> 530: Failed to add data store: DataCenter id is null, and simulator 
>> image store has to be associated with a data center
>> 
>> However this actually *removed* the NFS store (from the simulated basic 
>> zone).
>> 
> 
> I verified using advanced zone, not sure if there are any issues with 
> basic zone. The API response I get is the following:
>  cloud-stack-version="4.4.0-SNAPSHOT">55b7e6f7-ec27-4d
> a 
> 8-b4a0-b209a3e3d825testhttp://localhost:1234/t
> e 
> sthttpS3 e
>> REGIONsecretkeydummy> e
> tails>accesskeydummy tails>i
> magestore>
> 
 
 Hum, strange. I just checked with an advanced zone from 
 setup/dev/advanced.cfg and I get the same error 'datacenter id is null'.
 
 Can you send the exact request that you sent ?
 
> Also in the image_store table the entries look like below, note that the 
> 'role' of NFS store changed to 'ImageCache'.
> 
> '1', 'nfs://10.147.28.6:/export/home/sandbox/secondary', 'NFS', 
> 'nfs', 'nfs://10.147.28.6:/export/home/sandbox/secondary', '1', 
> 'ZONE', 'ImageCache', '8eb3e701-7e2b-4925-87f8-f8ea5f97b863',
> '/mnt/05b33ef7-da6a-33eb-9981-b4efb90ed99b/', '2014-06-23 06:27:58', 
> NULL, NULL, NULL '2', 'test', 'S3', 'http', 
> 'http://localhost:1234/test', NULL, 'REGION', 'Image', 
> '55b7e6f7-ec27-4da8-b4a0-b209a3e3d825', NULL, '2014-06-23 07:37:55', 
> NULL, NULL, NULL
> 
 
 Yes I can confirm this. It gets listed in the UI under 'secondary staging 
 store', and it's in the db.
 
> 
>> I was then able to add:
>

Jenkins build is back to normal : cloudstack-4.4-forward-build #280

See

[ACS4.4]release meeting

H,

I am going to start a #cloudstack-meeting on ACS4.4 in a few minutes

-- 
Daan

Re: [ACS4.4] release

Hi Daan,

How did the IRC meeting go?

Unfortunately I had another conflict (that time is hard for me), but I'm
curious how it went.

Thanks!
Mike


On Mon, Jun 23, 2014 at 12:44 AM, Daan Hoogland 
wrote:

> LS,
>
> There have been no blocker issues for a few days now. Part of this is
> because I told people they should not mark anything a blocker until it
> was discussed and agreed upon on this list. No blockers were being
> discussed for a few days so I want to start the work on creating a
> release. Can we convene at irc at 15:00 UTC today to distribute work?
> I will of course create the signed source distribution but a lot more
> needs to be created.
>
> would be nice if we can,
> --
> Daan
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the cloud
*™*

Re: [ACS4.4] release

it is about to start, but not much attendance

On Mon, Jun 23, 2014 at 5:00 PM, Mike Tutkowski
 wrote:
> Hi Daan,
>
> How did the IRC meeting go?
>
> Unfortunately I had another conflict (that time is hard for me), but I'm
> curious how it went.
>
> Thanks!
> Mike
>
>
> On Mon, Jun 23, 2014 at 12:44 AM, Daan Hoogland 
> wrote:
>
>> LS,
>>
>> There have been no blocker issues for a few days now. Part of this is
>> because I told people they should not mark anything a blocker until it
>> was discussed and agreed upon on this list. No blockers were being
>> discussed for a few days so I want to start the work on creating a
>> release. Can we convene at irc at 15:00 UTC today to distribute work?
>> I will of course create the signed source distribution but a lot more
>> needs to be created.
>>
>> would be nice if we can,
>> --
>> Daan
>>
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the cloud
> *™*



-- 
Daan

Re: [ACS4.4] release

Oh, I thought I missed it.

This morning is hard for me, though. I have another meeting in a sec that I
need to attend.

I will be curious what's discussed, though.

Thanks, Daan!


On Mon, Jun 23, 2014 at 9:02 AM, Daan Hoogland 
wrote:

> it is about to start, but not much attendance
>
> On Mon, Jun 23, 2014 at 5:00 PM, Mike Tutkowski
>  wrote:
> > Hi Daan,
> >
> > How did the IRC meeting go?
> >
> > Unfortunately I had another conflict (that time is hard for me), but I'm
> > curious how it went.
> >
> > Thanks!
> > Mike
> >
> >
> > On Mon, Jun 23, 2014 at 12:44 AM, Daan Hoogland  >
> > wrote:
> >
> >> LS,
> >>
> >> There have been no blocker issues for a few days now. Part of this is
> >> because I told people they should not mark anything a blocker until it
> >> was discussed and agreed upon on this list. No blockers were being
> >> discussed for a few days so I want to start the work on creating a
> >> release. Can we convene at irc at 15:00 UTC today to distribute work?
> >> I will of course create the signed source distribution but a lot more
> >> needs to be created.
> >>
> >> would be nice if we can,
> >> --
> >> Daan
> >>
> >
> >
> >
> > --
> > *Mike Tutkowski*
> > *Senior CloudStack Developer, SolidFire Inc.*
> > e: mike.tutkow...@solidfire.com
> > o: 303.746.7302
> > Advancing the way the world uses the cloud
> > *™*
>
>
>
> --
> Daan
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the cloud
*™*

Re: Review Request 22554: CLOUDSTACK-6909 - fix marvin's handling of SMB credentials for storage

2014-06-23 Thread John Dilley


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22554/
---

(Updated June 23, 2014, 3:53 p.m.)


Review request for cloudstack and Santhosh Edukulla.


Bugs: CLOUDSTACK-6909
https://issues.apache.org/jira/browse/CLOUDSTACK-6909


Repository: cloudstack-git


Description
---

Fix marvin's handling of details field for primary and secondary storage to 
cope with SMB credentials. This allows Hyper-V to work.


Diffs
-

  tools/marvin/marvin/configGenerator.py 191f08e 
  tools/marvin/marvin/deployDataCenter.py 22b78ab 

Diff: https://reviews.apache.org/r/22554/diff/


Testing
---

Tested deploydataCenter with this JSON:

{
   "dbSvr":{
  "dbSvr":"10.220.137.39",
  "passwd":"cloud",
  "db":"cloud",
  "port":3306,
  "user":"cloud"
   },
   "zones":[
  {
 "name":"XenRT-Zone-0",
 "guestcidraddress":"192.168.200.0/24",
 "dns1":"10.220.160.11",
 "physical_networks":[
{
   "XRT_VLANRangeSize":10,
   "name":"AdvPhyNetwork",
   "providers":[
  {
 "broadcastdomainrange":"ZONE",
 "name":"VirtualRouter"
  },
  {
 "broadcastdomainrange":"ZONE",
 "name":"VpcVirtualRouter"
  },
  {
 "broadcastdomainrange":"ZONE",
 "name":"InternalLbVm"
  }
   ],
   "broadcastdomainrange":"Zone",
   "vlan":"3000-3009",
   "traffictypes":[
  {
 "typ":"Guest"
  },
  {
 "typ":"Management"
  },
  {
 "typ":"Public"
  }
   ],
   "isolationmethods":[
  "VLAN"
   ]
}
 ],
 "ipranges":[
{
   "startip":"10.220.164.0",
   "endip":"10.220.164.9",
   "netmask":"255.255.240.0",
   "XRT_GuestIPRangeSize":10,
   "gateway":"10.220.160.1"
}
 ],
 "networktype":"Advanced",
 "pods":[
{
   "XRT_PodIPRangeSize":10,
   "name":"XenRT-Zone-0-Pod-0",
   "endip":"10.220.164.39",
   "startip":"10.220.164.30",
   "netmask":"255.255.240.0",
   "clusters":[
  {
 "XRT_HyperVHostIds":"0",
 "clustername":"XenRT-Zone-0-Pod-0-Cluster-0",
 "hypervisor":"hyperv",
 "primaryStorages":[
{
   "url":"cifs://10.220.163.45/storage/primary",
   "name":"XenRT-Zone-0-Pod-0-Primary-Store",
   "details":{
  "user":"Administrator",
  "password":"xenroot01T",
  "domain":"XSQA"
   }
}
 ],
 "clustertype":"CloudManaged",
 "hosts":[
{
   "url":"http://10.220.163.45";,
   "username":"root",
   "password":"xenroot"
}
 ],
 "XRT_Hosts":1
  }
   ],
   "gateway":"10.220.160.1"
}
 ],
 "internaldns1":"10.220.160.11",
 "secondaryStorages":[
{
   "url":"cifs://10.220.163.45/storage/secondary",
   "details":{
  "domain":"XSQA",
  "password":"xenroot01T",
  "user":"Administrator"
   },
   "provider":"SMB"
}
 ]
  }
   ],
   "mgtSvr":[
  {
 "mgtSvrIp":"10.220.137.39",
 "passwd":"xenroot",
 "port":8096,
 "user":"root"
  }
   ]
}


Thanks,

John Dilley

Re: Review Request 22554: CLOUDSTACK-6909 - fix marvin's handling of SMB credentials for storage

2014-06-23 Thread John Dilley


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22554/
---

(Updated June 23, 2014, 3:52 p.m.)


Review request for cloudstack.


Changes
---

- Added details to primarystorage in configGenerator.py
- Updated details in primary storage to take a single dictionary, then format 
it into a list afterwards
- Used lower case comparisons


Bugs: CLOUDSTACK-6909
https://issues.apache.org/jira/browse/CLOUDSTACK-6909


Repository: cloudstack-git


Description
---

Fix marvin's handling of details field for primary and secondary storage to 
cope with SMB credentials. This allows Hyper-V to work.


Diffs (updated)
-

  tools/marvin/marvin/configGenerator.py 191f08e 
  tools/marvin/marvin/deployDataCenter.py 22b78ab 

Diff: https://reviews.apache.org/r/22554/diff/


Testing (updated)
---

Tested deploydataCenter with this JSON:

{
   "dbSvr":{
  "dbSvr":"10.220.137.39",
  "passwd":"cloud",
  "db":"cloud",
  "port":3306,
  "user":"cloud"
   },
   "zones":[
  {
 "name":"XenRT-Zone-0",
 "guestcidraddress":"192.168.200.0/24",
 "dns1":"10.220.160.11",
 "physical_networks":[
{
   "XRT_VLANRangeSize":10,
   "name":"AdvPhyNetwork",
   "providers":[
  {
 "broadcastdomainrange":"ZONE",
 "name":"VirtualRouter"
  },
  {
 "broadcastdomainrange":"ZONE",
 "name":"VpcVirtualRouter"
  },
  {
 "broadcastdomainrange":"ZONE",
 "name":"InternalLbVm"
  }
   ],
   "broadcastdomainrange":"Zone",
   "vlan":"3000-3009",
   "traffictypes":[
  {
 "typ":"Guest"
  },
  {
 "typ":"Management"
  },
  {
 "typ":"Public"
  }
   ],
   "isolationmethods":[
  "VLAN"
   ]
}
 ],
 "ipranges":[
{
   "startip":"10.220.164.0",
   "endip":"10.220.164.9",
   "netmask":"255.255.240.0",
   "XRT_GuestIPRangeSize":10,
   "gateway":"10.220.160.1"
}
 ],
 "networktype":"Advanced",
 "pods":[
{
   "XRT_PodIPRangeSize":10,
   "name":"XenRT-Zone-0-Pod-0",
   "endip":"10.220.164.39",
   "startip":"10.220.164.30",
   "netmask":"255.255.240.0",
   "clusters":[
  {
 "XRT_HyperVHostIds":"0",
 "clustername":"XenRT-Zone-0-Pod-0-Cluster-0",
 "hypervisor":"hyperv",
 "primaryStorages":[
{
   "url":"cifs://10.220.163.45/storage/primary",
   "name":"XenRT-Zone-0-Pod-0-Primary-Store",
   "details":{
  "user":"Administrator",
  "password":"xenroot01T",
  "domain":"XSQA"
   }
}
 ],
 "clustertype":"CloudManaged",
 "hosts":[
{
   "url":"http://10.220.163.45";,
   "username":"root",
   "password":"xenroot"
}
 ],
 "XRT_Hosts":1
  }
   ],
   "gateway":"10.220.160.1"
}
 ],
 "internaldns1":"10.220.160.11",
 "secondaryStorages":[
{
   "url":"cifs://10.220.163.45/storage/secondary",
   "details":{
  "domain":"XSQA",
  "password":"xenroot01T",
  "user":"Administrator"
   },
   "provider":"SMB"
}
 ]
  }
   ],
   "mgtSvr":[
  {
 "mgtSvrIp":"10.220.137.39",
 "passwd":"xenroot",
 "port":8096,
 "user":"root"
  }
   ]
}


Thanks,

John Dilley

Re: Error in listHosts - Infrastructure Tab in UI

What version of the code are you using?


On Mon, Jun 23, 2014 at 1:51 AM, Mark van der Meulen 
wrote:

> Hi,
>
> Does anyone know where I can start looking to resolve this error? It occurs
> whenever we visit the Infrastructure page in the CS UI ever since we
> removed
> a host(which was apparently successful). It means we can¹t add more hosts
> or
> perform any functions which would be performed from the Infrastructure
> section of the UI.
>
> Thanks,
>
> Mark
>
>
> 2014-06-23 17:41:45,279 DEBUG [c.c.a.q.QueryManagerImpl]
> (catalina-exec-18:ctx-5ee0ee17 ctx-51f50f45) >>>Searching for hosts>>>
> 2014-06-23 17:41:45,301 DEBUG [c.c.a.q.QueryManagerImpl]
> (catalina-exec-18:ctx-5ee0ee17 ctx-51f50f45) >>>Generating Response>>>
> 2014-06-23 17:41:45,312 ERROR [c.c.a.ApiServer]
> (catalina-exec-18:ctx-5ee0ee17 ctx-51f50f45) unhandled exception executing
> api command: listHosts
> java.lang.NullPointerException
> at
>
> com.cloud.storage.StorageManagerImpl.isLocalStorageActiveOnHost(StorageManag
> erImpl.java:359)
> at
> com.cloud.api.ApiDBUtils.isLocalStorageActiveOnHost(ApiDBUtils.java:735)
> at
>
> com.cloud.api.query.dao.HostJoinDaoImpl.newHostResponse(HostJoinDaoImpl.java
> :166)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57
> )
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
> .java:43)
> at java.lang.reflect.Method.invoke(Method.java:622)
> at
>
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopU
> tils.java:317)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint
> (ReflectiveMethodInvocation.java:183)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflect
> iveMethodInvocation.java:150)
> at
>
> com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextIn
> terceptor.java:33)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflect
> iveMethodInvocation.java:161)
> at
>
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(Expos
> eInvocationInterceptor.java:91)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflect
> iveMethodInvocation.java:172)
> at
>
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopPro
> xy.java:204)
> at com.sun.proxy.$Proxy262.newHostResponse(Unknown Source)
> at com.cloud.api.ApiDBUtils.newHostResponse(ApiDBUtils.java:1540)
> at
>
> com.cloud.api.query.ViewResponseHelper.createHostResponse(ViewResponseHelper
> .java:236)
> at
>
> com.cloud.api.query.QueryManagerImpl.searchForServers(QueryManagerImpl.java:
> 1530)
> at
>
> org.apache.cloudstack.api.command.admin.host.ListHostsCmd.execute(ListHostsC
> md.java:179)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
> at com.cloud.api.ApiServer.queueCommand(ApiServer.java:531)
> at com.cloud.api.ApiServer.handleRequest(ApiServer.java:374)
> at
> com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:323)
> at com.cloud.api.ApiServlet.access$000(ApiServlet.java:53)
> at com.cloud.api.ApiServlet$1.run(ApiServlet.java:115)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(Defa
> ultManagedContext.java:56)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithCon
> text(DefaultManagedContext.java:103)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithCont
> ext(DefaultManagedContext.java:53)
> at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:112)
> at com.cloud.api.ApiServlet.doGet(ApiServlet.java:74)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> at
>
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application
> FilterChain.java:290)
> at
>
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh
> ain.java:206)
> at
>
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.ja
> va:233)
> at
>
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.ja
> va:191)
> at
>
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127
> )
> at
>
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102
> )
> at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:615)
> at
>
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java
> :109)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(Co

Re: [security] The case of the open dns resolver

Who would be the right person to bother about this?



--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro


- Original Message -
From: "Wido den Hollander" 
To: dev@cloudstack.apache.org
Sent: Monday, 23 June, 2014 12:26:08 PM
Subject: Re: [security] The case of the open dns resolver



On 06/23/2014 12:31 PM, Nux! wrote:
> Hi,
>
> Today I've been bitten again by the $subject and complaints were sent to my 
> hoster's abuse email address; apparently someone used my VR in a DDOS attack.
> It is my fault as I knew about this issue, but I'd like to throw the blame on 
> Cloudstack. :)
>
> So, the VR is accepting DNS requests from everybody on the interwebs and this 
> should be changed, imho.
>
> I see there are already iptables rules concerning port 8080 of the VR and 
> only the public IP ranges are allowed. Why isn't this the case for port 53 as 
> well?
>

I see no reason why this shouldn't be the case. DNS is only meant for 
the Instances and not for the rest of the internet in this case.

> I have placed this script in my VR's rc.local, but it's not kosher at all.
>
> # disallows global DNS traffic and only allows it from the cloud public 
> subnets
> for i in `iptables-save |grep 8080|awk '{print $4}'`; do iptables -I INPUT -s 
> $i -p tcp -m tcp --dport 53 -j ACCEPT; iptables -I INPUT -s $i -p udp -m udp 
> --dport 53 -j ACCEPT; done
> iptables -D INPUT -i eth0 -p udp -m udp --dport 53 -j ACCEPT
> iptables -D INPUT -i eth0 -p tcp -m tcp --dport 53 -j ACCEPT
>
> This could be greatly improved and added in the official tree.
> Currently I'm getting the subnets by checking which IPs the 8080 rules apply, 
> how can I retrieve this information in a more elegant way?
>
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>

NoClassDefFoundError while trying to access the cloudstack UI

2014-06-23 Thread Seif Eddine Jemli

Hi everyone,

I installed the cloudstack management server using the *: apt-get install
cloud-client.*

I have this exception when I try to log in the UI :

*exception*

javax.servlet.ServletException: java.lang.NoClassDefFoundError:
org/apache/tomcat/util/descriptor/LocalResolver
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:268)
javax.servlet.http.HttpServlet.service(HttpServlet.java:727)

*root cause*

java.lang.NoClassDefFoundError: org/apache/tomcat/util/descriptor/LocalResolver
org.apache.jasper.xmlparser.ParserUtils.(ParserUtils.java:82)

org.apache.jasper.compiler.JspConfig.processWebDotXml(JspConfig.java:102)
org.apache.jasper.compiler.JspConfig.init(JspConfig.java:238)
org.apache.jasper.compiler.JspConfig.findJspProperty(JspConfig.java:294)
org.apache.jasper.compiler.Compiler.generateJava(Compiler.java:112)
org.apache.jasper.compiler.Compiler.compile(Compiler.java:354)
org.apache.jasper.compiler.Compiler.compile(Compiler.java:334)
org.apache.jasper.compiler.Compiler.compile(Compiler.java:321)

org.apache.jasper.JspCompilationContext.compile(JspCompilationContext.java:592)

org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:328)
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313)
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260)

 javax.servlet.http.HttpServlet.service(HttpServlet.java:727)


When I try again , I get this exception :

*exception*

org.apache.jasper.JasperException: org.apache.jasper.JasperException:
Unable to load class for JSP

org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:161)

org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340)
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313)
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260)
javax.servlet.http.HttpServlet.service(HttpServlet.java:727)

*root cause*

org.apache.jasper.JasperException: Unable to load class for JSP

org.apache.jasper.JspCompilationContext.load(JspCompilationContext.java:630)

org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:149)

org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340)
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313)
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260)
javax.servlet.http.HttpServlet.service(HttpServlet.java:727)

*root cause*

java.lang.ClassNotFoundException: org.apache.jsp.index_jsp
java.net.URLClassLoader$1.run(URLClassLoader.java:217)
java.security.AccessController.doPrivileged(Native Method)
java.net.URLClassLoader.findClass(URLClassLoader.java:205)
org.apache.jasper.servlet.JasperLoader.loadClass(JasperLoader.java:134)
org.apache.jasper.servlet.JasperLoader.loadClass(JasperLoader.java:66)

org.apache.jasper.JspCompilationContext.load(JspCompilationContext.java:628)

org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:149)

org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340)
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313)
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260)

 javax.servlet.http.HttpServlet.service(HttpServlet.java:727)

Did anyone get these exceptions before while trying
*http://localhost:8080/client/
*?
What can be the problem?

thanks in advance

[ACS4.4] Cherry pick CLOUDSTACK-6971

2014-06-23 Thread Min Chen

Hi Daan,

Would you please cherry pick the following commit from 4.4-forward to 4.4 
branch?

Commit: 31e250a9d2adbf9ee59da66073497e38c02ded86
CLOUDSTACK-6971: createAutoScaleVmProfile failed with NPE due to lack of bean
Injection.

Thanks
-min

Re: Agent fails to start on SSVM/CPVM on latest master due to " Unsupported major.minor version 51.0"

2014-06-23 Thread Nguyen Anh Tu

Mike,

These links are not found at that moment. Could you check them?

Cheers,

--Tuna


On Wed, Mar 12, 2014 at 1:42 AM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> Here are links to the most recent ones for XenServer and KVM:
>
>
> http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-xen.vhd.bz2
>
> http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-kvm.qcow2.bz2
>
> Once I installed the one for XenServer, it fixed my problem.
>
>
> On Tue, Mar 11, 2014 at 12:39 PM, Alena Prokharchyk <
> alena.prokharc...@citrix.com> wrote:
>
> > Jdk version on the system vms is "1.6.0_27"; on my MS machine where I've
> > built the CS is 1.7.
> >
> > I'm not familiar with the way we package our templates, do I need to
> > download new ones to my secondary storage? If so, what is the URL for the
> > latest templates?
> >
> > From: Alena Prokharchyk  > alena.prokharc...@citrix.com>>
> > Date: Tuesday, March 11, 2014 at 11:31 AM
> > To: "dev@cloudstack.apache.org" <
> > dev@cloudstack.apache.org>
> > Subject: Agent fails to start on SSVM/CPVM on latest master due to "
> > Unsupported major.minor version 51.0"
> >
> > Does anybody see the same behavior and knows how to fix it?
> >
> >
> >   *   installed latest master CS, re-deployed DB
> >   *   After MS started up, system vms were created
> >   *   Agents inside SSVM/CPVM failed to start with this error:
> >
> >
> > + java -Djavax.net.ssl.trustStore=./certs/realhostip.keystore
> > -Dlog.home=/var/log/cloud/ -mx396m -cp
> >
> ./:./conf:activation-1.1.jar:antisamy-1.4.3.jar:aopalliance-1.0.jar:apache-log4j-extras-1.1.jar:aspectjweaver-1.7.0.jar:aws-java-sdk-1.3.22.jar:batik-css-1.7.jar:batik-ext-1.7.jar:batik-util-1.7.jar:bcprov-jdk16-1.46.jar:bsh-core-2.0b4.jar:cglib-nodep-2.2.2.jar:cloud-agent-4.4.0-SNAPSHOT.jar:cloud-api-4.4.0-SNAPSHOT.jar:cloud-console-proxy-4.4.0-SNAPSHOT.jar:cloud-core-4.4.0-SNAPSHOT.jar:cloud-engine-api-4.4.0-SNAPSHOT.jar:cloud-engine-components-api-4.4.0-SNAPSHOT.jar:cloud-engine-schema-4.4.0-SNAPSHOT.jar:cloud-framework-cluster-4.4.0-SNAPSHOT.jar:cloud-framework-config-4.4.0-SNAPSHOT.jar:cloud-framework-db-4.4.0-SNAPSHOT.jar:cloud-framework-events-4.4.0-SNAPSHOT.jar:cloud-framework-ipc-4.4.0-SNAPSHOT.jar:cloud-framework-jobs-4.4.0-SNAPSHOT.jar:cloud-framework-managed-context-4.4.0-SNAPSHOT.jar:cloud-framework-rest-4.4.0-SNAPSHOT.jar:cloud-framework-security-4.4.0-SNAPSHOT.jar:cloud-secondary-storage-4.4.0-SNAPSHOT.jar:cloud-server-4.4.0-SNAPSHOT.jar:cloud-utils-4.4.0-SNAPSHOT.jar:cloudstack-service-console-proxy-rdpclient-4.4.0-SNAPSHOT.jar:commons-beanutils-core-1.7.0.jar:commons-codec-1.6.jar:commons-collections-3.2.jar:commons-configuration-1.8.jar:commons-daemon-1.0.10.jar:commons-dbcp-1.4.jar:commons-fileupload-1.2.jar:commons-httpclient-3.1.jar:commons-io-1.4.jar:commons-lang-2.6.jar:commons-logging-1.1.1.jar:commons-net-3.3.jar:commons-pool-1.6.jar:cxf-bundle-jaxrs-2.7.0.jar:dom4j-1.6.1.jar:ehcache-core-2.6.6.jar:ejb-api-3.0.jar:esapi-2.0.1.jar:geronimo-javamail_1.4_spec-1.7.1.jar:geronimo-servlet_3.0_spec-1.0.jar:gson-1.7.1.jar:guava-14.0-rc1.jar:httpclient-4.2.1.jar:httpcore-4.2.1.jar:jackson-annotations-2.1.1.jar:jackson-core-2.1.1.jar:jackson-core-asl-1.8.9.jar:jackson-databind-2.1.1.jar:jackson-jaxrs-json-provider-2.1.1.jar:jackson-mapper-asl-1.8.9.jar:jackson-module-jaxb-annotations-2.1.1.jar:jasypt-1.9.0.jar:java-ipv6-0.10.jar:javassist-3.12.1.GA.jar:javassist-3.18.1-GA.jar:javax.inject-1.jar:javax.persistence-2.0.0.jar:javax.ws.rs-api-2.0-m10.jar:jaxen-1.1-beta-8.jar:jdom-1.0.jar:jetty-continuation-8.1.7.v20120910.jar:jetty-http-8.1.7.v20120910.jar:jetty-io-8.1.7.v20120910.jar:jetty-security-8.1.7.v20120910.jar:jetty-util-8.1.7.v20120910.jar:jsch-0.1.42.jar:jstl-1.2.jar:log4j-1.2.16.jar:mail-1.4.jar:nekohtml-1.9.12.jar:objenesis-2.1.jar:powermock-core-1.5.3.jar:powermock-module-junit4-1.5.3.jar:powermock-module-junit4-common-1.5.3.jar:powermock-reflect-1.5.3.jar:reflections-0.9.8.jar:slf4j-api-1.7.5.jar:slf4j-log4j12-1.7.5.jar:spring-aop-3.2.4.RELEASE.jar:spring-beans-3.2.4.RELEASE.jar:spring-context-3.2.4.RELEASE.jar:spring-core-3.2.4.RELEASE.jar:spring-expression-3.2.4.RELEASE.jar:spring-web-3.2.4.RELEASE.jar:stax2-api-3.1.1.jar:tomcat-embed-core-7.0.30.jar:trilead-ssh2-build213-svnkit-1.3-patch.jar:woodstox-core-asl-4.1.4.jar:wsdl4j-1.4.jar:xalan-2.7.0.jar:xercesImpl-2.6.2.jar:xmlschema-core-2.0.3.jar:xom-1.1.jar:xpp3_min-1.1.4c.jar:xstream-1.3.1.jar
> > com.cloud.agent.AgentShell root=UUID debian-installer=en_US console=hvc0
> > template=domP type=secstorage host=10.214.4.100 port=8250 name=s-1-VM
> > zone=1 pod=1 guid=s-1-VM
> >
> resource=org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource
> > instance=SecStorage sslcopy=false role=templateProcessor mtu=1500
> > eth2ip=1

Re: Agent fails to start on SSVM/CPVM on latest master due to " Unsupported major.minor version 51.0"

Tuna,

A list of all the artifacts can be seen on the jenkins UI.

http://jenkins.buildacloud.org/job/build-systemvm64-master/


On 23 June 2014 18:29, Nguyen Anh Tu  wrote:

> Mike,
>
> These links are not found at that moment. Could you check them?
>
> Cheers,
>
> --Tuna
>
>
> On Wed, Mar 12, 2014 at 1:42 AM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
> > Here are links to the most recent ones for XenServer and KVM:
> >
> >
> >
> http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-xen.vhd.bz2
> >
> >
> http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-kvm.qcow2.bz2
> >
> > Once I installed the one for XenServer, it fixed my problem.
> >
> >
> > On Tue, Mar 11, 2014 at 12:39 PM, Alena Prokharchyk <
> > alena.prokharc...@citrix.com> wrote:
> >
> > > Jdk version on the system vms is "1.6.0_27"; on my MS machine where
> I've
> > > built the CS is 1.7.
> > >
> > > I'm not familiar with the way we package our templates, do I need to
> > > download new ones to my secondary storage? If so, what is the URL for
> the
> > > latest templates?
> > >
> > > From: Alena Prokharchyk  > > alena.prokharc...@citrix.com>>
> > > Date: Tuesday, March 11, 2014 at 11:31 AM
> > > To: "dev@cloudstack.apache.org" <
> > > dev@cloudstack.apache.org>
> > > Subject: Agent fails to start on SSVM/CPVM on latest master due to "
> > > Unsupported major.minor version 51.0"
> > >
> > > Does anybody see the same behavior and knows how to fix it?
> > >
> > >
> > >   *   installed latest master CS, re-deployed DB
> > >   *   After MS started up, system vms were created
> > >   *   Agents inside SSVM/CPVM failed to start with this error:
> > >
> > >
> > > + java -Djavax.net.ssl.trustStore=./certs/realhostip.keystore
> > > -Dlog.home=/var/log/cloud/ -mx396m -cp
> > >
> >
> ./:./conf:activation-1.1.jar:antisamy-1.4.3.jar:aopalliance-1.0.jar:apache-log4j-extras-1.1.jar:aspectjweaver-1.7.0.jar:aws-java-sdk-1.3.22.jar:batik-css-1.7.jar:batik-ext-1.7.jar:batik-util-1.7.jar:bcprov-jdk16-1.46.jar:bsh-core-2.0b4.jar:cglib-nodep-2.2.2.jar:cloud-agent-4.4.0-SNAPSHOT.jar:cloud-api-4.4.0-SNAPSHOT.jar:cloud-console-proxy-4.4.0-SNAPSHOT.jar:cloud-core-4.4.0-SNAPSHOT.jar:cloud-engine-api-4.4.0-SNAPSHOT.jar:cloud-engine-components-api-4.4.0-SNAPSHOT.jar:cloud-engine-schema-4.4.0-SNAPSHOT.jar:cloud-framework-cluster-4.4.0-SNAPSHOT.jar:cloud-framework-config-4.4.0-SNAPSHOT.jar:cloud-framework-db-4.4.0-SNAPSHOT.jar:cloud-framework-events-4.4.0-SNAPSHOT.jar:cloud-framework-ipc-4.4.0-SNAPSHOT.jar:cloud-framework-jobs-4.4.0-SNAPSHOT.jar:cloud-framework-managed-context-4.4.0-SNAPSHOT.jar:cloud-framework-rest-4.4.0-SNAPSHOT.jar:cloud-framework-security-4.4.0-SNAPSHOT.jar:cloud-secondary-storage-4.4.0-SNAPSHOT.jar:cloud-server-4.4.0-SNAPSHOT.jar:cloud-utils-4.4.0-SNAPSHOT.jar:cloudstack-service-console-proxy-rdpclient-4.4.0-SNAPSHOT.jar:commons-beanutils-core-1.7.0.jar:commons-codec-1.6.jar:commons-collections-3.2.jar:commons-configuration-1.8.jar:commons-daemon-1.0.10.jar:commons-dbcp-1.4.jar:commons-fileupload-1.2.jar:commons-httpclient-3.1.jar:commons-io-1.4.jar:commons-lang-2.6.jar:commons-logging-1.1.1.jar:commons-net-3.3.jar:commons-pool-1.6.jar:cxf-bundle-jaxrs-2.7.0.jar:dom4j-1.6.1.jar:ehcache-core-2.6.6.jar:ejb-api-3.0.jar:esapi-2.0.1.jar:geronimo-javamail_1.4_spec-1.7.1.jar:geronimo-servlet_3.0_spec-1.0.jar:gson-1.7.1.jar:guava-14.0-rc1.jar:httpclient-4.2.1.jar:httpcore-4.2.1.jar:jackson-annotations-2.1.1.jar:jackson-core-2.1.1.jar:jackson-core-asl-1.8.9.jar:jackson-databind-2.1.1.jar:jackson-jaxrs-json-provider-2.1.1.jar:jackson-mapper-asl-1.8.9.jar:jackson-module-jaxb-annotations-2.1.1.jar:jasypt-1.9.0.jar:java-ipv6-0.10.jar:javassist-3.12.1.GA.jar:javassist-3.18.1-GA.jar:javax.inject-1.jar:javax.persistence-2.0.0.jar:javax.ws.rs-api-2.0-m10.jar:jaxen-1.1-beta-8.jar:jdom-1.0.jar:jetty-continuation-8.1.7.v20120910.jar:jetty-http-8.1.7.v20120910.jar:jetty-io-8.1.7.v20120910.jar:jetty-security-8.1.7.v20120910.jar:jetty-util-8.1.7.v20120910.jar:jsch-0.1.42.jar:jstl-1.2.jar:log4j-1.2.16.jar:mail-1.4.jar:nekohtml-1.9.12.jar:objenesis-2.1.jar:powermock-core-1.5.3.jar:powermock-module-junit4-1.5.3.jar:powermock-module-junit4-common-1.5.3.jar:powermock-reflect-1.5.3.jar:reflections-0.9.8.jar:slf4j-api-1.7.5.jar:slf4j-log4j12-1.7.5.jar:spring-aop-3.2.4.RELEASE.jar:spring-beans-3.2.4.RELEASE.jar:spring-context-3.2.4.RELEASE.jar:spring-core-3.2.4.RELEASE.jar:spring-expression-3.2.4.RELEASE.jar:spring-web-3.2.4.RELEASE.jar:stax2-api-3.1.1.jar:tomcat-embed-core-7.0.30.jar:trilead-ssh2-build213-svnkit-1.3-patch.jar:woodstox-core-asl-4.1.4.jar:wsdl4j-1.4.jar:xalan-2.7.0.jar:xercesImpl-2.6.2.jar:xmlschema-core-2.0.3.jar:xom-1.1.jar:xpp3_min-1.1.4c.jar:xstream-1.3.1.jar
> > > com.cloud.agent.AgentShell root=UUID debian-installer=e

Re: Review Request 22863: CLOUDSTACK-6823 : First code drop for Brocade Network plugin to orchestrate Brocade VDX switches for L2 connectivity.

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22863/
---

(Updated June 23, 2014, 5:49 p.m.)

Review request for cloudstack.

Changes
---

Added a note requesting a new branch for Brocade plugin.

Bugs: CLOUDSTACK-6823
https://issues.apache.org/jira/browse/CLOUDSTACK-6823

Repository: cloudstack-git

Description (updated)
---

First code drop for Brocade Network plugin to orchestrate Brocade VDX switches
for L2 connectivity. Please create a new branch for Brocade plugin.

Diffs
-

api/src/com/cloud/network/Network.java b5e8173
api/src/com/cloud/network/Networks.java 3159f6e
api/src/com/cloud/network/PhysicalNetwork.java 5d38b50
build/replace.properties 265f335
client/pom.xml 3995f6e
plugins/pom.xml 4f7805a
setup/db/create-schema.sql 55cb4cc
ui/scripts/system.js 0c56baf
utils/conf/db.properties e1b5fe9

Diff: https://reviews.apache.org/r/22863/diff/

Testing
---

• Create an isolated network; verify that the port-profile is created on
the Brocade switch.
• Attach a VM to the network; verify that the VMs MAC address is
associated with the port profile of the network on the Brocade switch.
• Delete VMs for an isolated network; verify that the VMs MAC address is
disassociated with the port profile of the network on the Brocade switch.
• Delete the isolated network; verify that the port-profile is deleted
from the Brocade switch.

File Attachments

Diff for the existing cloudstack code

https://reviews.apache.org/media/uploaded/files/2014/06/23/8fc3cfb1-7a21-4714-98f3-6514cf54ba84__diff
Patch for the plugin code

https://reviews.apache.org/media/uploaded/files/2014/06/23/fbb2b949-a42c-4b22-afa7-60e691c778df__brocade-vcs.patch

Thanks,

Ritu Sabharwal

RE: Review Request 22863: CLOUDSTACK-6823 : First code drop for Brocade Network plugin to orchestrate Brocade VDX switches for L2 connectivity.

Hi Sebastian,

I submitted the first code drop for plugin for review. Can you please create a 
new branch for Brocade plugin development.  

Also, I wanted to know how do I select specific reviewers for reviewing the 
request. I did not see any option to choose that while submitting the request.

Thanks & Regards,
Ritu S. 

-Original Message-
From: Ritu Sabharwal [mailto:nore...@reviews.apache.org] On Behalf Of Ritu 
Sabharwal
Sent: Monday, June 23, 2014 10:49 AM
To: Ritu Sabharwal; cloudstack
Subject: Re: Review Request 22863: CLOUDSTACK-6823 : First code drop for 
Brocade Network plugin to orchestrate Brocade VDX switches for L2 connectivity.


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22863/
---

(Updated June 23, 2014, 5:49 p.m.)


Review request for cloudstack.


Changes
---

Added a note requesting a new branch for Brocade plugin.


Bugs: CLOUDSTACK-6823
https://issues.apache.org/jira/browse/CLOUDSTACK-6823


Repository: cloudstack-git


Description (updated)
---

First code drop for Brocade Network plugin to orchestrate Brocade VDX switches 
for L2 connectivity. Please create a new branch for Brocade plugin.


Diffs
-

  api/src/com/cloud/network/Network.java b5e8173 
  api/src/com/cloud/network/Networks.java 3159f6e 
  api/src/com/cloud/network/PhysicalNetwork.java 5d38b50 
  build/replace.properties 265f335 
  client/pom.xml 3995f6e 
  plugins/pom.xml 4f7805a 
  setup/db/create-schema.sql 55cb4cc 
  ui/scripts/system.js 0c56baf 
  utils/conf/db.properties e1b5fe9 

Diff: https://reviews.apache.org/r/22863/diff/


Testing
---

•   Create an isolated network; verify that the port-profile is created on 
the Brocade switch.
•   Attach a VM to the network; verify that the VMs MAC address is 
associated with the port profile of the network on the Brocade switch.
•   Delete VMs for an isolated network; verify that the VMs MAC address is 
disassociated with the port profile of the network on the Brocade switch.
•   Delete the isolated network; verify that the port-profile is deleted 
from the Brocade switch.


File Attachments


Diff for the existing cloudstack code
  
https://reviews.apache.org/media/uploaded/files/2014/06/23/8fc3cfb1-7a21-4714-98f3-6514cf54ba84__diff
Patch for the plugin code
  
https://reviews.apache.org/media/uploaded/files/2014/06/23/fbb2b949-a42c-4b22-afa7-60e691c778df__brocade-vcs.patch


Thanks,

Ritu  Sabharwal

[ACS4.4] CLOUDSTACK-6854

2014-06-23 Thread Sheng Yang

Hi Daan,

Please cherry-pick from 4.4-forward branch:

commit dfe20f34f2e72335586b0e014ba1f91aa4ed473e
Author: Sheng Yang 
Date:   Fri Jun 20 17:36:49 2014 -0700

CLOUDSTACK-6854: Fix inconsistent IPv6 address formats

fc00:0003:1373::0002 should be treated the same as fc00:3:1373::2.


Thanks!

--Sheng

[ACS4.4] Cherry pick CLOUDSTACK-6938

2014-06-23 Thread Logan Barfield

Daan,

Could you please cherry pick this commit from master to 4.4?

Commit: 736bf540e8ef759a101d221622c64f3b3c3ed425
CLOUDSTACK-6938: Cannot create template from snapshot when using S3 storage


Thank You,

Logan Barfield
Tranquil Hosting

Re: [ACS4.4] Cherry pick CLOUDSTACK-6971

On Mon, Jun 23, 2014 at 7:08 PM, Min Chen  wrote:
> 31e250a9d2adbf9ee59da66073497e38c02ded86


is in

-- 
Daan

Re: [ACS4.4] CLOUDSTACK-6854

On Mon, Jun 23, 2014 at 7:56 PM, Sheng Yang  wrote:
> dfe20f34f2e72335586b0e014ba1f91aa4ed473e


is in

-- 
Daan

Jenkins build is back to normal : cloudstack-4.4-maven-build #362

See

Re: [ACS4.4] Cherry pick CLOUDSTACK-6938

On Mon, Jun 23, 2014 at 8:19 PM, Logan Barfield  wrote:
> 736bf540e8ef759a101d221622c64f3b3c3ed425


is in

-- 
Daan

[ACS4.5] SQL Error

Do we seriously have an error in our SQL code? :) I ran mvn -P developer
-pl developer -D deploydb and received the following:

> Processing SQL file at
/home/cloudstack/cloudstack/developer/target/db/create-schema.sql
Unable to execute
/home/cloudstack/cloudstack/developer/target/db/create-schema.sql: You have
an error in your SQL syntax; check the manual that corresponds to your
MySQL server version for the right syntax to use near '$ INSERT IGNORE INTO
`cloud`.`hypervisor_capabilities`(hypervisor_type, hypervis' at line 1

-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the cloud
*™*

Re: [ACS4.5] SQL Error

Hey Mike,

This appears to be correct.

There newly added lines in create-schema-sql ending in ;$

They appear to be introduced with the OVM stuff.


On 23 June 2014 20:17, Mike Tutkowski  wrote:

> Do we seriously have an error in our SQL code? :) I ran mvn -P developer
> -pl developer -D deploydb and received the following:
>
> > Processing SQL file at
> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql
> Unable to execute
> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql: You have
> an error in your SQL syntax; check the manual that corresponds to your
> MySQL server version for the right syntax to use near '$ INSERT IGNORE INTO
> `cloud`.`hypervisor_capabilities`(hypervisor_type, hypervis' at line 1
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the cloud
> *™*
>

Re: [ACS4.5] SQL Error

I think the problem is that no primary key is specified:

http://smallbusiness.chron.com/duplicate-ignore-mysql-inserts-28260.html

If we need to specify a primary key for these statements to work, I'm not
sure how we can use them because the id column is auto-incremented.


On Mon, Jun 23, 2014 at 1:34 PM, Ian Duffy  wrote:

> Hey Mike,
>
> This appears to be correct.
>
> There newly added lines in create-schema-sql ending in ;$
>
> They appear to be introduced with the OVM stuff.
>
>
> On 23 June 2014 20:17, Mike Tutkowski 
> wrote:
>
> > Do we seriously have an error in our SQL code? :) I ran mvn -P developer
> > -pl developer -D deploydb and received the following:
> >
> > > Processing SQL file at
> > /home/cloudstack/cloudstack/developer/target/db/create-schema.sql
> > Unable to execute
> > /home/cloudstack/cloudstack/developer/target/db/create-schema.sql: You
> have
> > an error in your SQL syntax; check the manual that corresponds to your
> > MySQL server version for the right syntax to use near '$ INSERT IGNORE
> INTO
> > `cloud`.`hypervisor_capabilities`(hypervisor_type, hypervis' at line 1
> >
> > --
> > *Mike Tutkowski*
> > *Senior CloudStack Developer, SolidFire Inc.*
> > e: mike.tutkow...@solidfire.com
> > o: 303.746.7302
> > Advancing the way the world uses the cloud
> > *™*
> >
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the cloud
*™*

Re: [ACS4.5] SQL Error

2014-06-23 Thread Sebastien Goasguen


On Jun 23, 2014, at 3:34 PM, Ian Duffy  wrote:

> Hey Mike,
> 
> This appears to be correct.
> 
> There newly added lines in create-schema-sql ending in ;$
> 
> They appear to be introduced with the OVM stuff.

The OVM stuff was put in the ovmsupport branch, nothing should be on master



> 
> 
> On 23 June 2014 20:17, Mike Tutkowski  wrote:
> 
>> Do we seriously have an error in our SQL code? :) I ran mvn -P developer
>> -pl developer -D deploydb and received the following:
>> 
>> > Processing SQL file at
>> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql
>> Unable to execute
>> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql: You have
>> an error in your SQL syntax; check the manual that corresponds to your
>> MySQL server version for the right syntax to use near '$ INSERT IGNORE INTO
>> `cloud`.`hypervisor_capabilities`(hypervisor_type, hypervis' at line 1
>> 
>> --
>> *Mike Tutkowski*
>> *Senior CloudStack Developer, SolidFire Inc.*
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the cloud
>> *™*
>>

Re: [ACS4.5] SQL Error

Just pushed a fix for it.

> The OVM stuff was put in the ovmsupport branch, nothing should be on
master

There is stuff in master

https://github.com/apache/cloudstack/commit/8a485b9b59e4108e862022baf7477f768380b325

On 23 June 2014 20:38, Sebastien Goasguen  wrote:

>
> On Jun 23, 2014, at 3:34 PM, Ian Duffy  wrote:
>
> > Hey Mike,
> >
> > This appears to be correct.
> >
> > There newly added lines in create-schema-sql ending in ;$
> >
> > They appear to be introduced with the OVM stuff.
>
> The OVM stuff was put in the ovmsupport branch, nothing should be on master
>
>
>
> >
> >
> > On 23 June 2014 20:17, Mike Tutkowski 
> wrote:
> >
> >> Do we seriously have an error in our SQL code? :) I ran mvn -P developer
> >> -pl developer -D deploydb and received the following:
> >>
> >> > Processing SQL file at
> >> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql
> >> Unable to execute
> >> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql: You
> have
> >> an error in your SQL syntax; check the manual that corresponds to your
> >> MySQL server version for the right syntax to use near '$ INSERT IGNORE
> INTO
> >> `cloud`.`hypervisor_capabilities`(hypervisor_type, hypervis' at line 1
> >>
> >> --
> >> *Mike Tutkowski*
> >> *Senior CloudStack Developer, SolidFire Inc.*
> >> e: mike.tutkow...@solidfire.com
> >> o: 303.746.7302
> >> Advancing the way the world uses the cloud
> >> *™*
> >>
>
>

Re: [ACS4.5] SQL Error

Thanks, Ian


On Mon, Jun 23, 2014 at 1:41 PM, Ian Duffy  wrote:

> Just pushed a fix for it.
>
> > The OVM stuff was put in the ovmsupport branch, nothing should be on
> master
>
> There is stuff in master
>
>
> https://github.com/apache/cloudstack/commit/8a485b9b59e4108e862022baf7477f768380b325
>
> On 23 June 2014 20:38, Sebastien Goasguen  wrote:
>
> >
> > On Jun 23, 2014, at 3:34 PM, Ian Duffy  wrote:
> >
> > > Hey Mike,
> > >
> > > This appears to be correct.
> > >
> > > There newly added lines in create-schema-sql ending in ;$
> > >
> > > They appear to be introduced with the OVM stuff.
> >
> > The OVM stuff was put in the ovmsupport branch, nothing should be on
> master
> >
> >
> >
> > >
> > >
> > > On 23 June 2014 20:17, Mike Tutkowski 
> > wrote:
> > >
> > >> Do we seriously have an error in our SQL code? :) I ran mvn -P
> developer
> > >> -pl developer -D deploydb and received the following:
> > >>
> > >> > Processing SQL file at
> > >> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql
> > >> Unable to execute
> > >> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql: You
> > have
> > >> an error in your SQL syntax; check the manual that corresponds to your
> > >> MySQL server version for the right syntax to use near '$ INSERT IGNORE
> > INTO
> > >> `cloud`.`hypervisor_capabilities`(hypervisor_type, hypervis' at line 1
> > >>
> > >> --
> > >> *Mike Tutkowski*
> > >> *Senior CloudStack Developer, SolidFire Inc.*
> > >> e: mike.tutkow...@solidfire.com
> > >> o: 303.746.7302
> > >> Advancing the way the world uses the cloud
> > >> *™*
> > >>
> >
> >
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the cloud
*™*

Re: [ACS4.5] SQL Error

I see they had an extra couple "$" chars in the code. Thanks for removing
them, Ian.


On Mon, Jun 23, 2014 at 1:43 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> Thanks, Ian
>
>
> On Mon, Jun 23, 2014 at 1:41 PM, Ian Duffy  wrote:
>
>> Just pushed a fix for it.
>>
>> > The OVM stuff was put in the ovmsupport branch, nothing should be on
>> master
>>
>> There is stuff in master
>>
>>
>> https://github.com/apache/cloudstack/commit/8a485b9b59e4108e862022baf7477f768380b325
>>
>> On 23 June 2014 20:38, Sebastien Goasguen  wrote:
>>
>> >
>> > On Jun 23, 2014, at 3:34 PM, Ian Duffy  wrote:
>> >
>> > > Hey Mike,
>> > >
>> > > This appears to be correct.
>> > >
>> > > There newly added lines in create-schema-sql ending in ;$
>> > >
>> > > They appear to be introduced with the OVM stuff.
>> >
>> > The OVM stuff was put in the ovmsupport branch, nothing should be on
>> master
>> >
>> >
>> >
>> > >
>> > >
>> > > On 23 June 2014 20:17, Mike Tutkowski 
>> > wrote:
>> > >
>> > >> Do we seriously have an error in our SQL code? :) I ran mvn -P
>> developer
>> > >> -pl developer -D deploydb and received the following:
>> > >>
>> > >> > Processing SQL file at
>> > >> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql
>> > >> Unable to execute
>> > >> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql:
>> You
>> > have
>> > >> an error in your SQL syntax; check the manual that corresponds to
>> your
>> > >> MySQL server version for the right syntax to use near '$ INSERT
>> IGNORE
>> > INTO
>> > >> `cloud`.`hypervisor_capabilities`(hypervisor_type, hypervis' at line
>> 1
>> > >>
>> > >> --
>> > >> *Mike Tutkowski*
>> > >> *Senior CloudStack Developer, SolidFire Inc.*
>> > >> e: mike.tutkow...@solidfire.com
>> > >> o: 303.746.7302
>> > >> Advancing the way the world uses the cloud
>> > >> *™*
>> > >>
>> >
>> >
>>
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the cloud
> *™*
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the cloud
*™*

Re: [security] The case of the open dns resolver

2014-06-23 Thread Erik Weber

On Mon, Jun 23, 2014 at 12:31 PM, Nux!  wrote:

> Hi,
>
> Today I've been bitten again by the $subject and complaints were sent to
> my hoster's abuse email address; apparently someone used my VR in a DDOS
> attack.
> It is my fault as I knew about this issue, but I'd like to throw the blame
> on Cloudstack. :)
>
> So, the VR is accepting DNS requests from everybody on the interwebs and
> this should be changed, imho.
>
> I see there are already iptables rules concerning port 8080 of the VR and
> only the public IP ranges are allowed. Why isn't this the case for port 53
> as well?
>
> I have placed this script in my VR's rc.local, but it's not kosher at all.
>
> # disallows global DNS traffic and only allows it from the cloud public
> subnets
> for i in `iptables-save |grep 8080|awk '{print $4}'`; do iptables -I INPUT
> -s $i -p tcp -m tcp --dport 53 -j ACCEPT; iptables -I INPUT -s $i -p udp -m
> udp --dport 53 -j ACCEPT; done
> iptables -D INPUT -i eth0 -p udp -m udp --dport 53 -j ACCEPT
> iptables -D INPUT -i eth0 -p tcp -m tcp --dport 53 -j ACCEPT
>
> This could be greatly improved and added in the official tree.
> Currently I'm getting the subnets by checking which IPs the 8080 rules
> apply, how can I retrieve this information in a more elegant way?
>


Which version are you running?

On a 4.3 installation I see no iptables rules that allow it on the public
interface, and testing it externally fails due to the default DROP rule.


-- 
Erik Weber

Re: Review Request 22799: Golden (Base) Primary Storage feature


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22799/#review46451
---


I was wondering if you could fill out the section about tests that have been 
performed?

I would be interested in both new and regression testing.

Thanks!

- Mike Tutkowski


On June 20, 2014, 3:46 a.m., Hieu LE wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22799/
> ---
> 
> (Updated June 20, 2014, 3:46 a.m.)
> 
> 
> Review request for cloudstack, Mike Tutkowski and Tim Mackey.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> As discussed in mailing list, this patch is applied for golden primary 
> storage in [1].
> I have changed the term from "golden" to "base" because there are some 
> functions and variables in CloudStack also use "base" for base image.
> This patch only apply for Xen Server.
> 
> [1]: 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Golden+Primary+Storage
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/deploy/DeployDestination.java 
> 4ded5ebe7a18252da471ee25019856f2b2f772e0 
>   api/src/com/cloud/storage/StoragePool.java 
> 8e03c3348f3a6dd3156ab9e440126ea317957dc0 
>   api/src/com/cloud/template/VirtualMachineTemplate.java 
> 599212bb039fdbb78511019e8f0a6ea4b4a84440 
>   api/src/org/apache/cloudstack/api/ApiConstants.java 
> ae5d6f05b6b52f60b151369a641cb11fcbb558af 
>   api/src/org/apache/cloudstack/api/BaseUpdateTemplateOrIsoCmd.java 
> 2350f6b389203e2c6cc2182fe03fe9a95e936b81 
>   
> api/src/org/apache/cloudstack/api/command/admin/storage/CreateStoragePoolCmd.java
>  ae44bc9373232d242e4ebdcf76844969f0fe69fc 
>   
> api/src/org/apache/cloudstack/api/command/admin/storage/UpdateStoragePoolCmd.java
>  3d1a77353257c814efaf60875ffdf99603bc414e 
>   
> api/src/org/apache/cloudstack/api/command/user/template/RegisterTemplateCmd.java
>  f478c9bc8eebf867a03deb4add1bf695ac3ec0ad 
>   api/src/org/apache/cloudstack/api/response/StoragePoolResponse.java 
> 3571866fe74dca9aa5fe0d11373313eab97e94ac 
>   api/src/org/apache/cloudstack/api/response/TemplateResponse.java 
> 3e21043e339103c021d3c9e767acac8b3837f760 
>   core/src/com/cloud/agent/api/CheckPoolBelongToHostAnswer.java PRE-CREATION 
>   core/src/com/cloud/agent/api/CheckPoolBelongToHostCommand.java PRE-CREATION 
>   core/src/org/apache/cloudstack/storage/to/PrimaryDataStoreTO.java 
> 29e53b0d9581f764a17ea285606213d2c045b029 
>   core/src/org/apache/cloudstack/storage/to/TemplateObjectTO.java 
> b201c386f4975913f13c575d7685e50cedc7d92f 
>   
> core/test/org/apache/cloudstack/api/agent/test/BackupSnapshotCommandTest.java 
> 33361e87265df05e00bfa6dba810d2b68ae8d923 
>   core/test/org/apache/cloudstack/api/agent/test/CheckNetworkAnswerTest.java 
> 66feaecb5ef20053db50956e2801fec096a350c9 
>   core/test/org/apache/cloudstack/api/agent/test/SnapshotCommandTest.java 
> 114c8854d1504436523aa99c78bf2b4d84a12077 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/PrimaryDataStoreParameters.java
>  1dbff59a8911ad8f0933ef17a2c2b1d3e33523b9 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/StoragePoolAllocator.java
>  dfdbd8ab92c47799f6ad23637fa63e030f0be968 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/VolumeInfo.java
>  f93f4efac83c565cd33eb7eb67dcaca335f1c226 
>   engine/components-api/src/com/cloud/deploy/DeploymentPlanningManager.java 
> ee6721ab445a5222d0087dc9170e0b58f9eef91a 
>   engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java 
> 4aa5fc80d9660d2f985db98124c33465bd99767f 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/cloud/entity/api/VMEntityManagerImpl.java
>  b1ac2f853374d6f1ddd9087919dbc16db0433f59 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/orchestration/VolumeOrchestrator.java
>  6256e2526ef9bd4632a5e3873c4d9531eb301c7f 
>   engine/schema/src/com/cloud/storage/VMTemplateVO.java 
> 9a77cbf873aa9e422985fbcdc0ae7e18b8c78d4c 
>   engine/schema/src/com/cloud/storage/VolumeVO.java 
> e328253a596891029c2b55bea81b7ead425251ee 
>   
> engine/schema/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDao.java
>  a976bfbf6fe46306d20ad939c335bba6b9b7be54 
>   
> engine/schema/src/org/apache/cloudstack/storage/datastore/db/PrimaryDataStoreDaoImpl.java
>  92793f1fb1a08a455a78667ba4a39ae162378360 
>   
> engine/schema/src/org/apache/cloudstack/storage/datastore/db/StoragePoolVO.java
>  1508ce0b28c83968c25d9601b6dae34e1a73dbb0 
>   
> engine/storage/image/src/org/apache/cloudstack/storage/image/store/TemplateObject.java
>  7288d454c30fdb81445e43549145f1f2da8533e4 
>   
> engine/storage/src/org/apache/cloudstack/storage/allocator/ClusterScopeStoragePoolAllocator.java
>  ea084c7555468001a12376

Re: Review Request 22631: supporting nfs protocol and resize feature for managed storage in xenserver.


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22631/#review46452
---


Hi Punith,

Just wanted to let you know that I have not forgotten about this review.

I plan to check the code in once I finish up something else I'm working on over 
the next day or so.

Thanks!
Mike

- Mike Tutkowski


On June 17, 2014, 9:28 a.m., punith s wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22631/
> ---
> 
> (Updated June 17, 2014, 9:28 a.m.)
> 
> 
> Review request for cloudstack, amit kumar das, edison su, and Mike Tutkowski.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> currently managed storage only supports iscsi protocol.
> 
> hence now adding support for nfs protocol and also resizing the vdi to the SR 
> size, hence fully utilizing the SR space in managed storage.
> 
> to support nfs, the getNfsSR method's signature has to changed similar to 
> existing getIscsiSR method.
> 
> SR will be created based on the volume's protocoltype.
> 
> jira id - CLOUDSTACK-6916
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/agent/api/to/DiskTO.java 5901367 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/orchestration/VolumeOrchestrator.java
>  eea931e 
>   
> plugins/hypervisors/xenserver/src/com/cloud/hypervisor/xenserver/resource/CitrixResourceBase.java
>  9979802 
>   server/src/com/cloud/storage/VolumeApiServiceImpl.java 9b034e9 
> 
> Diff: https://reviews.apache.org/r/22631/diff/
> 
> 
> Testing
> ---
> 
> system testing done.
> 
> 
> Thanks,
> 
> punith s
> 
>

[DISCUSS] Global Settings - Inheritance Rules

2014-06-23 Thread ilya musayev


Not certain if this mechanism exists, if it does, please let me know.

Some settings in ACS that are defined as global setting - can be used on 
much lower level, for example
vm.full.clone - can be used on global, zone, pod, cluster and possibly 
even VM itself.

systemvm.use.local.disk - should be a global and zone
vm.instancename.flag - can be used on zone level, pod and cluster (or 
even VM)


Instead of porting one call at a time based on customer request, would 
it be possible to define Global Setting inheritance rule set. For 
example if inheritance rule is set to global, it can be overriden on 
zone leve, and even cluster or host. We would need a settings 
inheritance tab - that shows what configs have been inherited from 
upstream and ability to override the config on lower level.


I'd propose for inheritance to go from Global Setting, Zone, Pod, 
Cluster, Host and VM. Needless to say, not all Global Settings can be in 
each category.


Any thoughts on this?

Problem with Management server and connection to the databse

2014-06-23 Thread Seif Eddine Jemli

Hi everyone,

I am having a 404 error when trying to access  *http://localhost:8080/client
,  *this exception is in the
management-server.log


2014-06-23 20:43:26,899 INFO  [c.c.u.d.T.Transaction] (main:null) Is Data
Base High Availiability enabled? Ans : false
2014-06-23 20:43:26,915 ERROR [c.c.u.d.Merovingian2] (main:null) Unable to
get a new db connection
*java.sql.SQLException: No suitable driver found for
jdbc:mysql://localhost:3306/cloud?*
autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true
at java.sql.DriverManager.getConnection(DriverManager.java:596)
at java.sql.DriverManager.getConnection(DriverManager.java:215)
at
org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:75)
at
org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)
at
org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1188)
at
org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106)
at
com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:204)
at com.cloud.utils.db.Merovingian2.(Merovingian2.java:68)
at com.cloud.utils.db.Merovingian2.createLockMaster(Merovingian2.java:80)
at com.cloud.server.LockMasterListener.(LockMasterListener.java:33)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:148)
at
org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:121)
at
org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:280)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1045)


what can be the problem?
thanks.

Re: Problem with Management server and connection to the databse

Sounds like a missing mysql driver jar.

Please see the following solution:
http://blog.widodh.nl/2014/03/sql-connection-error-after-upgrade-to-cloudstack-4-3-0/


On 23 June 2014 22:41, Seif Eddine Jemli  wrote:

> Hi everyone,
>
> I am having a 404 error when trying to access  *
> http://localhost:8080/client
> ,  *this exception is in the
> management-server.log
>
>
> 2014-06-23 20:43:26,899 INFO  [c.c.u.d.T.Transaction] (main:null) Is Data
> Base High Availiability enabled? Ans : false
> 2014-06-23 20:43:26,915 ERROR [c.c.u.d.Merovingian2] (main:null) Unable to
> get a new db connection
> *java.sql.SQLException: No suitable driver found for
> jdbc:mysql://localhost:3306/cloud?*
> autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true
> at java.sql.DriverManager.getConnection(DriverManager.java:596)
> at java.sql.DriverManager.getConnection(DriverManager.java:215)
> at
>
> org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:75)
> at
>
> org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)
> at
>
> org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1188)
> at
>
> org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106)
> at
>
> com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:204)
> at com.cloud.utils.db.Merovingian2.(Merovingian2.java:68)
> at com.cloud.utils.db.Merovingian2.createLockMaster(Merovingian2.java:80)
> at com.cloud.server.LockMasterListener.(LockMasterListener.java:33)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
>
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:148)
> at
>
> org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:121)
> at
>
> org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:280)
> at
>
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1045)
>
>
> what can be the problem?
> thanks.
>

[GSoC] Mid Term Looming

Hi Folks,

At the end of this week (27th) we will be at the mid term evaluation stage
of the Google Summer of code programme.

It has been great working with the Cloudstack Community again. I'm very
happy with the progress I've been making on my project and the feedback
I've received from community members. (
http://www.google-melange.com/gsoc/proposal/public/google/gsoc2014/imduffy15/5662278724616192
)

At the moment I've essentially re-created a new devcloud environment using
vagrant and chef. Full details of this can be found over on my projects
github repo: https://github.com/imduffy15/GSoC-2014

This week I extended my current setup to introduce more network cards to
the Hypervisor and "Management Server" This allows for deploying an
advanced zone. The networking looks something like this:
https://pbs.twimg.com/media/BqtBYwiIcAAX_7d.jpg:large

If anybody is interested in giving it a go the project page (
https://github.com/imduffy15/GSoC-2014) contains full instructions.

I had an issue with the default ttylinux template supplied. It has hard
coded DNS servers within its resolv.conf which take precedence.

For this reason I created a debian template. The template is fully
reproducible using packer https://github.com/imduffy15/cloudstack-templates
it exports as a OVA and you can then use qemu / vhd-util to convert it
whatever way you want. I have uploaded one for XenServer
https://github.com/imduffy15/cloudstack-templates/releases

I think it would be neat if the community extended on something like this
to offer templates for all major linux operating systems. In order to
subvert security concerns it would be nice if a CI automatically
generated/uploaded the images (Something like what we do with the SystemVMs)

I've started work on extending the "management" VM to be a self contained
simulator. I have completed some work on my cloudstack cookbook for
installing all development dependencies so it should just be a case of git
cloning from some attribute and building based on attribute parameters.

All feedback welcome!

Ian

Re: [ACS4.5] SQL Error

Looks like we have another SQL issue on master (this time clicking on the
Storage button in the GUI):

DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@7e1b4c2b: SELECT
volume_view.id, volume_view.uuid, volume_view.name, volume_view.device_id,
volume_view.volume_type, volume_view.provisioning_type, volume_view.size,
volume_view.min_iops, volume_view.max_iops, volume_view.state,
volume_view.created, volume_view.attached, volume_view.removed,
volume_view.account_id, volume_view.account_uuid, volume_view.account_name,
volume_view.account_type, volume_view.domain_id, volume_view.domain_uuid,
volume_view.domain_name, volume_view.domain_path, volume_view.project_id,
volume_view.project_uuid, volume_view.project_name, volume_view.pod_id,
volume_view.data_center_id, volume_view.data_center_uuid,
volume_view.data_center_name, volume_view.vm_id, volume_view.vm_uuid,
volume_view.vm_name, volume_view.vm_display_name, volume_view.vm_state,
volume_view.vm_type, volume_view.volume_store_size,
volume_view.created_on_store, volume_view.format, volume_view.download_pct,
volume_view.download_state, volume_view.error_str,
volume_view.hypervisor_type, volume_view.disk_offering_id,
volume_view.disk_offering_uuid, volume_view.disk_offering_name,
volume_view.disk_offering_display_text, volume_view.system_use,
volume_view.use_local_storage, volume_view.bytes_read_rate,
volume_view.bytes_write_rate, volume_view.iops_read_rate,
volume_view.iops_write_rate, volume_view.pool_id, volume_view.pool_uuid,
volume_view.pool_name, volume_view.template_id, volume_view.template_uuid,
volume_view.template_name, volume_view.template_display_text,
volume_view.extractable, volume_view.template_type, volume_view.iso_id,
volume_view.iso_uuid, volume_view.iso_name, volume_view.iso_display_text,
volume_view.job_id, volume_view.job_uuid, volume_view.job_status,
volume_view.tag_id, volume_view.tag_uuid, volume_view.tag_key,
volume_view.tag_value, volume_view.tag_domain_id,
volume_view.tag_account_id, volume_view.tag_resource_id,
volume_view.tag_resource_uuid, volume_view.tag_resource_type,
volume_view.tag_customer, volume_view.display_volume, volume_view.path,
volume_view.chain_info FROM volume_view WHERE volume_view.id=3


On Mon, Jun 23, 2014 at 1:47 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> I see they had an extra couple "$" chars in the code. Thanks for removing
> them, Ian.
>
>
> On Mon, Jun 23, 2014 at 1:43 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> Thanks, Ian
>>
>>
>> On Mon, Jun 23, 2014 at 1:41 PM, Ian Duffy  wrote:
>>
>>> Just pushed a fix for it.
>>>
>>> > The OVM stuff was put in the ovmsupport branch, nothing should be on
>>> master
>>>
>>> There is stuff in master
>>>
>>>
>>> https://github.com/apache/cloudstack/commit/8a485b9b59e4108e862022baf7477f768380b325
>>>
>>> On 23 June 2014 20:38, Sebastien Goasguen  wrote:
>>>
>>> >
>>> > On Jun 23, 2014, at 3:34 PM, Ian Duffy  wrote:
>>> >
>>> > > Hey Mike,
>>> > >
>>> > > This appears to be correct.
>>> > >
>>> > > There newly added lines in create-schema-sql ending in ;$
>>> > >
>>> > > They appear to be introduced with the OVM stuff.
>>> >
>>> > The OVM stuff was put in the ovmsupport branch, nothing should be on
>>> master
>>> >
>>> >
>>> >
>>> > >
>>> > >
>>> > > On 23 June 2014 20:17, Mike Tutkowski 
>>> > wrote:
>>> > >
>>> > >> Do we seriously have an error in our SQL code? :) I ran mvn -P
>>> developer
>>> > >> -pl developer -D deploydb and received the following:
>>> > >>
>>> > >> > Processing SQL file at
>>> > >> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql
>>> > >> Unable to execute
>>> > >> /home/cloudstack/cloudstack/developer/target/db/create-schema.sql:
>>> You
>>> > have
>>> > >> an error in your SQL syntax; check the manual that corresponds to
>>> your
>>> > >> MySQL server version for the right syntax to use near '$ INSERT
>>> IGNORE
>>> > INTO
>>> > >> `cloud`.`hypervisor_capabilities`(hypervisor_type, hypervis' at
>>> line 1
>>> > >>
>>> > >> --
>>> > >> *Mike Tutkowski*
>>> > >> *Senior CloudStack Developer, SolidFire Inc.*
>>> > >> e: mike.tutkow...@solidfire.com
>>> > >> o: 303.746.7302
>>> > >> Advancing the way the world uses the cloud
>>> > >> *™*
>>> > >>
>>> >
>>> >
>>>
>>
>>
>>
>> --
>> *Mike Tutkowski*
>> *Senior CloudStack Developer, SolidFire Inc.*
>> e: mike.tutkow...@solidfire.com
>> o: 303.746.7302
>> Advancing the way the world uses the cloud
>> *™*
>>
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the cloud
> *™*
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the cloud

Re: Review Request 22799: Golden (Base) Primary Storage feature

2014-06-23 Thread Tim Mackey



> On June 23, 2014, 9:16 p.m., Mike Tutkowski wrote:
> > I was wondering if you could fill out the section about tests that have 
> > been performed?
> > 
> > I would be interested in both new and regression testing.
> > 
> > Thanks!

It looked like some functions added parameters, but didn't include descriptions 
of those parameters.  

Having just gone through some refactoring, I'd like to see some of the 
abbreviations made clearer.  I'm thinking of future people who might not be as 
familiar with this code.

You made changes to schema-421to430, but that represents shipping versions.  
Please ensure schema changes are done in 4.5 (aka master).

I didn't see anything which limited this to XenServer only.  I could easily 
have missed it, but if this is only XenServer, I'd prefer to see some check to 
keep people from accidentally configuring something which isn't expected to 
work for them.

Thanks

-tim 


- Tim


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22799/#review46451
---


On June 20, 2014, 3:46 a.m., Hieu LE wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22799/
> ---
> 
> (Updated June 20, 2014, 3:46 a.m.)
> 
> 
> Review request for cloudstack, Mike Tutkowski and Tim Mackey.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> As discussed in mailing list, this patch is applied for golden primary 
> storage in [1].
> I have changed the term from "golden" to "base" because there are some 
> functions and variables in CloudStack also use "base" for base image.
> This patch only apply for Xen Server.
> 
> [1]: 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Golden+Primary+Storage
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/deploy/DeployDestination.java 
> 4ded5ebe7a18252da471ee25019856f2b2f772e0 
>   api/src/com/cloud/storage/StoragePool.java 
> 8e03c3348f3a6dd3156ab9e440126ea317957dc0 
>   api/src/com/cloud/template/VirtualMachineTemplate.java 
> 599212bb039fdbb78511019e8f0a6ea4b4a84440 
>   api/src/org/apache/cloudstack/api/ApiConstants.java 
> ae5d6f05b6b52f60b151369a641cb11fcbb558af 
>   api/src/org/apache/cloudstack/api/BaseUpdateTemplateOrIsoCmd.java 
> 2350f6b389203e2c6cc2182fe03fe9a95e936b81 
>   
> api/src/org/apache/cloudstack/api/command/admin/storage/CreateStoragePoolCmd.java
>  ae44bc9373232d242e4ebdcf76844969f0fe69fc 
>   
> api/src/org/apache/cloudstack/api/command/admin/storage/UpdateStoragePoolCmd.java
>  3d1a77353257c814efaf60875ffdf99603bc414e 
>   
> api/src/org/apache/cloudstack/api/command/user/template/RegisterTemplateCmd.java
>  f478c9bc8eebf867a03deb4add1bf695ac3ec0ad 
>   api/src/org/apache/cloudstack/api/response/StoragePoolResponse.java 
> 3571866fe74dca9aa5fe0d11373313eab97e94ac 
>   api/src/org/apache/cloudstack/api/response/TemplateResponse.java 
> 3e21043e339103c021d3c9e767acac8b3837f760 
>   core/src/com/cloud/agent/api/CheckPoolBelongToHostAnswer.java PRE-CREATION 
>   core/src/com/cloud/agent/api/CheckPoolBelongToHostCommand.java PRE-CREATION 
>   core/src/org/apache/cloudstack/storage/to/PrimaryDataStoreTO.java 
> 29e53b0d9581f764a17ea285606213d2c045b029 
>   core/src/org/apache/cloudstack/storage/to/TemplateObjectTO.java 
> b201c386f4975913f13c575d7685e50cedc7d92f 
>   
> core/test/org/apache/cloudstack/api/agent/test/BackupSnapshotCommandTest.java 
> 33361e87265df05e00bfa6dba810d2b68ae8d923 
>   core/test/org/apache/cloudstack/api/agent/test/CheckNetworkAnswerTest.java 
> 66feaecb5ef20053db50956e2801fec096a350c9 
>   core/test/org/apache/cloudstack/api/agent/test/SnapshotCommandTest.java 
> 114c8854d1504436523aa99c78bf2b4d84a12077 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/PrimaryDataStoreParameters.java
>  1dbff59a8911ad8f0933ef17a2c2b1d3e33523b9 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/StoragePoolAllocator.java
>  dfdbd8ab92c47799f6ad23637fa63e030f0be968 
>   
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/VolumeInfo.java
>  f93f4efac83c565cd33eb7eb67dcaca335f1c226 
>   engine/components-api/src/com/cloud/deploy/DeploymentPlanningManager.java 
> ee6721ab445a5222d0087dc9170e0b58f9eef91a 
>   engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java 
> 4aa5fc80d9660d2f985db98124c33465bd99767f 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/cloud/entity/api/VMEntityManagerImpl.java
>  b1ac2f853374d6f1ddd9087919dbc16db0433f59 
>   
> engine/orchestration/src/org/apache/cloudstack/engine/orchestration/VolumeOrchestrator.java
>  6256e2526ef9bd4632a5e3873c4d9531eb301c7f 
>   engine/schema/src/com/cloud/storage/VMTemplateVO.java 
> 9a77cbf873aa9e422985fbcdc0ae7e18b8c78d4c 
>   engine/schema/src/com

Re: Review Request 22709: This test suite contains test cases relating to access checks for createNetwork(), deploying VM in an isolated network and restartNetwork() for Admin, domain admin and regula

2014-06-23 Thread sangeetha hariharan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22709/
---

(Updated June 24, 2014, 12:38 a.m.)


Review request for cloudstack, Min Chen, Prachi Damle, and Santhosh Edukulla.


Changes
---

Made the following changes for Test cases relating to acl checks for 
isolate Networks relating to createNetwork() , restartNetwork() and deploying 
VM:
- Replaced try and except block such that the self.fail() statement is 
moved inside the try block. Also using self.fail() instead of raising exception 
when error message validation fails
- Replaced selfservice tag to required_hardware="false"
- Added Acl related error messages as constants to CloudstackAclException() 
in cloudstackException.py and added verifyMsginException() and 
verifyErrorCodeinException() to check for error message/error code in an 
exception.
- Added ACL related data needed for driving test_acl_isolatednetwork.py to 
common test data repository in test_data.py
- Added Allocated state string for network in codes.py



Repository: cloudstack-git


Description
---

This test suite contains test cases relating to access checks for 
createNetwork(), deploying VM in an isolated network and restartNetwork() for 
Admin, domain admin and regular users.


Added error string constants in code.py
Added verifyMsginException() to verify the presence of error string in 
exception string


Diffs (updated)
-

  test/integration/component/test_acl_isolatednetwork.py PRE-CREATION 
  tools/marvin/marvin/cloudstackException.py c2eb57a 
  tools/marvin/marvin/codes.py a1e7085 
  tools/marvin/marvin/config/test_data.py d870c98 

Diff: https://reviews.apache.org/r/22709/diff/


Testing
---

test_01_createNetwork_admin 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_01_createNetwork_admin | Status : SUCCESS ===
ok
test_02_createNetwork_admin_foruserinsamedomain 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_02_createNetwork_admin_foruserinsamedomain | Status : SUCCESS ===
ok
test_03_createNetwork_admin_foruserinotherdomain 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_03_createNetwork_admin_foruserinotherdomain | Status : SUCCESS 
===
ok
test_04_createNetwork_domaindmin 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_04_createNetwork_domaindmin | Status : SUCCESS ===
ok
test_05_createNetwork_domaindmin_foruserinsamedomain 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_05_createNetwork_domaindmin_foruserinsamedomain | Status : 
SUCCESS ===
ok
test_06_createNetwork_domaindmin_foruserinsubdomain 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_06_createNetwork_domaindmin_foruserinsubdomain | Status : 
SUCCESS ===
ok
test_07_createNetwork_domaindmin_forcrossdomainuser 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_07_createNetwork_domaindmin_forcrossdomainuser | Status : 
SUCCESS ===
ok
test_08_createNetwork_user 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_08_createNetwork_user | Status : SUCCESS ===
ok
test_09_createNetwork_user_foruserinsamedomain 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_09_createNetwork_user_foruserinsamedomain | Status : SUCCESS ===
ok
test_10_createNetwork_user_foruserinotherdomain 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_10_createNetwork_user_foruserinotherdomain | Status : SUCCESS ===
ok
test_11_deployvm_admin 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_11_deployvm_admin | Status : SUCCESS ===
ok
test_12_deployvm_admin_foruserinsamedomain 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_12_deployvm_admin_foruserinsamedomain | Status : SUCCESS ===
ok
test_13_1_deployvm_admin_foruserinotherdomain_crossnetwork 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_13_1_deployvm_admin_foruserinotherdomain_crossnetwork | Status : 
SUCCESS ===
ok
test_13_deployvm_admin_foruserinotherdomain 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_13_deployvm_admin_foruserinotherdomain | Status : SUCCESS ===
ok
test_14_deployvm_domaindmin 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_14_deployvm_domaindmin | Status : SUCCESS ===
ok
test_15_deployvm_domaindmin_foruserinsamedomain 
(integration.component.test_acl_isolatednetwork.TestIsolatedNetwork) ... === 
TestName: test_15

Re: Review Request 22799: Golden (Base) Primary Storage feature

2014-06-23 Thread Hieu LE

Hi Tim and Mike,


On Tue, Jun 24, 2014 at 5:59 AM, Tim Mackey  wrote:

>This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22799/
>
> On June 23rd, 2014, 9:16 p.m. UTC, *Mike Tutkowski* wrote:
>
> I was wondering if you could fill out the section about tests that have been 
> performed?
>
> I would be interested in both new and regression testing.
>
> Thanks!
>
> Thank you Mike, will I use marvin for regression testing ?


>   It looked like some functions added parameters, but didn't include 
> descriptions of those parameters.
>
> Having just gone through some refactoring, I'd like to see some of the 
> abbreviations made clearer.  I'm thinking of future people who might not be 
> as familiar with this code.
>
> Thank you, I will refactor my code to make it clearer.


>
> You made changes to schema-421to430, but that represents shipping versions.  
> Please ensure schema changes are done in 4.5 (aka master).
>
> Sure !

> I didn't see anything which limited this to XenServer only.  I could easily 
> have missed it, but if this is only XenServer, I'd prefer to see some check 
> to keep people from accidentally configuring something which isn't expected 
> to work for them.
>
> I have implemented some checks in this patch which limited to XenServer,
e.g: in DeploymentPlanningManagerImpl class, function planBaseDeployment,
line 298, or basePsHostCheck function to check that host can communicate
with pool.


>
> Thanks
>
> -tim
>
>
> - Tim
>
> On June 20th, 2014, 3:46 a.m. UTC, Hieu LE wrote:
>   Review request for cloudstack, Mike Tutkowski and Tim Mackey.
> By Hieu LE.
>
> *Updated June 20, 2014, 3:46 a.m.*
>  *Repository: * cloudstack-git
> Description
>
> As discussed in mailing list, this patch is applied for golden primary 
> storage in [1].
> I have changed the term from "golden" to "base" because there are some 
> functions and variables in CloudStack also use "base" for base image.
> This patch only apply for Xen Server.
>
> [1]: 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Golden+Primary+Storage
>
>   Diffs
>
>- api/src/com/cloud/deploy/DeployDestination.java
>(4ded5ebe7a18252da471ee25019856f2b2f772e0)
>- api/src/com/cloud/storage/StoragePool.java
>(8e03c3348f3a6dd3156ab9e440126ea317957dc0)
>- api/src/com/cloud/template/VirtualMachineTemplate.java
>(599212bb039fdbb78511019e8f0a6ea4b4a84440)
>- api/src/org/apache/cloudstack/api/ApiConstants.java
>(ae5d6f05b6b52f60b151369a641cb11fcbb558af)
>- api/src/org/apache/cloudstack/api/BaseUpdateTemplateOrIsoCmd.java
>(2350f6b389203e2c6cc2182fe03fe9a95e936b81)
>- 
> api/src/org/apache/cloudstack/api/command/admin/storage/CreateStoragePoolCmd.java
>(ae44bc9373232d242e4ebdcf76844969f0fe69fc)
>- 
> api/src/org/apache/cloudstack/api/command/admin/storage/UpdateStoragePoolCmd.java
>(3d1a77353257c814efaf60875ffdf99603bc414e)
>- 
> api/src/org/apache/cloudstack/api/command/user/template/RegisterTemplateCmd.java
>(f478c9bc8eebf867a03deb4add1bf695ac3ec0ad)
>- api/src/org/apache/cloudstack/api/response/StoragePoolResponse.java
>(3571866fe74dca9aa5fe0d11373313eab97e94ac)
>- api/src/org/apache/cloudstack/api/response/TemplateResponse.java
>(3e21043e339103c021d3c9e767acac8b3837f760)
>- core/src/com/cloud/agent/api/CheckPoolBelongToHostAnswer.java
>(PRE-CREATION)
>- core/src/com/cloud/agent/api/CheckPoolBelongToHostCommand.java
>(PRE-CREATION)
>- core/src/org/apache/cloudstack/storage/to/PrimaryDataStoreTO.java
>(29e53b0d9581f764a17ea285606213d2c045b029)
>- core/src/org/apache/cloudstack/storage/to/TemplateObjectTO.java
>(b201c386f4975913f13c575d7685e50cedc7d92f)
>- 
> core/test/org/apache/cloudstack/api/agent/test/BackupSnapshotCommandTest.java
>(33361e87265df05e00bfa6dba810d2b68ae8d923)
>- 
> core/test/org/apache/cloudstack/api/agent/test/CheckNetworkAnswerTest.java
>(66feaecb5ef20053db50956e2801fec096a350c9)
>- core/test/org/apache/cloudstack/api/agent/test/SnapshotCommandTest.java
>(114c8854d1504436523aa99c78bf2b4d84a12077)
>- 
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/PrimaryDataStoreParameters.java
>(1dbff59a8911ad8f0933ef17a2c2b1d3e33523b9)
>- 
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/StoragePoolAllocator.java
>(dfdbd8ab92c47799f6ad23637fa63e030f0be968)
>- 
> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/VolumeInfo.java
>(f93f4efac83c565cd33eb7eb67dcaca335f1c226)
>- engine/components-api/src/com/cloud/deploy/DeploymentPlanningManager.java
>(ee6721ab445a5222d0087dc9170e0b58f9eef91a)
>- engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java
>(4aa5fc80d9660d2f985db98124c33465bd99767f)
>- 
> engine/orchestration/src/org/apache/cloudstack/engine/cloud/entity/api/VMEntityManagerImpl.java
>(b1ac2f853374d6f1ddd9087919dbc16db0433f59)
>- 
> engine/or

Re: Review Request 22799: Golden (Base) Primary Storage feature

Hi,

Yes, Marvin is great for automated regression testing of CloudStack.

However, I was hoping you could note even manual testing (new and
regression tests) you may have run to verify correctness of the system
within reason (even if these are not automated).

If you have time, automated tests would be excellent, as well.

Thanks!
Mike


On Mon, Jun 23, 2014 at 8:50 PM, Hieu LE  wrote:

> Hi Tim and Mike,
>
>
> On Tue, Jun 24, 2014 at 5:59 AM, Tim Mackey  wrote:
>
>>This is an automatically generated e-mail. To reply, visit:
>> https://reviews.apache.org/r/22799/
>>
>> On June 23rd, 2014, 9:16 p.m. UTC, *Mike Tutkowski* wrote:
>>
>> I was wondering if you could fill out the section about tests that have been 
>> performed?
>>
>> I would be interested in both new and regression testing.
>>
>> Thanks!
>>
>> Thank you Mike, will I use marvin for regression testing ?
>
>
>>   It looked like some functions added parameters, but didn't include 
>> descriptions of those parameters.
>>
>> Having just gone through some refactoring, I'd like to see some of the 
>> abbreviations made clearer.  I'm thinking of future people who might not be 
>> as familiar with this code.
>>
>> Thank you, I will refactor my code to make it clearer.
>
>
>>
>> You made changes to schema-421to430, but that represents shipping versions.  
>> Please ensure schema changes are done in 4.5 (aka master).
>>
>> Sure !
>
>> I didn't see anything which limited this to XenServer only.  I could easily 
>> have missed it, but if this is only XenServer, I'd prefer to see some check 
>> to keep people from accidentally configuring something which isn't expected 
>> to work for them.
>>
>> I have implemented some checks in this patch which limited to XenServer,
> e.g: in DeploymentPlanningManagerImpl class, function planBaseDeployment,
> line 298, or basePsHostCheck function to check that host can communicate
> with pool.
>
>
>>
>> Thanks
>>
>> -tim
>>
>>
>> - Tim
>>
>> On June 20th, 2014, 3:46 a.m. UTC, Hieu LE wrote:
>>Review request for cloudstack, Mike Tutkowski and Tim Mackey.
>> By Hieu LE.
>>
>> *Updated June 20, 2014, 3:46 a.m.*
>>  *Repository: * cloudstack-git
>> Description
>>
>> As discussed in mailing list, this patch is applied for golden primary 
>> storage in [1].
>> I have changed the term from "golden" to "base" because there are some 
>> functions and variables in CloudStack also use "base" for base image.
>> This patch only apply for Xen Server.
>>
>> [1]: 
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Golden+Primary+Storage
>>
>>   Diffs
>>
>>- api/src/com/cloud/deploy/DeployDestination.java
>>(4ded5ebe7a18252da471ee25019856f2b2f772e0)
>>- api/src/com/cloud/storage/StoragePool.java
>>(8e03c3348f3a6dd3156ab9e440126ea317957dc0)
>>- api/src/com/cloud/template/VirtualMachineTemplate.java
>>(599212bb039fdbb78511019e8f0a6ea4b4a84440)
>>- api/src/org/apache/cloudstack/api/ApiConstants.java
>>(ae5d6f05b6b52f60b151369a641cb11fcbb558af)
>>- api/src/org/apache/cloudstack/api/BaseUpdateTemplateOrIsoCmd.java
>>(2350f6b389203e2c6cc2182fe03fe9a95e936b81)
>>- 
>> api/src/org/apache/cloudstack/api/command/admin/storage/CreateStoragePoolCmd.java
>>(ae44bc9373232d242e4ebdcf76844969f0fe69fc)
>>- 
>> api/src/org/apache/cloudstack/api/command/admin/storage/UpdateStoragePoolCmd.java
>>(3d1a77353257c814efaf60875ffdf99603bc414e)
>>- 
>> api/src/org/apache/cloudstack/api/command/user/template/RegisterTemplateCmd.java
>>(f478c9bc8eebf867a03deb4add1bf695ac3ec0ad)
>>- api/src/org/apache/cloudstack/api/response/StoragePoolResponse.java
>>(3571866fe74dca9aa5fe0d11373313eab97e94ac)
>>- api/src/org/apache/cloudstack/api/response/TemplateResponse.java
>>(3e21043e339103c021d3c9e767acac8b3837f760)
>>- core/src/com/cloud/agent/api/CheckPoolBelongToHostAnswer.java
>>(PRE-CREATION)
>>- core/src/com/cloud/agent/api/CheckPoolBelongToHostCommand.java
>>(PRE-CREATION)
>>- core/src/org/apache/cloudstack/storage/to/PrimaryDataStoreTO.java
>>(29e53b0d9581f764a17ea285606213d2c045b029)
>>- core/src/org/apache/cloudstack/storage/to/TemplateObjectTO.java
>>(b201c386f4975913f13c575d7685e50cedc7d92f)
>>- 
>> core/test/org/apache/cloudstack/api/agent/test/BackupSnapshotCommandTest.java
>>(33361e87265df05e00bfa6dba810d2b68ae8d923)
>>- 
>> core/test/org/apache/cloudstack/api/agent/test/CheckNetworkAnswerTest.java
>>(66feaecb5ef20053db50956e2801fec096a350c9)
>>- core/test/org/apache/cloudstack/api/agent/test/SnapshotCommandTest.java
>>(114c8854d1504436523aa99c78bf2b4d84a12077)
>>- 
>> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/PrimaryDataStoreParameters.java
>>(1dbff59a8911ad8f0933ef17a2c2b1d3e33523b9)
>>- 
>> engine/api/src/org/apache/cloudstack/engine/subsystem/api/storage/StoragePoolAllocator.java
>>(dfdbd8ab92c47799f6ad23637fa63e030f0be968)
>>- 
>> engine/api/src/org/apache/cloudstack/e

Re: Agent fails to start on SSVM/CPVM on latest master due to " Unsupported major.minor version 51.0"

2014-06-23 Thread Nguyen Anh Tu

Got it. Thanks Ian.

--Tuna


On Tue, Jun 24, 2014 at 12:32 AM, Ian Duffy  wrote:

> Tuna,
>
> A list of all the artifacts can be seen on the jenkins UI.
>
> http://jenkins.buildacloud.org/job/build-systemvm64-master/
>
>
> On 23 June 2014 18:29, Nguyen Anh Tu  wrote:
>
> > Mike,
> >
> > These links are not found at that moment. Could you check them?
> >
> > Cheers,
> >
> > --Tuna
> >
> >
> > On Wed, Mar 12, 2014 at 1:42 AM, Mike Tutkowski <
> > mike.tutkow...@solidfire.com> wrote:
> >
> > > Here are links to the most recent ones for XenServer and KVM:
> > >
> > >
> > >
> >
> http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-xen.vhd.bz2
> > >
> > >
> >
> http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-kvm.qcow2.bz2
> > >
> > > Once I installed the one for XenServer, it fixed my problem.
> > >
> > >
> > > On Tue, Mar 11, 2014 at 12:39 PM, Alena Prokharchyk <
> > > alena.prokharc...@citrix.com> wrote:
> > >
> > > > Jdk version on the system vms is "1.6.0_27"; on my MS machine where
> > I've
> > > > built the CS is 1.7.
> > > >
> > > > I'm not familiar with the way we package our templates, do I need to
> > > > download new ones to my secondary storage? If so, what is the URL for
> > the
> > > > latest templates?
> > > >
> > > > From: Alena Prokharchyk  > > > alena.prokharc...@citrix.com>>
> > > > Date: Tuesday, March 11, 2014 at 11:31 AM
> > > > To: "dev@cloudstack.apache.org" <
> > > > dev@cloudstack.apache.org>
> > > > Subject: Agent fails to start on SSVM/CPVM on latest master due to "
> > > > Unsupported major.minor version 51.0"
> > > >
> > > > Does anybody see the same behavior and knows how to fix it?
> > > >
> > > >
> > > >   *   installed latest master CS, re-deployed DB
> > > >   *   After MS started up, system vms were created
> > > >   *   Agents inside SSVM/CPVM failed to start with this error:
> > > >
> > > >
> > > > + java -Djavax.net.ssl.trustStore=./certs/realhostip.keystore
> > > > -Dlog.home=/var/log/cloud/ -mx396m -cp
> > > >
> > >
> >
> ./:./conf:activation-1.1.jar:antisamy-1.4.3.jar:aopalliance-1.0.jar:apache-log4j-extras-1.1.jar:aspectjweaver-1.7.0.jar:aws-java-sdk-1.3.22.jar:batik-css-1.7.jar:batik-ext-1.7.jar:batik-util-1.7.jar:bcprov-jdk16-1.46.jar:bsh-core-2.0b4.jar:cglib-nodep-2.2.2.jar:cloud-agent-4.4.0-SNAPSHOT.jar:cloud-api-4.4.0-SNAPSHOT.jar:cloud-console-proxy-4.4.0-SNAPSHOT.jar:cloud-core-4.4.0-SNAPSHOT.jar:cloud-engine-api-4.4.0-SNAPSHOT.jar:cloud-engine-components-api-4.4.0-SNAPSHOT.jar:cloud-engine-schema-4.4.0-SNAPSHOT.jar:cloud-framework-cluster-4.4.0-SNAPSHOT.jar:cloud-framework-config-4.4.0-SNAPSHOT.jar:cloud-framework-db-4.4.0-SNAPSHOT.jar:cloud-framework-events-4.4.0-SNAPSHOT.jar:cloud-framework-ipc-4.4.0-SNAPSHOT.jar:cloud-framework-jobs-4.4.0-SNAPSHOT.jar:cloud-framework-managed-context-4.4.0-SNAPSHOT.jar:cloud-framework-rest-4.4.0-SNAPSHOT.jar:cloud-framework-security-4.4.0-SNAPSHOT.jar:cloud-secondary-storage-4.4.0-SNAPSHOT.jar:cloud-server-4.4.0-SNAPSHOT.jar:cloud-utils-4.4.0-SNAPSHOT.jar:cloudstack-service-console-proxy-rdpclient-4.4.0-SNAPSHOT.jar:commons-beanutils-core-1.7.0.jar:commons-codec-1.6.jar:commons-collections-3.2.jar:commons-configuration-1.8.jar:commons-daemon-1.0.10.jar:commons-dbcp-1.4.jar:commons-fileupload-1.2.jar:commons-httpclient-3.1.jar:commons-io-1.4.jar:commons-lang-2.6.jar:commons-logging-1.1.1.jar:commons-net-3.3.jar:commons-pool-1.6.jar:cxf-bundle-jaxrs-2.7.0.jar:dom4j-1.6.1.jar:ehcache-core-2.6.6.jar:ejb-api-3.0.jar:esapi-2.0.1.jar:geronimo-javamail_1.4_spec-1.7.1.jar:geronimo-servlet_3.0_spec-1.0.jar:gson-1.7.1.jar:guava-14.0-rc1.jar:httpclient-4.2.1.jar:httpcore-4.2.1.jar:jackson-annotations-2.1.1.jar:jackson-core-2.1.1.jar:jackson-core-asl-1.8.9.jar:jackson-databind-2.1.1.jar:jackson-jaxrs-json-provider-2.1.1.jar:jackson-mapper-asl-1.8.9.jar:jackson-module-jaxb-annotations-2.1.1.jar:jasypt-1.9.0.jar:java-ipv6-0.10.jar:javassist-3.12.1.GA.jar:javassist-3.18.1-GA.jar:javax.inject-1.jar:javax.persistence-2.0.0.jar:javax.ws.rs-api-2.0-m10.jar:jaxen-1.1-beta-8.jar:jdom-1.0.jar:jetty-continuation-8.1.7.v20120910.jar:jetty-http-8.1.7.v20120910.jar:jetty-io-8.1.7.v20120910.jar:jetty-security-8.1.7.v20120910.jar:jetty-util-8.1.7.v20120910.jar:jsch-0.1.42.jar:jstl-1.2.jar:log4j-1.2.16.jar:mail-1.4.jar:nekohtml-1.9.12.jar:objenesis-2.1.jar:powermock-core-1.5.3.jar:powermock-module-junit4-1.5.3.jar:powermock-module-junit4-common-1.5.3.jar:powermock-reflect-1.5.3.jar:reflections-0.9.8.jar:slf4j-api-1.7.5.jar:slf4j-log4j12-1.7.5.jar:spring-aop-3.2.4.RELEASE.jar:spring-beans-3.2.4.RELEASE.jar:spring-context-3.2.4.RELEASE.jar:spring-core-3.2.4.RELEASE.jar:spring-expression-3.2.4.RELEASE.jar:spring-web-3.2.4.RELEASE.jar:stax2-api-3.1.1.jar:tomcat-embed-core-7.0.30.jar:trilead-ssh2-build213-svnkit-1.3-patch.jar:

Management Server HA & DB Replication

2014-06-23 Thread Tejas Gadaria

Hi,

I want to make MS on high availability, with automatic failover.
I have MS & DB on same server. & planning to create slave DB on separate
server.

but if I create separate Slave MS for HA, how can point it to DB so command
issued from any of MS will trigger to same infrastructure.

Regards,
Tejas

Re: Review Request 22865: [Automation] test_01_primary_storage_iscsi failed on "test_primary_storage.py" - Wrong iscsi path format - it should be /targetIQN/LUN


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22865/#review46494
---

Ship it!


4.4-forward -> 24401e0b2b575d1aa151dbf5d4e0e0e1de4e9361
master -> d3ffb7a5659bf988d00f607ee14cc07741b76c4a

- Koushik Das


On June 23, 2014, 10:54 a.m., Damodar Reddy Talakanti wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/22865/
> ---
> 
> (Updated June 23, 2014, 10:54 a.m.)
> 
> 
> Review request for cloudstack, daan Hoogland and Koushik Das.
> 
> 
> Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-6444
> 
> https://issues.apache.org/jira/browse/https://issues.apache.org/jira/browse/CLOUDSTACK-6444
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Due to the changes done to fix the findbug tool issues, we introduced the 
> iSCSI path format issue by replacing the first "/" with empty string. Fixed 
> the same by removing the replacement string part.
> 
> 
> Diffs
> -
> 
>   
> plugins/storage/volume/default/src/org/apache/cloudstack/storage/datastore/lifecycle/CloudStackPrimaryDataStoreLifeCycleImpl.java
>  3c1b76a 
> 
> Diff: https://reviews.apache.org/r/22865/diff/
> 
> 
> Testing
> ---
> 
> Tested with iSCSI primary storage with XenServer
> 
> 
> Thanks,
> 
> Damodar Reddy Talakanti
> 
>

Build failed in Jenkins: cloudstack-4.4-forward-build #282