test_nicira_controller.py is failing on all Advzone - XS, KVM

2015-09-30 Thread Raja Pullela 
Hi Miguel or someone's familiar with this test,

Can you please provide documentation around how to get these tests running ?
BTW - looks like this is a new test that was added on Aug 25th 2015.

Thanks,
Raja

=== TestName: None | Status : EXCEPTION ===
ERROR

==
ERROR: test suite for 
--
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 209, in run
self.setUp()
  File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 292, in 
setUp
self.setupContext(ancestor)
  File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 315, in 
setupContext
try_run(context, names)
  File "/usr/local/lib/python2.7/dist-packages/nose/util.py", line 470, in 
try_run
return func()
  File "/root/cloudstack/test/integration/smoke/test_nicira_controller.py", 
line 46, in setUpClass
cls.nicira_hosts  = cls.config.niciraNvp.hosts
AttributeError: 'NoneType' object has no attribute 'hosts'
 >> begin captured stdout << -
=== TestName: None | Status : EXCEPTION ===


- >> end captured stdout << --
 >> begin captured logging << 
CSLog: CRITICAL: EXCEPTION: None: ['Traceback (most recent call last):\n', '  
File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 209, in run\n 
   self.setUp()\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 292, in setUp\n
self.setupContext(ancestor)\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 315, in 
setupContext\ntry_run(context, names)\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/util.py", line 470, in try_run\n   
 return func()\n', '  File 
"/root/cloudstack/test/integration/smoke/test_nicira_controller.py", line 46, 
in setUpClass\ncls.nicira_hosts  = cls.config.niciraNvp.hosts\n', 
"AttributeError: 'NoneType' object has no attribute 'hosts'\n"]
- >> end captured logging << -

--
XML: /root/marvinxKcIvFqe/results.xml
--
Ran 0 tests in 0.002s

FAILED (errors=1)

Re: BVT report 9/29

2015-09-30 Thread Milamber 


The Advanced Network with SG don't works with me (perhaps mistake in my 
setup).

The error on wizard final step is:

string '' has an unknown BroadcastDomainType

Perhaps need a VLAN ID? (mandatory?)

Extract of log:

2015-09-30 06:53:01,070 DEBUG [c.c.a.ApiServlet] 
(catalina-exec-5:ctx-85a55cdf) ===START===  192.168.7.235 -- GET 
command=createNetwork&response=json&zoneid=2017678e-c89b-42b4-9722-5af3fa6d398a&name=defaultGuestNetwork&displaytext=defaultGuestNetwork&networkofferingid=243b0d2a-5295-4c0b-9716-c62fc7262d07&gateway=192.168.100.1&netmask=255.255.255.0&startip=192.168.100.10&vlan=&endip=192.168.100.99&_=1443595981035


2015-09-30 06:53:01,137 DEBUG [c.c.u.d.T.Transaction] 
(catalina-exec-5:ctx-85a55cdf ctx-ef462c95) Rolling back the 
transaction: Time = 8 Name =  catalina-exec-5; called by 
-TransactionLegacy.rollback:879-TransactionLegacy.removeUpTo:822-TransactionLegacy.close:646-Transaction.execute:49-NetworkServiceImpl.commitNetwork:1339-NetworkServiceImpl.createGuestNetwork:1302-NativeMethodAccessorImpl.invoke0:-2-NativeMethodAccessorImpl.invoke:57-DelegatingMethodAccessorImpl.invoke:43-Method.invoke:606-AopUtils.invokeJoinpointUsingReflection:317-ReflectiveMethodInvocation.invokeJoinpoint:183


2015-09-30 06:53:01,137 DEBUG [c.c.u.d.T.Transaction] 
(catalina-exec-5:ctx-85a55cdf ctx-ef462c95) Rolling back the 
transaction: Time = 8 Name =  catalina-exec-5; called by 
-TransactionLegacy.rollback:879-TransactionLegacy.removeUpTo:822-TransactionLegacy.close:646-Transaction.execute:49-NetworkServiceImpl.commitNetwork:1339-NetworkServiceImpl.createGuestNetwork:1302-NativeMethodAccessorImpl.invoke0:-2-NativeMethodAccessorImpl.invoke:57-DelegatingMethodAccessorImpl.invoke:43-Method.invoke:606-AopUtils.invokeJoinpointUsingReflection:317-ReflectiveMethodInvocation.invokeJoinpoint:183
2015-09-30 06:53:01,149 ERROR [c.c.a.ApiServer] 
(catalina-exec-5:ctx-85a55cdf ctx-ef462c95) unhandled exception 
executing api command: [Ljava.lang.String;@50f714ea
com.cloud.utils.exception.CloudRuntimeException: string '' has an 
unknown BroadcastDomainType.
at 
com.cloud.network.Networks$BroadcastDomainType.fromString(Networks.java:260)
at 
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.createGuestNetwork(NetworkOrchestrator.java:1913)
at 
com.cloud.network.NetworkServiceImpl$4.doInTransaction(NetworkServiceImpl.java:1391)
at 
com.cloud.network.NetworkServiceImpl$4.doInTransaction(NetworkServiceImpl.java:1339)

at com.cloud.utils.db.Transaction.execute(Transaction.java:45)
at 
com.cloud.network.NetworkServiceImpl.commitNetwork(NetworkServiceImpl.java:1339)
at 
com.cloud.network.NetworkServiceImpl.createGuestNetwork(NetworkServiceImpl.java:1302)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at 
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at 
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)

at com.sun.proxy.$Proxy160.createGuestNetwork(Unknown Source)
at 
org.apache.cloudstack.api.command.admin.network.CreateNetworkCmdByAdmin.execute(CreateNetworkCmdByAdmin.java:58)

at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:703)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:528)
at 
com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:296)

at com.cloud.api.ApiServlet$1.run(ApiServlet.java:127)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)

RE: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Koushik Das 
Raja,
The earlier scale vm test couldn't run on simulator because of the validation 
steps (IIRC it tries to connect to the real VM created during test). Since it 
wasn't possible to run with simulator, the new test was added to run just on 
the simulator. Check the required_hardware tag.

-Original Message-
From: Raja Pullela [mailto:raja.pull...@citrix.com] 
Sent: Wednesday, 30 September 2015 12:12
To: CloudStack Dev (dev@cloudstack.apache.org)
Subject: [Blocker] test duplicated in test_scale_vm.py

Hi,

Filed this blocker on test case "test_scale_vm.py"  - 
https://issues.apache.org/jira/browse/CLOUDSTACK-8924
Fixing this will bring Simulator Basic and XS Basic to 100% passrate.

Best,
Raja

Re: BVT report 9/29

2015-09-30 Thread Milamber 


The advanced network installation without SG seems works, but the final 
screen of setup wizard stills blank until the activation zone pop-up. A 
lot of error in the browser console. I need make more test (clean my 
browser cache before setup)


See screenshot: http://s27.postimg.org/qr7pijrer/Selection_151.png


On 29/09/2015 22:40, Milamber wrote:


If I change my ansible script to install the tomcat6 package before 
cloudstack-management, that's works.


Tomorrow I will test a full ACS advanced network installation.

root@cs-mgr1:~# service cloudstack-management status
 * CloudStack-specific Tomcat servlet engine is running with pid 5798
root@cs-mgr1:~# dpkg -l|grep cloudstack
ii  cloudstack-common 4.6.0-SNAPSHOT all  A common package 
which contains files which are shared by several CloudStack packages
ii  cloudstack-management 4.6.0-SNAPSHOT all  CloudStack 
server library

root@cs-mgr1:~# dpkg -l|grep tomcat
ii  libtomcat6-java 6.0.39-1 all Servlet and 
JSP engine -- core libraries
ii  tomcat6 6.0.39-1 all  Servlet and 
JSP engine
ii  tomcat6-common 6.0.39-1 all Servlet and 
JSP engine -- common files




On 29/09/2015 22:07, Milamber wrote:


I have tested an installation of the CS 4.6.0 SNAPSHOT (today) on 
Ubuntu 14.04 LTS with latest update (installation with a ansible script)


The cloudstack-management don't works.


I don't known the root cause, but I suppose that is the (new?) 
dependency of Tomcat v7 (before ~1 month: tomcat6 was the tomcat 
dependency)


I need to made some other tests to confirm if the issue come from my 
ansible script or other things.


Some results commands (and visibly at least 1 bug):

root@cs-mgr1:/var/log/cloudstack/management# service 
cloudstack-management status

 * cloudstack-management is not installed

root@cs-mgr1:/var/log/cloudstack/management# dpkg -l|grep cloudstack
ii  cloudstack-common 4.6.0-SNAPSHOT all  A common package 
which contains files which are shared by several CloudStack packages
ii  cloudstack-management 4.6.0-SNAPSHOT all  CloudStack 
server library


root@cs-mgr1:/var/log/cloudstack/management# dpkg -l|grep tomcat
ii  libtomcat7-java 7.0.52-1ubuntu0.3all Servlet and 
JSP engine -- core libraries

ii  tomcat7 7.0.52-1ubuntu0.3all Servlet and JSP engine
ii  tomcat7-common 7.0.52-1ubuntu0.3all Servlet and 
JSP engine -- common files



On 29/09/2015 19:42, Sebastien Goasguen wrote:

Hi folks, let’s try to shed some lights on those tests errors.

First off, it appears some of those tests are not included in our 
Travis run…:( If anyone wants to check that list of tests and cross 
check with Travis, we could run them as well.


@miguel, looks like smoke/test_scale_vm is reporting errors. It 
seems you were the last one to touch that test. Could you try to run 
the tests on some cloudstack setup you have and report back to use 
your finding. From below you can see, the test seems to be failing 
on simulator/basic.


@boris, any chance you can run the tests listed under KVM/basic in 
your test environment ? I don’t know if you know how to use Marvin. 
You can check the Marvin scripts used in .travis.yml for a clue.


The NAT tests errors might be related to the “VPC” errors Wilder and 
Remi just solved, so we can see tomorrow what BVT says.


(pinging pdion and milamber in that email to see what they can do on 
spare cycles)


Thanks everyone, let’s knock those down.

-Sebastien

On Sep 29, 2015, at 2:49 PM, Raja Pullela  
wrote:


Hopefully the format of this email stays as I compose ?

Bugs to be fixed for BVTs:
a. https://issues.apache.org/jira/browse/CLOUDSTACK-8915
b. https://issues.apache.org/jira/browse/CLOUDSTACK-8697
c. https://issues.apache.org/jira/browse/CLOUDSTACK-8891 - Should 
be a blocker
d. https://issues.apache.org/jira/browse/CLOUDSTACK-8876 - Should 
be a blocker



BVT Passrate for 9/25:


* Simulator Basic - 97.6%,  Failed tests 1

* Simulator Adv - 100%

* XS Basic - 97.1%, Failed tests 2

* XS Adv - 94.3%, Failed tests 6

* KVM Basic - 94.2%, Failed tests 4

* KVM Adv - 92.6%, Failed tests 8

Test cases failed:

Simulator Basic

* 
integration.smoke.test_scale_vm.TestScaleVm.test_02_scale_vm_without_hypervisor_specifics 
(Failure: test case issue)



XS Basic

* 
integration.smoke.test_scale_vm.TestScaleVm.test_02_scale_vm_without_hypervisor_specifics 
(Failure: test case issue)


* integration.smoke.test_volumes.TestVolumes.test_02_attach_volume 
/Failure: SSH connection failed


XS Adv

* 
integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat 
(Failure: SSH connection failed)


* 
integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat 
(Failure: SSH connection failed)


* 
integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb 
(Failur

Re: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Sebastien Goasguen 

> On Sep 30, 2015, at 9:10 AM, Koushik Das  wrote:
> 
> Raja,
> The earlier scale vm test couldn't run on simulator because of the validation 
> steps (IIRC it tries to connect to the real VM created during test). Since it 
> wasn't possible to run with simulator, the new test was added to run just on 
> the simulator. Check the required_hardware tag.
> 

Ok so that’s not really a blocker. 

Can we reduce the severity to major ?
Or send a PR that will add this to the Travis run and run the correct test for 
simulator ?

Or make you modifications in your BVT settings, re-run and close the issue ?



> -Original Message-
> From: Raja Pullela [mailto:raja.pull...@citrix.com] 
> Sent: Wednesday, 30 September 2015 12:12
> To: CloudStack Dev (dev@cloudstack.apache.org)
> Subject: [Blocker] test duplicated in test_scale_vm.py
> 
> Hi,
> 
> Filed this blocker on test case "test_scale_vm.py"  - 
> https://issues.apache.org/jira/browse/CLOUDSTACK-8924
> Fixing this will bring Simulator Basic and XS Basic to 100% passrate.
> 
> Best,
> Raja
>

[GitHub] cloudstack pull request: CLOUDSTACK-89027 Restart Network fails in...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/898#issuecomment-144314489
  
In issues like this, we should track which automated test fails.
If no test can check for that, then we need to write one and submit it in 
the PR.

BTW: The PR header references the wrong JIRA ID


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8879: Depend in rados-java 0.2...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/889#issuecomment-144315290
  
LGTM, small change.
@wido what tests can be run to check for this.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: jenkins disk full ?

2015-09-30 Thread David Nalley 
The below is before I cleaned up a bit. We now have 3.2GB free.

[root@domU-12-31-39-15-22-2D jobs]# du -h -d 1
1.3G ./package-rhel63-master
200M ./cloudstack-4.3-maven-build-noredist
638M ./package-rhel63-4.5
1.1G ./cloudstack-4.4-systemvm64
1.3M ./build-4.5
8.0K ./cloudstack-master-with-patch
186M ./build-test-archive-4.4
2.9M ./test-smoke-matrix-master
100K ./Create-Release-Packages
1.5M ./test-packaging-4.4
214M ./build-test-archive-master
612K ./cloudstack.apt-get.eu-systemvm
88M ./built-test-archive
4.2M ./simulator-4.5-singlerun
424K ./test-tabnanny-4.4
2.2G ./build-master
124M ./cloudstack-4.4-systemvm
331M ./package-centos7-4.4.4-noredist
804K ./cloudstack-4.4-maven-build
3.4M ./cloudstack-4.3-maven-build
645M ./package-centos7-master
80M ./test-fetch-marvin-master
180M ./parameterized-slowbuild
508K ./cloudstack.apt-get.eu-noredis-rhel
104K ./dockerbuild-master-marvin
9.1M ./test-regression-matrix-master
345M ./cloudstack-4.3-package-deb
3.8G ./parameterized-sytemvm
26M ./HyperVAgent4.3
510M ./cloudstack-4.3-package-rpm
1.5M ./test-packaging-master
7.2M ./build-docs-admin-master
8.3M ./cloudstack-marvin-master
1013M ./cloudstack-4.3-systemvm
131M ./run-checkin-tests
2.5M ./simulator-gate
145M ./cloudstack-master-twiceweekly-coverity
3.2M ./cloudstack-4.4-hyperv-agent
104K ./test-setup-advancedzone-master
1.1G ./master-slowbuild
44M ./cloudstack-master
301M ./package-centos7-master-noredist
396K ./test-tabnanny-master
816K ./simulator-build
20K ./test-libcloud
236K ./test-smoke-matrix-4.3
4.9M ./dockerbuild-4.5-simulator
331M ./package-centos7-4.4-noredist
632K ./cloudstack.apt-get.eu-noredis-deb
144K ./dockerbuild-master-management_centos6
292M ./package-centos6-4.6
9.4M ./stop-jetty
326M ./cloudstack-4.4-package-rpm
40K ./mgmt-build-reviewboard-requests
20K ./build-test-centos-builtin
76K ./simulator-deploydb
20K ./Master - Python Static Code Analysis
53M ./test-smoke-matrix-4.4
442M ./build-master-slowbuild
376K ./build-docs-niciranvp-master
840K ./test-matrix-4.4
2.7M ./dockerbuild-master-simulator
21M ./build-docs-install-master
50M ./test-fetch-marvin-4.4
789M ./cloudstack-rpm-packages-with-branch-parameter
5.3G ./build-systemvm-4.5
1.1G ./cloudstack-4.3-systemvm64
3.2M ./build-docs-release-notes-master
8.0K ./cloudstack-master-codecoverage
121M ./fastsimulatorbuild
4.3M ./cloudstack-4.4-marvin
352M ./build-master-noredist
7.2M ./test-setup-advancedzone-4.4
3.3M ./cloudstack-master-hyperv-agent
1.9G ./build-systemvm64-master
29M ./start-jetty
3.4M ./simulator-4.4-integration-tests
264M ./build-4.5-noredist
2.0G ./package-deb-master
576K ./build-master-simulator
137M ./mgmt-update-nonoss-libs
11M ./test-matrix-extended-master
235M ./cloudstack-4.4-maven-build-noredist
5.3M ./simulator-hotfix-trigger
8.0K ./cloudstack-maven-build-with-branch-parameter
2.7M ./test-yumrepo-refresh-master
1.3G ./cloudstack-4.5-hyperv-agent
1.6M ./Build-by-Branch
3.5G ./build-systemvm-master
369M ./package-deb-4.6
172K ./test-maintenance-operations-4.4
48K ./cloudstack-4.3-package-rpm-noredist
532K ./build-docs-vxlan-master
18M ./build-docs-devguide-master
456K ./test-environment-refresh-master
876K ./test-matrix-master
2.1M ./test-yumrepo-refresh-4.4
51M ./test-environment-refresh-4.4
6.3M ./simulator-singlerun
724M ./package-deb-4.5
16M ./docs-4.3-gsoc-guide
384K ./test-matrix-extended-4.4
20K ./pull-requests
204K ./build-docs-midonet-master
358M ./cloudstack-4.4-package-deb
506M ./build-master-jdk18
2.3M ./cloudstack.apt-get.eu-noredis-centos7
499M ./package-centos7-4.6
119M ./build-4.5-simulator
12K ./cloudstack-4.2-systemvm_test
1.6M ./test-regression-matrix-4.4
144K ./build-systemvm64-master-with-debian8
12K ./cloudstack-4.2-systemvm
12K ./cloudstack-4.2-systemvm64
3.1M ./cloudstack-4.4-auto-marvin
334M ./package-rhel63-master-noredist
6.8M ./test-maintenance-operations-master
36G .

On Tue, Sep 29, 2015 at 9:04 AM, Pierre-Luc Dion  wrote:
> David, Do you think you could do another cleanup on  the master of j.bac.o ?
>
> Could you list the jobs that consume most of the spaces?
>
> Thanks,
>
>
> On Wed, Sep 23, 2015 at 12:22 AM, Rajani Karuturi
>  wrote:
>>
>> Hi David,
>> disk space issue again. Can you please do a little more cleanup?
>>
>>
>> http://jenkins.buildacloud.org/computer/coohq-slave-01/executors/0/causeOfDeath
>>
>> ~Rajani
>>
>>
>>
>> On 18-Sep-2015, at 11:59 pm, David Nalley  wrote:
>>
>> > I freed up a little bit of space, but we'll have to do something
>> > different in the long term.
>> >
>> > --David
>> >
>> > On Fri, Sep 18, 2015 at 7:37 AM, Pierre-Luc Dion 
>> > wrote:
>> >> Hi,
>> >>
>> >> Srikanteswararao (or any one having access to jenkins server), do you
>> >> think
>> >> you could do some more magic here?  We ran out of space again on the
>> >> master
>> >> jenkins server for  j.bac.o.
>> >>
>> >> Thanks,
>> >>
>> >> PL
>> >>
>> >> On Mon, Jun 1, 2015 at 4:26 PM, Pierre-Luc Dion 
>> >> wrote:
>> >>
>> >>> thanks  Srikanteswararao, it worked  and we have centos63 rpm now for
>> >>>

[GitHub] cloudstack pull request: Bug-ID: CLOUDSTACK-8880: calculate free m...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/847#issuecomment-144315690
  
Hi @kishankavala if you can answer @remibergsma and @borisroman questions, 
we can move forward with your PR.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: Bug-ID: CLOUDSTACK-8882: calculate networ...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/859#issuecomment-144316351
  
Hi @kishankavala can we run some simulator tests to check this ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: Cloudstack-8885 added blocked connection ...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/857#issuecomment-144317611
  
@remibergsma that one is tough to test as @karuturi mentions. so I am with 
@wido here +1 on code review. Small enough.
We need to think further on how to handle commits like this.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8888: Xenserver 6.0.2 host stu...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/861#issuecomment-144320963
  
@harikrishna-patnala and @koushik-das I agree with @remibergsma please 
advise on how you want to proceed, considering #883 reimplements the 602 
resource.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: CloudStack Ceph S3 Secondary Storage on KVM

2015-09-30 Thread Wido den Hollander 


On 09/30/2015 02:44 AM, ilya musayev wrote:
> Hi Wido,
> 
> Hope your day is going well.
> 
> Would you know if CloudStack Ceph S3 Secondary Storage on KVM requires
> NFS backing or can it be bypassed?
> 

Yes, it still requires a staging NFS secondary store.

Wido

> Thanks
> ilya
>

Re: BVT report 9/29

2015-09-30 Thread Miguel Ferreira 
Hi Sebastian,

On 29 Sep 2015, at 20:42, Sebastien Goasguen 
mailto:run...@gmail.com>> wrote:

@miguel, looks like smoke/test_scale_vm is reporting errors. It seems you were 
the last one to touch that test. Could you try to run the tests on some 
cloudstack setup you have and report back to use your finding. From below you 
can see, the test seems to be failing on simulator/basic.

It would be nice to have the output of the tests to troubleshoot...
Anyway, I’m going to build an environment to run the 
“integration.smoke.test_scale_vm.TestScaleVm.test_02_scale_vm_without_hypervisor_specifics”
 test.

From the list you sent I can see that the test is being ran against XS. That 
should not be a problem, however that test is a dumbed down, mean for simulator 
only, version of the other test in that same file. The other one is the one 
that actually tries to connect to the VM, and that’s the one that should be 
running against real hypervisors.
Have a look at the PR where that test was introduced if you want to have the 
full context. (https://github.com/apache/cloudstack/pull/741)

I’ll let you guys know if I can run the test or not, and what’s the output.


\ Miguel Ferreira
   mferre...@schubergphilis.com

[GitHub] cloudstack pull request: CLOUDSTACK-8879: Depend in rados-java 0.2...

2015-09-30 Thread wido 
Github user wido commented on the pull request:

https://github.com/apache/cloudstack/pull/889#issuecomment-144322421
  
@runseb No, not really. All my Unit tests are succeeding on rados-java 
itself. It should work as expected. But I have no in CloudStack test


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8893: Fixing script as per the...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/871#issuecomment-144322464
  
@pavanb018 it always helps other folks reviewing to know what you did. For 
example. 
Did you just check the Travis green light ? Did you just check the code 
through github ? Did you pull the patch, apply and compile ? Did you do the 
build then run the tests. It may sound obvious to you what you did by giving 
the copy paste form a test, but writing a small friendly sentence for the next 
reviewer will go a long way to help us merge those fixes as a group.

thanks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

RE: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Raja Pullela 
Sebastien, any BVT tests failing is a blocker and needs to be fixed - which is 
the reason for Blocker.  We already have a fix.   

Koushik, 

modified the test "test_01_scale_vm" with required_hardware=false on simulator 
setup and it works.  So, I think we can let the second method go.  I will also 
test this on XS.
Raja


root@localhost:~/cloudstack# nosetests --with-marvin 
--marvin-config=/root/cloudstack/setup/dev/local1.cfg --zone=Sandbox-simulator 
--hypervisor=simulator -a tags=basic,required_hardware=false 
/root/cloudstack/test/integration/smoke/test_scale_vm.py

 Marvin Init Started 

=== Marvin Parse Config Successful ===

=== Marvin Setting TestData Successful===

 Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_06_32_AWNF1O. All logs 
will be available here 

=== Marvin Init Logging Successful===

 Marvin Init Successful 
===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_OPS7AD===
root@localhost:~/cloudstack# cd /tmp//MarvinLogs/test_scale_vm_OPS7AD
root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls
failed_plus_exceptions.txt  results.txt  runinfo.txt
root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# vi  results.txt
root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls -al
total 48
drwxr-xr-x 2 root root  4096 Sep 30 08:07 .
drwxr-xr-x 8 root root  4096 Sep 30 08:06 ..
-rw-r--r-- 1 root root 0 Sep 30 08:06 failed_plus_exceptions.txt
-rw-r--r-- 1 root root   186 Sep 30 08:06 results.txt
-rw-r--r-- 1 root root 36164 Sep 30 08:06 runinfo.txt
root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD#
root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# cat results.txt
Test scale virtual machine ... === TestName: test_01_scale_vm | Status : 
SUCCESS ===
ok

--
Ran 1 test in 23.455s

OK

-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: Wednesday, September 30, 2015 1:04 PM
To: dev@cloudstack.apache.org
Subject: Re: [Blocker] test duplicated in test_scale_vm.py


> On Sep 30, 2015, at 9:10 AM, Koushik Das  wrote:
> 
> Raja,
> The earlier scale vm test couldn't run on simulator because of the validation 
> steps (IIRC it tries to connect to the real VM created during test). Since it 
> wasn't possible to run with simulator, the new test was added to run just on 
> the simulator. Check the required_hardware tag.
> 

Ok so that’s not really a blocker. 

Can we reduce the severity to major ?
Or send a PR that will add this to the Travis run and run the correct test for 
simulator ?

Or make you modifications in your BVT settings, re-run and close the issue ?



> -Original Message-
> From: Raja Pullela [mailto:raja.pull...@citrix.com] 
> Sent: Wednesday, 30 September 2015 12:12
> To: CloudStack Dev (dev@cloudstack.apache.org)
> Subject: [Blocker] test duplicated in test_scale_vm.py
> 
> Hi,
> 
> Filed this blocker on test case "test_scale_vm.py"  - 
> https://issues.apache.org/jira/browse/CLOUDSTACK-8924
> Fixing this will bring Simulator Basic and XS Basic to 100% passrate.
> 
> Best,
> Raja
>

[GitHub] cloudstack pull request: CLOUDSTACK-8894: Restrict vGPU enabled VM...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/868#issuecomment-144322859
  
@anshul1886 Can you add a bit of a description here.
Is that fixing a bug, is that a new feature ? Can you add Travis tests to 
check this ?
many thanks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

RE: BVT report 9/29

2015-09-30 Thread Raja Pullela 
Miguel, please see the defect 
https://issues.apache.org/jira/browse/CLOUDSTACK-8924
Let me know if you have any questions,
Raja

-Original Message-
From: Miguel Ferreira [mailto:mferre...@schubergphilis.com] 
Sent: Wednesday, September 30, 2015 1:43 PM
To: Sebastien Goasguen 
Cc: dev ; Boris Schrijver ; 
Pierre-Luc Dion ; Milamber 
Subject: Re: BVT report 9/29

Hi Sebastian,

On 29 Sep 2015, at 20:42, Sebastien Goasguen 
mailto:run...@gmail.com>> wrote:

@miguel, looks like smoke/test_scale_vm is reporting errors. It seems you were 
the last one to touch that test. Could you try to run the tests on some 
cloudstack setup you have and report back to use your finding. From below you 
can see, the test seems to be failing on simulator/basic.

It would be nice to have the output of the tests to troubleshoot...
Anyway, I’m going to build an environment to run the 
“integration.smoke.test_scale_vm.TestScaleVm.test_02_scale_vm_without_hypervisor_specifics”
 test.

From the list you sent I can see that the test is being ran against XS. That 
should not be a problem, however that test is a dumbed down, mean for simulator 
only, version of the other test in that same file. The other one is the one 
that actually tries to connect to the VM, and that’s the one that should be 
running against real hypervisors.
Have a look at the PR where that test was introduced if you want to have the 
full context. (https://github.com/apache/cloudstack/pull/741)

I’ll let you guys know if I can run the test or not, and what’s the output.


\ Miguel Ferreira
   mferre...@schubergphilis.com

Re: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Sebastien Goasguen 

> On Sep 30, 2015, at 10:15 AM, Raja Pullela  wrote:
> 
> Sebastien, any BVT tests failing is a blocker and needs to be fixed - which 
> is the reason for Blocker.  We already have a fix.   
> 

Right, but that’s a fix in the test itself, no an issue with the cloudstack 
“core”.

In any case, great, one less blocker. 

> Koushik, 
> 
> modified the test "test_01_scale_vm" with required_hardware=false on 
> simulator setup and it works.  So, I think we can let the second method go.  
> I will also test this on XS.
> Raja
> 
> 
> root@localhost:~/cloudstack# nosetests --with-marvin 
> --marvin-config=/root/cloudstack/setup/dev/local1.cfg 
> --zone=Sandbox-simulator --hypervisor=simulator -a 
> tags=basic,required_hardware=false 
> /root/cloudstack/test/integration/smoke/test_scale_vm.py
> 
>  Marvin Init Started 
> 
> === Marvin Parse Config Successful ===
> 
> === Marvin Setting TestData Successful===
> 
>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_06_32_AWNF1O. All logs 
> will be available here 
> 
> === Marvin Init Logging Successful===
> 
>  Marvin Init Successful 
> ===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_OPS7AD===
> root@localhost:~/cloudstack# cd /tmp//MarvinLogs/test_scale_vm_OPS7AD
> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls
> failed_plus_exceptions.txt  results.txt  runinfo.txt
> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# vi  results.txt
> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls -al
> total 48
> drwxr-xr-x 2 root root  4096 Sep 30 08:07 .
> drwxr-xr-x 8 root root  4096 Sep 30 08:06 ..
> -rw-r--r-- 1 root root 0 Sep 30 08:06 failed_plus_exceptions.txt
> -rw-r--r-- 1 root root   186 Sep 30 08:06 results.txt
> -rw-r--r-- 1 root root 36164 Sep 30 08:06 runinfo.txt
> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD#
> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# cat results.txt
> Test scale virtual machine ... === TestName: test_01_scale_vm | Status : 
> SUCCESS ===
> ok
> 
> --
> Ran 1 test in 23.455s
> 
> OK
> 
> -Original Message-
> From: Sebastien Goasguen [mailto:run...@gmail.com] 
> Sent: Wednesday, September 30, 2015 1:04 PM
> To: dev@cloudstack.apache.org
> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> 
> 
>> On Sep 30, 2015, at 9:10 AM, Koushik Das  wrote:
>> 
>> Raja,
>> The earlier scale vm test couldn't run on simulator because of the 
>> validation steps (IIRC it tries to connect to the real VM created during 
>> test). Since it wasn't possible to run with simulator, the new test was 
>> added to run just on the simulator. Check the required_hardware tag.
>> 
> 
> Ok so that’s not really a blocker. 
> 
> Can we reduce the severity to major ?
> Or send a PR that will add this to the Travis run and run the correct test 
> for simulator ?
> 
> Or make you modifications in your BVT settings, re-run and close the issue ?
> 
> 
> 
>> -Original Message-
>> From: Raja Pullela [mailto:raja.pull...@citrix.com] 
>> Sent: Wednesday, 30 September 2015 12:12
>> To: CloudStack Dev (dev@cloudstack.apache.org)
>> Subject: [Blocker] test duplicated in test_scale_vm.py
>> 
>> Hi,
>> 
>> Filed this blocker on test case "test_scale_vm.py"  - 
>> https://issues.apache.org/jira/browse/CLOUDSTACK-8924
>> Fixing this will bring Simulator Basic and XS Basic to 100% passrate.
>> 
>> Best,
>> Raja
>> 
>

Build failed in Jenkins: build-master-jdk18 #358

2015-09-30 Thread jenkins 
See 

Changes:

[pavanbandarupally] Automation for multiple disk attachments to instance

[pavanbandarupally] Imparting changes mentioned by nitt10prashant

[pavanbandarupally] changed the testcase skip code into setup method

[jayapal] CLOUDSTACK-8843: Fixed issue in default iptables rules on shared 
network VR

[Boris Schrijver] Added findByPodId(Long podId) to HostDao and HostDaoImpl.

[Boris Schrijver] Refactored checkIfPodIsDeletable().

[Boris Schrijver] Added countIPs(long dcId, boolean onlyCountAllocated) to 
DataCenterIpAddressDao and DataCenterIpAddressDaoImpl.

[Boris Schrijver] Added countIPs(long dcId, boolean onlyCountAllocated) to 
IPAddressDao and IPAddressDaoImpl.

[Boris Schrijver] Added findByDc(long dcId) to VolumeDao and VolumeDaoImpl.

[Boris Schrijver] Refactored checkIfZoneIsDeletable().

[sudharma.jain] CLOUDSTACK-8863: VM doesn't reconnect to internet post VR 
RESTART/STOP-START/RECREATE

[Boris Schrijver] Updated Dao classes with correct field names.

[Boris Schrijver] Added unit tests for checkIfPodIsDeletable() and 
checkIfZoneIsDeletable().

[sudharma.jain] CLOUDSTACK-8864: Not able to add TCP port forwarding rule in 
VPN for specific ports

[Boris Schrijver] Call cleanUp() before looping isStartup().

[Boris Schrijver] Added return statement to stop start() if there has been an 
ConnectException.

[jayapal] Configured dnsmasq to listen on all interfaces so that vpn  client 
gets dns

[pdube] Fixed box location on vagrant files

[sanjeev] CLOUDSTACK-8893: Fixing script as per the latest functionality

[sanjeev] Modified test description

[Boris Schrijver] Added isEmpty() check to prevent nullPointerException.

[pdube] Added fix to binary installation vagrant files (CLOUDSTACK-8898)

[jayapal] CLOUDSTACK-8891: Fixed default iptables rules on VR  for guest traffic

[jayapal] CLOUDSTACK-8905: Fixed hooking egress rules

[jayapal] CLOUDSTACK-8881: Fixed Static and PF configuration issue

[wido] Use java.io.tmpdir instead of hardcoded /tmp

[github] Revert "Merge pull request #884 from wido/test-tmp-dir"

[wrodrigues] Formatting the router_proxy.sh script

[wrodrigues] Fixing the dhcpsrvr iptables file

[wrodrigues] Formatting the get_gateway() method in the CsDatabag.py file

[github] Fixing the defaut route for VPC routers

[github] small cleanups

[github] Fixing the index out of bounds error in the check_if_link_up() function

--
[...truncated 568 lines...]
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.071 sec - in 
com.cloud.utils.UuidUtilsTest
Running com.cloud.utils.crypto.RSAHelperTest
2015-09-30 08:19:22,753 INFO  [utils.crypt.RSAHelper] (main:) [ignored]error 
during public key encryption: Unsupported format
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.94 sec - in 
com.cloud.utils.crypto.RSAHelperTest
Running com.cloud.utils.crypto.EncryptionSecretKeyCheckerTest
2015-09-30 08:19:22,907 DEBUG [utils.crypt.EncryptionSecretKeyChecker] (main:) 
Encryption Type: null
2015-09-30 08:19:22,908 DEBUG [utils.crypt.EncryptionSecretKeyChecker] (main:) 
Encryption Type: file
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.046 sec - in 
com.cloud.utils.crypto.EncryptionSecretKeyCheckerTest
Running com.cloud.utils.PropertiesUtilsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.038 sec - in 
com.cloud.utils.PropertiesUtilsTest
Running com.cloud.utils.exception.ExceptionUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
com.cloud.utils.exception.ExceptionUtilTest
Running com.cloud.utils.storage.QCOW2UtilsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
com.cloud.utils.storage.QCOW2UtilsTest
Running com.cloud.utils.encoding.UrlEncoderTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
com.cloud.utils.encoding.UrlEncoderTest
Running com.cloud.utils.UriUtilsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec - in 
com.cloud.utils.UriUtilsTest
Running com.cloud.utils.HttpUtilsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec - in 
com.cloud.utils.HttpUtilsTest
Running com.cloud.utils.backoff.impl.ConstantTimeBackoffTest
2015-09-30 08:19:23,199 INFO  [backoff.impl.ConstantTimeBackoff] (Thread-1:) 
Thread Thread-1 interrupted while waiting for retry
2015-09-30 08:19:23,303 DEBUG [backoff.impl.ConstantTimeBackoffTest] (main:) 
thread started
2015-09-30 08:19:23,303 DEBUG [backoff.impl.ConstantTimeBackoffTest] 
(Thread-2:) before
2015-09-30 08:19:23,405 DEBUG [backoff.impl.ConstantTimeBackoffTest] (main:) 
testing wakeup
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.33 sec - in 
com.cloud.utils.backoff.impl.ConstantTimeBackoffTest
Running com.cloud.utils.ProcessUtilTest
2015-09-30 08:19:23,405 INFO  [backoff.impl.ConstantTimeBackoff] (Thread-2:

Re: jenkins disk full ?

2015-09-30 Thread Rajani Karuturi 
Thanks david. Do you know if anyone else has access to this? if not, can you 
give access to PL please?

~Rajani



On 30-Sep-2015, at 1:13 pm, David Nalley  wrote:

> The below is before I cleaned up a bit. We now have 3.2GB free.
> 
> [root@domU-12-31-39-15-22-2D jobs]# du -h -d 1
> 1.3G ./package-rhel63-master
> 200M ./cloudstack-4.3-maven-build-noredist
> 638M ./package-rhel63-4.5
> 1.1G ./cloudstack-4.4-systemvm64
> 1.3M ./build-4.5
> 8.0K ./cloudstack-master-with-patch
> 186M ./build-test-archive-4.4
> 2.9M ./test-smoke-matrix-master
> 100K ./Create-Release-Packages
> 1.5M ./test-packaging-4.4
> 214M ./build-test-archive-master
> 612K ./cloudstack.apt-get.eu-systemvm
> 88M ./built-test-archive
> 4.2M ./simulator-4.5-singlerun
> 424K ./test-tabnanny-4.4
> 2.2G ./build-master
> 124M ./cloudstack-4.4-systemvm
> 331M ./package-centos7-4.4.4-noredist
> 804K ./cloudstack-4.4-maven-build
> 3.4M ./cloudstack-4.3-maven-build
> 645M ./package-centos7-master
> 80M ./test-fetch-marvin-master
> 180M ./parameterized-slowbuild
> 508K ./cloudstack.apt-get.eu-noredis-rhel
> 104K ./dockerbuild-master-marvin
> 9.1M ./test-regression-matrix-master
> 345M ./cloudstack-4.3-package-deb
> 3.8G ./parameterized-sytemvm
> 26M ./HyperVAgent4.3
> 510M ./cloudstack-4.3-package-rpm
> 1.5M ./test-packaging-master
> 7.2M ./build-docs-admin-master
> 8.3M ./cloudstack-marvin-master
> 1013M ./cloudstack-4.3-systemvm
> 131M ./run-checkin-tests
> 2.5M ./simulator-gate
> 145M ./cloudstack-master-twiceweekly-coverity
> 3.2M ./cloudstack-4.4-hyperv-agent
> 104K ./test-setup-advancedzone-master
> 1.1G ./master-slowbuild
> 44M ./cloudstack-master
> 301M ./package-centos7-master-noredist
> 396K ./test-tabnanny-master
> 816K ./simulator-build
> 20K ./test-libcloud
> 236K ./test-smoke-matrix-4.3
> 4.9M ./dockerbuild-4.5-simulator
> 331M ./package-centos7-4.4-noredist
> 632K ./cloudstack.apt-get.eu-noredis-deb
> 144K ./dockerbuild-master-management_centos6
> 292M ./package-centos6-4.6
> 9.4M ./stop-jetty
> 326M ./cloudstack-4.4-package-rpm
> 40K ./mgmt-build-reviewboard-requests
> 20K ./build-test-centos-builtin
> 76K ./simulator-deploydb
> 20K ./Master - Python Static Code Analysis
> 53M ./test-smoke-matrix-4.4
> 442M ./build-master-slowbuild
> 376K ./build-docs-niciranvp-master
> 840K ./test-matrix-4.4
> 2.7M ./dockerbuild-master-simulator
> 21M ./build-docs-install-master
> 50M ./test-fetch-marvin-4.4
> 789M ./cloudstack-rpm-packages-with-branch-parameter
> 5.3G ./build-systemvm-4.5
> 1.1G ./cloudstack-4.3-systemvm64
> 3.2M ./build-docs-release-notes-master
> 8.0K ./cloudstack-master-codecoverage
> 121M ./fastsimulatorbuild
> 4.3M ./cloudstack-4.4-marvin
> 352M ./build-master-noredist
> 7.2M ./test-setup-advancedzone-4.4
> 3.3M ./cloudstack-master-hyperv-agent
> 1.9G ./build-systemvm64-master
> 29M ./start-jetty
> 3.4M ./simulator-4.4-integration-tests
> 264M ./build-4.5-noredist
> 2.0G ./package-deb-master
> 576K ./build-master-simulator
> 137M ./mgmt-update-nonoss-libs
> 11M ./test-matrix-extended-master
> 235M ./cloudstack-4.4-maven-build-noredist
> 5.3M ./simulator-hotfix-trigger
> 8.0K ./cloudstack-maven-build-with-branch-parameter
> 2.7M ./test-yumrepo-refresh-master
> 1.3G ./cloudstack-4.5-hyperv-agent
> 1.6M ./Build-by-Branch
> 3.5G ./build-systemvm-master
> 369M ./package-deb-4.6
> 172K ./test-maintenance-operations-4.4
> 48K ./cloudstack-4.3-package-rpm-noredist
> 532K ./build-docs-vxlan-master
> 18M ./build-docs-devguide-master
> 456K ./test-environment-refresh-master
> 876K ./test-matrix-master
> 2.1M ./test-yumrepo-refresh-4.4
> 51M ./test-environment-refresh-4.4
> 6.3M ./simulator-singlerun
> 724M ./package-deb-4.5
> 16M ./docs-4.3-gsoc-guide
> 384K ./test-matrix-extended-4.4
> 20K ./pull-requests
> 204K ./build-docs-midonet-master
> 358M ./cloudstack-4.4-package-deb
> 506M ./build-master-jdk18
> 2.3M ./cloudstack.apt-get.eu-noredis-centos7
> 499M ./package-centos7-4.6
> 119M ./build-4.5-simulator
> 12K ./cloudstack-4.2-systemvm_test
> 1.6M ./test-regression-matrix-4.4
> 144K ./build-systemvm64-master-with-debian8
> 12K ./cloudstack-4.2-systemvm
> 12K ./cloudstack-4.2-systemvm64
> 3.1M ./cloudstack-4.4-auto-marvin
> 334M ./package-rhel63-master-noredist
> 6.8M ./test-maintenance-operations-master
> 36G .
> 
> On Tue, Sep 29, 2015 at 9:04 AM, Pierre-Luc Dion  wrote:
>> David, Do you think you could do another cleanup on  the master of j.bac.o ?
>> 
>> Could you list the jobs that consume most of the spaces?
>> 
>> Thanks,
>> 
>> 
>> On Wed, Sep 23, 2015 at 12:22 AM, Rajani Karuturi
>>  wrote:
>>> 
>>> Hi David,
>>> disk space issue again. Can you please do a little more cleanup?
>>> 
>>> 
>>> http://jenkins.buildacloud.org/computer/coohq-slave-01/executors/0/causeOfDeath
>>> 
>>> ~Rajani
>>> 
>>> 
>>> 
>>> On 18-Sep-2015, at 11:59 pm, David Nalley  wrote:
>>> 
 I freed up a little bit of space, but we'll have to do something
 different in the long term.
 
 --David
 
 On Fri, Sep 18, 2015 at 7:37 AM, Pierre-

RE: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Raja Pullela 
Yup... btw, I am on top of this and goal is to get to 100% passrate on BVTs!  

-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: Wednesday, September 30, 2015 1:48 PM
To: dev@cloudstack.apache.org
Subject: Re: [Blocker] test duplicated in test_scale_vm.py


> On Sep 30, 2015, at 10:15 AM, Raja Pullela  wrote:
> 
> Sebastien, any BVT tests failing is a blocker and needs to be fixed - which 
> is the reason for Blocker.  We already have a fix.   
> 

Right, but that’s a fix in the test itself, no an issue with the cloudstack 
“core”.

In any case, great, one less blocker. 

> Koushik,
> 
> modified the test "test_01_scale_vm" with required_hardware=false on 
> simulator setup and it works.  So, I think we can let the second method go.  
> I will also test this on XS.
> Raja
> 
> 
> root@localhost:~/cloudstack# nosetests --with-marvin 
> --marvin-config=/root/cloudstack/setup/dev/local1.cfg 
> --zone=Sandbox-simulator --hypervisor=simulator -a 
> tags=basic,required_hardware=false 
> /root/cloudstack/test/integration/smoke/test_scale_vm.py
> 
>  Marvin Init Started 
> 
> === Marvin Parse Config Successful ===
> 
> === Marvin Setting TestData Successful===
> 
>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_06_32_AWNF1O. 
> All logs will be available here 
> 
> === Marvin Init Logging Successful===
> 
>  Marvin Init Successful 
> ===final results are now copied to: 
> /tmp//MarvinLogs/test_scale_vm_OPS7AD===
> root@localhost:~/cloudstack# cd /tmp//MarvinLogs/test_scale_vm_OPS7AD
> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls 
> failed_plus_exceptions.txt  results.txt  runinfo.txt 
> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# vi  results.txt 
> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls -al total 48 
> drwxr-xr-x 2 root root  4096 Sep 30 08:07 .
> drwxr-xr-x 8 root root  4096 Sep 30 08:06 ..
> -rw-r--r-- 1 root root 0 Sep 30 08:06 failed_plus_exceptions.txt
> -rw-r--r-- 1 root root   186 Sep 30 08:06 results.txt
> -rw-r--r-- 1 root root 36164 Sep 30 08:06 runinfo.txt 
> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD#
> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# cat results.txt 
> Test scale virtual machine ... === TestName: test_01_scale_vm | Status 
> : SUCCESS === ok
> 
> --
> Ran 1 test in 23.455s
> 
> OK
> 
> -Original Message-
> From: Sebastien Goasguen [mailto:run...@gmail.com]
> Sent: Wednesday, September 30, 2015 1:04 PM
> To: dev@cloudstack.apache.org
> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> 
> 
>> On Sep 30, 2015, at 9:10 AM, Koushik Das  wrote:
>> 
>> Raja,
>> The earlier scale vm test couldn't run on simulator because of the 
>> validation steps (IIRC it tries to connect to the real VM created during 
>> test). Since it wasn't possible to run with simulator, the new test was 
>> added to run just on the simulator. Check the required_hardware tag.
>> 
> 
> Ok so that’s not really a blocker. 
> 
> Can we reduce the severity to major ?
> Or send a PR that will add this to the Travis run and run the correct test 
> for simulator ?
> 
> Or make you modifications in your BVT settings, re-run and close the issue ?
> 
> 
> 
>> -Original Message-
>> From: Raja Pullela [mailto:raja.pull...@citrix.com]
>> Sent: Wednesday, 30 September 2015 12:12
>> To: CloudStack Dev (dev@cloudstack.apache.org)
>> Subject: [Blocker] test duplicated in test_scale_vm.py
>> 
>> Hi,
>> 
>> Filed this blocker on test case "test_scale_vm.py"  - 
>> https://issues.apache.org/jira/browse/CLOUDSTACK-8924
>> Fixing this will bring Simulator Basic and XS Basic to 100% passrate.
>> 
>> Best,
>> Raja
>> 
>

RE: jenkins disk full ?

2015-09-30 Thread Raja Pullela 
Yes, please give access to PL or couple of other folks - Rajani or other PMC 
members?

-Original Message-
From: Rajani Karuturi [mailto:rajani.karut...@citrix.com] 
Sent: Wednesday, September 30, 2015 1:51 PM
To: dev@cloudstack.apache.org
Cc: Pierre-Luc Dion ; tall...@apache.org
Subject: Re: jenkins disk full ?

Thanks david. Do you know if anyone else has access to this? if not, can you 
give access to PL please?

~Rajani



On 30-Sep-2015, at 1:13 pm, David Nalley  wrote:

> The below is before I cleaned up a bit. We now have 3.2GB free.
> 
> [root@domU-12-31-39-15-22-2D jobs]# du -h -d 1 1.3G 
> ./package-rhel63-master 200M ./cloudstack-4.3-maven-build-noredist
> 638M ./package-rhel63-4.5
> 1.1G ./cloudstack-4.4-systemvm64
> 1.3M ./build-4.5
> 8.0K ./cloudstack-master-with-patch
> 186M ./build-test-archive-4.4
> 2.9M ./test-smoke-matrix-master
> 100K ./Create-Release-Packages
> 1.5M ./test-packaging-4.4
> 214M ./build-test-archive-master
> 612K ./cloudstack.apt-get.eu-systemvm
> 88M ./built-test-archive
> 4.2M ./simulator-4.5-singlerun
> 424K ./test-tabnanny-4.4
> 2.2G ./build-master
> 124M ./cloudstack-4.4-systemvm
> 331M ./package-centos7-4.4.4-noredist
> 804K ./cloudstack-4.4-maven-build
> 3.4M ./cloudstack-4.3-maven-build
> 645M ./package-centos7-master
> 80M ./test-fetch-marvin-master
> 180M ./parameterized-slowbuild
> 508K ./cloudstack.apt-get.eu-noredis-rhel
> 104K ./dockerbuild-master-marvin
> 9.1M ./test-regression-matrix-master
> 345M ./cloudstack-4.3-package-deb
> 3.8G ./parameterized-sytemvm
> 26M ./HyperVAgent4.3
> 510M ./cloudstack-4.3-package-rpm
> 1.5M ./test-packaging-master
> 7.2M ./build-docs-admin-master
> 8.3M ./cloudstack-marvin-master
> 1013M ./cloudstack-4.3-systemvm
> 131M ./run-checkin-tests
> 2.5M ./simulator-gate
> 145M ./cloudstack-master-twiceweekly-coverity
> 3.2M ./cloudstack-4.4-hyperv-agent
> 104K ./test-setup-advancedzone-master
> 1.1G ./master-slowbuild
> 44M ./cloudstack-master
> 301M ./package-centos7-master-noredist 396K ./test-tabnanny-master 
> 816K ./simulator-build 20K ./test-libcloud 236K 
> ./test-smoke-matrix-4.3 4.9M ./dockerbuild-4.5-simulator 331M 
> ./package-centos7-4.4-noredist 632K 
> ./cloudstack.apt-get.eu-noredis-deb
> 144K ./dockerbuild-master-management_centos6
> 292M ./package-centos6-4.6
> 9.4M ./stop-jetty
> 326M ./cloudstack-4.4-package-rpm
> 40K ./mgmt-build-reviewboard-requests
> 20K ./build-test-centos-builtin
> 76K ./simulator-deploydb
> 20K ./Master - Python Static Code Analysis 53M ./test-smoke-matrix-4.4 
> 442M ./build-master-slowbuild 376K ./build-docs-niciranvp-master 840K 
> ./test-matrix-4.4 2.7M ./dockerbuild-master-simulator 21M 
> ./build-docs-install-master 50M ./test-fetch-marvin-4.4 789M 
> ./cloudstack-rpm-packages-with-branch-parameter
> 5.3G ./build-systemvm-4.5
> 1.1G ./cloudstack-4.3-systemvm64
> 3.2M ./build-docs-release-notes-master 8.0K 
> ./cloudstack-master-codecoverage 121M ./fastsimulatorbuild 4.3M 
> ./cloudstack-4.4-marvin 352M ./build-master-noredist 7.2M 
> ./test-setup-advancedzone-4.4 3.3M ./cloudstack-master-hyperv-agent 
> 1.9G ./build-systemvm64-master 29M ./start-jetty 3.4M 
> ./simulator-4.4-integration-tests 264M ./build-4.5-noredist 2.0G 
> ./package-deb-master 576K ./build-master-simulator 137M 
> ./mgmt-update-nonoss-libs 11M ./test-matrix-extended-master 235M 
> ./cloudstack-4.4-maven-build-noredist
> 5.3M ./simulator-hotfix-trigger
> 8.0K ./cloudstack-maven-build-with-branch-parameter
> 2.7M ./test-yumrepo-refresh-master
> 1.3G ./cloudstack-4.5-hyperv-agent
> 1.6M ./Build-by-Branch
> 3.5G ./build-systemvm-master
> 369M ./package-deb-4.6
> 172K ./test-maintenance-operations-4.4 48K 
> ./cloudstack-4.3-package-rpm-noredist
> 532K ./build-docs-vxlan-master
> 18M ./build-docs-devguide-master
> 456K ./test-environment-refresh-master 876K ./test-matrix-master 2.1M 
> ./test-yumrepo-refresh-4.4 51M ./test-environment-refresh-4.4 6.3M 
> ./simulator-singlerun 724M ./package-deb-4.5 16M ./docs-4.3-gsoc-guide 
> 384K ./test-matrix-extended-4.4 20K ./pull-requests 204K 
> ./build-docs-midonet-master 358M ./cloudstack-4.4-package-deb 506M 
> ./build-master-jdk18 2.3M ./cloudstack.apt-get.eu-noredis-centos7
> 499M ./package-centos7-4.6
> 119M ./build-4.5-simulator
> 12K ./cloudstack-4.2-systemvm_test
> 1.6M ./test-regression-matrix-4.4
> 144K ./build-systemvm64-master-with-debian8
> 12K ./cloudstack-4.2-systemvm
> 12K ./cloudstack-4.2-systemvm64
> 3.1M ./cloudstack-4.4-auto-marvin
> 334M ./package-rhel63-master-noredist
> 6.8M ./test-maintenance-operations-master
> 36G .
> 
> On Tue, Sep 29, 2015 at 9:04 AM, Pierre-Luc Dion  wrote:
>> David, Do you think you could do another cleanup on  the master of j.bac.o ?
>> 
>> Could you list the jobs that consume most of the spaces?
>> 
>> Thanks,
>> 
>> 
>> On Wed, Sep 23, 2015 at 12:22 AM, Rajani Karuturi 
>>  wrote:
>>> 
>>> Hi David,
>>> disk space issue again. Can you please do a little more cleanup?
>>> 
>>> 
>>> http://jenkins.buildacloud.org/computer/c

Build failed in Jenkins: build-4.5 #531

2015-09-30 Thread jenkins 
See 

Changes:

[Pierre-Luc Dion] Fix dockerbuild because hardcoded filename for marvin

--
[...truncated 3296 lines...]
[INFO] Compiling 44 source files to 

Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.275 sec

Results :

Tests run: 35, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Plugin - Stratosphere SSP 4.5.3-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ 
cloud-plugin-network-ssp ---
[INFO] Deleting 

 (includes = [**/*], excludes = [])
[INFO] Deleting 

 (includes = [target, dist], excludes = [])
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-plugin-network-ssp ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-plugin-network-ssp ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
cloud-plugin-network-ssp ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ 
cloud-plugin-network-ssp ---
[INFO] Compiling 17 source files to 

Build timed out (after 12 minutes). Marking the build as failed.
Build was aborted
Recording test results
[INFO] 
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ 
cloud-plugin-network-nvp ---
[INFO] Surefire report directory: 


---
 T E S T S
---
[INFO] 
[INFO] 
[INFO] Skipping Apache CloudStack Plugin - Network Opendaylight
[INFO] This project has been banned from the build due to previous failures.
[INFO] 
[INFO] 
[INFO] 
[INFO] Skipping Apache CloudStack Plugin - User Authenticator LDAP
[INFO] This project has been banned from the build due to previous failures.
[INFO] 
[INFO] 
[INFO] 
[INFO] Skipping Apache CloudStack Plugin - User Authenticator MD5
[INFO] This project has been banned from the build due to previous failures.
[INFO] 
[INFO] 
[INFO] 
[INFO] Skipping Apache CloudStack Plugin - User Authenticator PBKDF2-SHA-256
[INFO] This project has been banned from the build due to previous failures.
[INFO] 
[INFO] 
[INFO] 
[INFO] Skipping Apache CloudStack Plugin - User Authenticator Plain Text
[INFO] This project has been banned from the build due to previous failures.
[INFO] 
[INFO] 
[INFO] 
[INFO] Skipping Apache CloudStack Plugin - User Authenticator SAML2
[INFO] This project has been banned from the build due to previous failures.
[INFO] 
[INFO] 
[INFO] 
[INFO] Skipping Apache CloudStack Plugin - User Authenticator SHA256 Salted
[INFO] This

Re: jenkins disk full ?

2015-09-30 Thread David Nalley 
Right now these folks have access:

ewanm:x:1002:1002::/home/ewanm:/bin/bash
prasanna:x:1003:1003::/home/prasanna:/bin/bash
salvatore:x:1004:1004::/home/salvatore:/bin/bash
edison:x:1005:1005::/home/edison:/bin/bash
pradeep:x:1006:1006::/home/pradeep:/bin/bash
rayeesn:x:1007:1007::/home/rayeesn:/bin/bash
hugot:x:1008:1008::/home/hugot:/bin/bash
talluri:x:1009:1009::/home/talluri:/bin/bash
dahn:x:1010:1010::/home/dahn:/bin/bash

PL or other folks who want access, send me a ssh pub key off list.

--David

On Wed, Sep 30, 2015 at 4:20 AM, Rajani Karuturi
 wrote:
> Thanks david. Do you know if anyone else has access to this? if not, can you 
> give access to PL please?
>
> ~Rajani
>
>
>
> On 30-Sep-2015, at 1:13 pm, David Nalley  wrote:
>
>> The below is before I cleaned up a bit. We now have 3.2GB free.
>>
>> [root@domU-12-31-39-15-22-2D jobs]# du -h -d 1
>> 1.3G ./package-rhel63-master
>> 200M ./cloudstack-4.3-maven-build-noredist
>> 638M ./package-rhel63-4.5
>> 1.1G ./cloudstack-4.4-systemvm64
>> 1.3M ./build-4.5
>> 8.0K ./cloudstack-master-with-patch
>> 186M ./build-test-archive-4.4
>> 2.9M ./test-smoke-matrix-master
>> 100K ./Create-Release-Packages
>> 1.5M ./test-packaging-4.4
>> 214M ./build-test-archive-master
>> 612K ./cloudstack.apt-get.eu-systemvm
>> 88M ./built-test-archive
>> 4.2M ./simulator-4.5-singlerun
>> 424K ./test-tabnanny-4.4
>> 2.2G ./build-master
>> 124M ./cloudstack-4.4-systemvm
>> 331M ./package-centos7-4.4.4-noredist
>> 804K ./cloudstack-4.4-maven-build
>> 3.4M ./cloudstack-4.3-maven-build
>> 645M ./package-centos7-master
>> 80M ./test-fetch-marvin-master
>> 180M ./parameterized-slowbuild
>> 508K ./cloudstack.apt-get.eu-noredis-rhel
>> 104K ./dockerbuild-master-marvin
>> 9.1M ./test-regression-matrix-master
>> 345M ./cloudstack-4.3-package-deb
>> 3.8G ./parameterized-sytemvm
>> 26M ./HyperVAgent4.3
>> 510M ./cloudstack-4.3-package-rpm
>> 1.5M ./test-packaging-master
>> 7.2M ./build-docs-admin-master
>> 8.3M ./cloudstack-marvin-master
>> 1013M ./cloudstack-4.3-systemvm
>> 131M ./run-checkin-tests
>> 2.5M ./simulator-gate
>> 145M ./cloudstack-master-twiceweekly-coverity
>> 3.2M ./cloudstack-4.4-hyperv-agent
>> 104K ./test-setup-advancedzone-master
>> 1.1G ./master-slowbuild
>> 44M ./cloudstack-master
>> 301M ./package-centos7-master-noredist
>> 396K ./test-tabnanny-master
>> 816K ./simulator-build
>> 20K ./test-libcloud
>> 236K ./test-smoke-matrix-4.3
>> 4.9M ./dockerbuild-4.5-simulator
>> 331M ./package-centos7-4.4-noredist
>> 632K ./cloudstack.apt-get.eu-noredis-deb
>> 144K ./dockerbuild-master-management_centos6
>> 292M ./package-centos6-4.6
>> 9.4M ./stop-jetty
>> 326M ./cloudstack-4.4-package-rpm
>> 40K ./mgmt-build-reviewboard-requests
>> 20K ./build-test-centos-builtin
>> 76K ./simulator-deploydb
>> 20K ./Master - Python Static Code Analysis
>> 53M ./test-smoke-matrix-4.4
>> 442M ./build-master-slowbuild
>> 376K ./build-docs-niciranvp-master
>> 840K ./test-matrix-4.4
>> 2.7M ./dockerbuild-master-simulator
>> 21M ./build-docs-install-master
>> 50M ./test-fetch-marvin-4.4
>> 789M ./cloudstack-rpm-packages-with-branch-parameter
>> 5.3G ./build-systemvm-4.5
>> 1.1G ./cloudstack-4.3-systemvm64
>> 3.2M ./build-docs-release-notes-master
>> 8.0K ./cloudstack-master-codecoverage
>> 121M ./fastsimulatorbuild
>> 4.3M ./cloudstack-4.4-marvin
>> 352M ./build-master-noredist
>> 7.2M ./test-setup-advancedzone-4.4
>> 3.3M ./cloudstack-master-hyperv-agent
>> 1.9G ./build-systemvm64-master
>> 29M ./start-jetty
>> 3.4M ./simulator-4.4-integration-tests
>> 264M ./build-4.5-noredist
>> 2.0G ./package-deb-master
>> 576K ./build-master-simulator
>> 137M ./mgmt-update-nonoss-libs
>> 11M ./test-matrix-extended-master
>> 235M ./cloudstack-4.4-maven-build-noredist
>> 5.3M ./simulator-hotfix-trigger
>> 8.0K ./cloudstack-maven-build-with-branch-parameter
>> 2.7M ./test-yumrepo-refresh-master
>> 1.3G ./cloudstack-4.5-hyperv-agent
>> 1.6M ./Build-by-Branch
>> 3.5G ./build-systemvm-master
>> 369M ./package-deb-4.6
>> 172K ./test-maintenance-operations-4.4
>> 48K ./cloudstack-4.3-package-rpm-noredist
>> 532K ./build-docs-vxlan-master
>> 18M ./build-docs-devguide-master
>> 456K ./test-environment-refresh-master
>> 876K ./test-matrix-master
>> 2.1M ./test-yumrepo-refresh-4.4
>> 51M ./test-environment-refresh-4.4
>> 6.3M ./simulator-singlerun
>> 724M ./package-deb-4.5
>> 16M ./docs-4.3-gsoc-guide
>> 384K ./test-matrix-extended-4.4
>> 20K ./pull-requests
>> 204K ./build-docs-midonet-master
>> 358M ./cloudstack-4.4-package-deb
>> 506M ./build-master-jdk18
>> 2.3M ./cloudstack.apt-get.eu-noredis-centos7
>> 499M ./package-centos7-4.6
>> 119M ./build-4.5-simulator
>> 12K ./cloudstack-4.2-systemvm_test
>> 1.6M ./test-regression-matrix-4.4
>> 144K ./build-systemvm64-master-with-debian8
>> 12K ./cloudstack-4.2-systemvm
>> 12K ./cloudstack-4.2-systemvm64
>> 3.1M ./cloudstack-4.4-auto-marvin
>> 334M ./package-rhel63-master-noredist
>> 6.8M ./test-maintenance-operations-master
>> 36G .
>>
>> On Tue, Sep 29, 2015 at 9:04 AM, P

Re: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Sebastien Goasguen 

> On Sep 30, 2015, at 10:28 AM, Raja Pullela  wrote:
> 
> Yup... btw, I am on top of this and goal is to get to 100% passrate on BVTs!  
> 

Yes I got it, and we all have the same goal.

It does appear that not all smoke tests are run by Travis, otherwise we would 
catch any errors on simulator for every PR.

My point is that if a failure in your BVT is due to the test itself it is not a 
cloudstack failure per se and hence not a blocker. Which all said and done is 
not a problem because it should be fixed now if I am understanding your 
assessment and Koushik report of this failure correctly.



> -Original Message-
> From: Sebastien Goasguen [mailto:run...@gmail.com] 
> Sent: Wednesday, September 30, 2015 1:48 PM
> To: dev@cloudstack.apache.org
> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> 
> 
>> On Sep 30, 2015, at 10:15 AM, Raja Pullela  wrote:
>> 
>> Sebastien, any BVT tests failing is a blocker and needs to be fixed - which 
>> is the reason for Blocker.  We already have a fix.   
>> 
> 
> Right, but that’s a fix in the test itself, no an issue with the cloudstack 
> “core”.
> 
> In any case, great, one less blocker. 
> 
>> Koushik,
>> 
>> modified the test "test_01_scale_vm" with required_hardware=false on 
>> simulator setup and it works.  So, I think we can let the second method go.  
>> I will also test this on XS.
>> Raja
>> 
>> 
>> root@localhost:~/cloudstack# nosetests --with-marvin 
>> --marvin-config=/root/cloudstack/setup/dev/local1.cfg 
>> --zone=Sandbox-simulator --hypervisor=simulator -a 
>> tags=basic,required_hardware=false 
>> /root/cloudstack/test/integration/smoke/test_scale_vm.py
>> 
>>  Marvin Init Started 
>> 
>> === Marvin Parse Config Successful ===
>> 
>> === Marvin Setting TestData Successful===
>> 
>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_06_32_AWNF1O. 
>> All logs will be available here 
>> 
>> === Marvin Init Logging Successful===
>> 
>>  Marvin Init Successful 
>> ===final results are now copied to: 
>> /tmp//MarvinLogs/test_scale_vm_OPS7AD===
>> root@localhost:~/cloudstack# cd /tmp//MarvinLogs/test_scale_vm_OPS7AD
>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls 
>> failed_plus_exceptions.txt  results.txt  runinfo.txt 
>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# vi  results.txt 
>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls -al total 48 
>> drwxr-xr-x 2 root root  4096 Sep 30 08:07 .
>> drwxr-xr-x 8 root root  4096 Sep 30 08:06 ..
>> -rw-r--r-- 1 root root 0 Sep 30 08:06 failed_plus_exceptions.txt
>> -rw-r--r-- 1 root root   186 Sep 30 08:06 results.txt
>> -rw-r--r-- 1 root root 36164 Sep 30 08:06 runinfo.txt 
>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD#
>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# cat results.txt 
>> Test scale virtual machine ... === TestName: test_01_scale_vm | Status 
>> : SUCCESS === ok
>> 
>> --
>> Ran 1 test in 23.455s
>> 
>> OK
>> 
>> -Original Message-
>> From: Sebastien Goasguen [mailto:run...@gmail.com]
>> Sent: Wednesday, September 30, 2015 1:04 PM
>> To: dev@cloudstack.apache.org
>> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
>> 
>> 
>>> On Sep 30, 2015, at 9:10 AM, Koushik Das  wrote:
>>> 
>>> Raja,
>>> The earlier scale vm test couldn't run on simulator because of the 
>>> validation steps (IIRC it tries to connect to the real VM created during 
>>> test). Since it wasn't possible to run with simulator, the new test was 
>>> added to run just on the simulator. Check the required_hardware tag.
>>> 
>> 
>> Ok so that’s not really a blocker. 
>> 
>> Can we reduce the severity to major ?
>> Or send a PR that will add this to the Travis run and run the correct test 
>> for simulator ?
>> 
>> Or make you modifications in your BVT settings, re-run and close the issue ?
>> 
>> 
>> 
>>> -Original Message-
>>> From: Raja Pullela [mailto:raja.pull...@citrix.com]
>>> Sent: Wednesday, 30 September 2015 12:12
>>> To: CloudStack Dev (dev@cloudstack.apache.org)
>>> Subject: [Blocker] test duplicated in test_scale_vm.py
>>> 
>>> Hi,
>>> 
>>> Filed this blocker on test case "test_scale_vm.py"  - 
>>> https://issues.apache.org/jira/browse/CLOUDSTACK-8924
>>> Fixing this will bring Simulator Basic and XS Basic to 100% passrate.
>>> 
>>> Best,
>>> Raja
>>> 
>> 
>

[GitHub] cloudstack pull request: CLOUDSTACK-8894: Restrict vGPU enabled VM...

2015-09-30 Thread anshul1886 
Github user anshul1886 commented on the pull request:

https://github.com/apache/cloudstack/pull/868#issuecomment-144328947
  
@runseb Updated the bug description. I am looking into travis tests. This 
test will require vGPU enabled hosts with different type of GPU cards.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

RE: jenkins disk full ?

2015-09-30 Thread Raja Pullela 
Btw, edison, pradeep, rayeesn - are not active anymore - talluri may be?   I 
think. 

-Original Message-
From: David Nalley [mailto:da...@gnsa.us] 
Sent: Wednesday, September 30, 2015 2:01 PM
To: dev@cloudstack.apache.org
Cc: Pierre-Luc Dion ; tall...@apache.org
Subject: Re: jenkins disk full ?

Right now these folks have access:

ewanm:x:1002:1002::/home/ewanm:/bin/bash
prasanna:x:1003:1003::/home/prasanna:/bin/bash
salvatore:x:1004:1004::/home/salvatore:/bin/bash
edison:x:1005:1005::/home/edison:/bin/bash
pradeep:x:1006:1006::/home/pradeep:/bin/bash
rayeesn:x:1007:1007::/home/rayeesn:/bin/bash
hugot:x:1008:1008::/home/hugot:/bin/bash
talluri:x:1009:1009::/home/talluri:/bin/bash
dahn:x:1010:1010::/home/dahn:/bin/bash

PL or other folks who want access, send me a ssh pub key off list.

--David

On Wed, Sep 30, 2015 at 4:20 AM, Rajani Karuturi  
wrote:
> Thanks david. Do you know if anyone else has access to this? if not, can you 
> give access to PL please?
>
> ~Rajani
>
>
>
> On 30-Sep-2015, at 1:13 pm, David Nalley  wrote:
>
>> The below is before I cleaned up a bit. We now have 3.2GB free.
>>
>> [root@domU-12-31-39-15-22-2D jobs]# du -h -d 1 1.3G 
>> ./package-rhel63-master 200M ./cloudstack-4.3-maven-build-noredist
>> 638M ./package-rhel63-4.5
>> 1.1G ./cloudstack-4.4-systemvm64
>> 1.3M ./build-4.5
>> 8.0K ./cloudstack-master-with-patch
>> 186M ./build-test-archive-4.4
>> 2.9M ./test-smoke-matrix-master
>> 100K ./Create-Release-Packages
>> 1.5M ./test-packaging-4.4
>> 214M ./build-test-archive-master
>> 612K ./cloudstack.apt-get.eu-systemvm 88M ./built-test-archive 4.2M 
>> ./simulator-4.5-singlerun 424K ./test-tabnanny-4.4 2.2G 
>> ./build-master 124M ./cloudstack-4.4-systemvm 331M 
>> ./package-centos7-4.4.4-noredist 804K ./cloudstack-4.4-maven-build 
>> 3.4M ./cloudstack-4.3-maven-build 645M ./package-centos7-master 80M 
>> ./test-fetch-marvin-master 180M ./parameterized-slowbuild 508K 
>> ./cloudstack.apt-get.eu-noredis-rhel
>> 104K ./dockerbuild-master-marvin
>> 9.1M ./test-regression-matrix-master
>> 345M ./cloudstack-4.3-package-deb
>> 3.8G ./parameterized-sytemvm
>> 26M ./HyperVAgent4.3
>> 510M ./cloudstack-4.3-package-rpm
>> 1.5M ./test-packaging-master
>> 7.2M ./build-docs-admin-master
>> 8.3M ./cloudstack-marvin-master
>> 1013M ./cloudstack-4.3-systemvm
>> 131M ./run-checkin-tests
>> 2.5M ./simulator-gate
>> 145M ./cloudstack-master-twiceweekly-coverity
>> 3.2M ./cloudstack-4.4-hyperv-agent
>> 104K ./test-setup-advancedzone-master 1.1G ./master-slowbuild 44M 
>> ./cloudstack-master 301M ./package-centos7-master-noredist 396K 
>> ./test-tabnanny-master 816K ./simulator-build 20K ./test-libcloud 
>> 236K ./test-smoke-matrix-4.3 4.9M ./dockerbuild-4.5-simulator 331M 
>> ./package-centos7-4.4-noredist 632K 
>> ./cloudstack.apt-get.eu-noredis-deb
>> 144K ./dockerbuild-master-management_centos6
>> 292M ./package-centos6-4.6
>> 9.4M ./stop-jetty
>> 326M ./cloudstack-4.4-package-rpm
>> 40K ./mgmt-build-reviewboard-requests 20K ./build-test-centos-builtin 
>> 76K ./simulator-deploydb 20K ./Master - Python Static Code Analysis 
>> 53M ./test-smoke-matrix-4.4 442M ./build-master-slowbuild 376K 
>> ./build-docs-niciranvp-master 840K ./test-matrix-4.4 2.7M 
>> ./dockerbuild-master-simulator 21M ./build-docs-install-master 50M 
>> ./test-fetch-marvin-4.4 789M 
>> ./cloudstack-rpm-packages-with-branch-parameter
>> 5.3G ./build-systemvm-4.5
>> 1.1G ./cloudstack-4.3-systemvm64
>> 3.2M ./build-docs-release-notes-master 8.0K 
>> ./cloudstack-master-codecoverage 121M ./fastsimulatorbuild 4.3M 
>> ./cloudstack-4.4-marvin 352M ./build-master-noredist 7.2M 
>> ./test-setup-advancedzone-4.4 3.3M ./cloudstack-master-hyperv-agent 
>> 1.9G ./build-systemvm64-master 29M ./start-jetty 3.4M 
>> ./simulator-4.4-integration-tests 264M ./build-4.5-noredist 2.0G 
>> ./package-deb-master 576K ./build-master-simulator 137M 
>> ./mgmt-update-nonoss-libs 11M ./test-matrix-extended-master 235M 
>> ./cloudstack-4.4-maven-build-noredist
>> 5.3M ./simulator-hotfix-trigger
>> 8.0K ./cloudstack-maven-build-with-branch-parameter
>> 2.7M ./test-yumrepo-refresh-master
>> 1.3G ./cloudstack-4.5-hyperv-agent
>> 1.6M ./Build-by-Branch
>> 3.5G ./build-systemvm-master
>> 369M ./package-deb-4.6
>> 172K ./test-maintenance-operations-4.4 48K 
>> ./cloudstack-4.3-package-rpm-noredist
>> 532K ./build-docs-vxlan-master
>> 18M ./build-docs-devguide-master
>> 456K ./test-environment-refresh-master 876K ./test-matrix-master 2.1M 
>> ./test-yumrepo-refresh-4.4 51M ./test-environment-refresh-4.4 6.3M 
>> ./simulator-singlerun 724M ./package-deb-4.5 16M 
>> ./docs-4.3-gsoc-guide 384K ./test-matrix-extended-4.4 20K 
>> ./pull-requests 204K ./build-docs-midonet-master 358M 
>> ./cloudstack-4.4-package-deb 506M ./build-master-jdk18 2.3M 
>> ./cloudstack.apt-get.eu-noredis-centos7
>> 499M ./package-centos7-4.6
>> 119M ./build-4.5-simulator
>> 12K ./cloudstack-4.2-systemvm_test
>> 1.6M ./test-regression-matrix-4.4
>> 144K ./build-systemvm64-master-wit

Re: OVS Plugin documentation issues

2015-09-30 Thread Sebastien Goasguen 

> On Sep 29, 2015, at 2:40 PM, Ron Wheeler  
> wrote:
> 
> Don't mind making the changes.
> I have a lot of SVN experience and have the git repo for Apache OFBiz 
> configured but am still trying to figure out git.
> What do I have to setup in Eclipse to access the "right" bits on git.
> 
> Seems to be a ton of git repo entries at 
> https://git-wip-us.apache.org/repos/asf/cloudstack.git
> I have cloned [4.5]. Is that right?
> 
> Where are the doc files?
> 

There are several documentation repos depending on which guide you need to fix:

https://github.com/apache/cloudstack-docs
https://github.com/apache/cloudstack-docs-install
https://github.com/apache/cloudstack-docs-admin

Check the README file to see how to submit a patch.

thanks for your help


> Ron
> 
> On 29/09/2015 4:25 AM, Erik Weber wrote:
>> On Tue, Sep 29, 2015 at 7:58 AM, Ron Wheeler > > wrote:
>> 
>>On the page
>>http://docs.cloudstack.apache.org/en/master/networking/ovs-plugin.html
>>"Configuring the OVS Plugin"
>>starts with
>>"Prerequisites"
>>which opens with this sentence
>>"Before enabling the OVS plugin the hypervisor needs to be install
>>OpenvSwitch."
>>which needs to be fixed.
>>Does "Before enabling the OVS plugin, OpenvSwitch must be
>>installed on  the hypervisor ." express the idea correctly.
>> 
>>"Default, XenServer has already installed OpenvSwitch." might be
>>trying to say "Xenserver has OpenvSwitch installed by default."
>> 
>> 
>> 
>> Open a Pull Request for the proposed changes :-)
>> You can do it directly in the github ui by pressing the 'Edit the file on 
>> your fork of this project' if you are unfamiliar with git and its workflows.
>> 
>> 
>> If you for some reason don't want to/can't do that, let us know and we'll do 
>> our best to pick it up.
>> 
>> 
>> -- 
>> Erik
>> 
> 
> 
> -- 
> Ron Wheeler
> President
> Artifact Software Inc
> email: rwhee...@artifact-software.com
> skype: ronaldmwheeler
> phone: 866-970-2435, ext 102

[GitHub] cloudstack pull request: CLOUDSTACK-8895: Verify if storage on sto...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/869#issuecomment-144331549
  
@pritisarap12 can this be run via simulator ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8896: allocated percentage of ...

2015-09-30 Thread runseb 
Github user runseb commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/873#discussion_r40771703
  
--- Diff: server/src/com/cloud/storage/StorageManagerImpl.java ---
@@ -1736,7 +1737,10 @@ public boolean 
storagePoolHasEnoughSpace(List volumes, StoragePool pool)
 allocatedSizeWithtemplate = 
_capacityMgr.getAllocatedPoolCapacity(poolVO, tmpl);
 }
 }
-if (volumeVO.getState() != Volume.State.Ready) {
+// A ready state volume is already allocated in a pool. so the 
asking size is zero for it.
+// In case the volume is moving across pools or is not ready 
yet, the asking size has to be computed
+s_logger.debug("pool id for the volume with id: " + 
volumeVO.getId() + " is: " + volumeVO.getPoolId());
--- End diff --

@karuturi waiting for your reply on wido's question :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8897: baremetal:addHost:make h...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/874#issuecomment-144332355
  
We won't be able to test this on simulator.
@harikrishna-patnala can you answer @borisroman and then we can merge.
LGTM +1 on code review alone


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: Changes made to DeployDataCenter to suppo...

2015-09-30 Thread DaanHoogland 
Github user DaanHoogland commented on the pull request:

https://github.com/apache/cloudstack/pull/809#issuecomment-144332699
  
@sanju1010 makes sense and then of course a test report and -description is 
needed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

RE: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Raja Pullela 
The problem needs to be fixed - "have tested a solution that was discussed with 
koushik" - we will have to create PR with that change.  Once the PR is pushed - 
we will have one less blocker/test failure.  

I agree this is not a cloudstack core code problem - but we should NOT make 
that a criteria for priority of a bug - just my take.  We should include BVT 
failures in the Blocker criteria (whether the fix is in the core 
functionality/test script).  Otherwise, we will not hit 100% passrate on BVTs. 

You are right - only a subset of these tests are being run on "travis" 
otherwise we will catch more or some of these failures.  

-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: Wednesday, September 30, 2015 2:09 PM
To: dev@cloudstack.apache.org
Subject: Re: [Blocker] test duplicated in test_scale_vm.py


> On Sep 30, 2015, at 10:28 AM, Raja Pullela  wrote:
> 
> Yup... btw, I am on top of this and goal is to get to 100% passrate on BVTs!  
> 

Yes I got it, and we all have the same goal.

It does appear that not all smoke tests are run by Travis, otherwise we would 
catch any errors on simulator for every PR.

My point is that if a failure in your BVT is due to the test itself it is not a 
cloudstack failure per se and hence not a blocker. Which all said and done is 
not a problem because it should be fixed now if I am understanding your 
assessment and Koushik report of this failure correctly.



> -Original Message-
> From: Sebastien Goasguen [mailto:run...@gmail.com]
> Sent: Wednesday, September 30, 2015 1:48 PM
> To: dev@cloudstack.apache.org
> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> 
> 
>> On Sep 30, 2015, at 10:15 AM, Raja Pullela  wrote:
>> 
>> Sebastien, any BVT tests failing is a blocker and needs to be fixed - which 
>> is the reason for Blocker.  We already have a fix.   
>> 
> 
> Right, but that’s a fix in the test itself, no an issue with the cloudstack 
> “core”.
> 
> In any case, great, one less blocker. 
> 
>> Koushik,
>> 
>> modified the test "test_01_scale_vm" with required_hardware=false on 
>> simulator setup and it works.  So, I think we can let the second method go.  
>> I will also test this on XS.
>> Raja
>> 
>> 
>> root@localhost:~/cloudstack# nosetests --with-marvin 
>> --marvin-config=/root/cloudstack/setup/dev/local1.cfg
>> --zone=Sandbox-simulator --hypervisor=simulator -a 
>> tags=basic,required_hardware=false
>> /root/cloudstack/test/integration/smoke/test_scale_vm.py
>> 
>>  Marvin Init Started 
>> 
>> === Marvin Parse Config Successful ===
>> 
>> === Marvin Setting TestData Successful===
>> 
>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_06_32_AWNF1O. 
>> All logs will be available here 
>> 
>> === Marvin Init Logging Successful===
>> 
>>  Marvin Init Successful 
>> ===final results are now copied to: 
>> /tmp//MarvinLogs/test_scale_vm_OPS7AD===
>> root@localhost:~/cloudstack# cd /tmp//MarvinLogs/test_scale_vm_OPS7AD
>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls 
>> failed_plus_exceptions.txt  results.txt  runinfo.txt 
>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# vi  results.txt 
>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls -al total 48 
>> drwxr-xr-x 2 root root  4096 Sep 30 08:07 .
>> drwxr-xr-x 8 root root  4096 Sep 30 08:06 ..
>> -rw-r--r-- 1 root root 0 Sep 30 08:06 failed_plus_exceptions.txt
>> -rw-r--r-- 1 root root   186 Sep 30 08:06 results.txt
>> -rw-r--r-- 1 root root 36164 Sep 30 08:06 runinfo.txt 
>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD#
>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# cat results.txt 
>> Test scale virtual machine ... === TestName: test_01_scale_vm | 
>> Status
>> : SUCCESS === ok
>> 
>> -
>> -
>> Ran 1 test in 23.455s
>> 
>> OK
>> 
>> -Original Message-
>> From: Sebastien Goasguen [mailto:run...@gmail.com]
>> Sent: Wednesday, September 30, 2015 1:04 PM
>> To: dev@cloudstack.apache.org
>> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
>> 
>> 
>>> On Sep 30, 2015, at 9:10 AM, Koushik Das  wrote:
>>> 
>>> Raja,
>>> The earlier scale vm test couldn't run on simulator because of the 
>>> validation steps (IIRC it tries to connect to the real VM created during 
>>> test). Since it wasn't possible to run with simulator, the new test was 
>>> added to run just on the simulator. Check the required_hardware tag.
>>> 
>> 
>> Ok so that’s not really a blocker. 
>> 
>> Can we reduce the severity to major ?
>> Or send a PR that will add this to the Travis run and run the correct test 
>> for simulator ?
>> 
>> Or make you modifications in your BVT settings, re-run and close the issue ?
>> 
>> 
>> 
>>> -Original Message-
>>> From: Raja Pullela [mailto:raja.pull...@citrix.com]
>>> Sent: Wednesday, 30 September 2015 12:12
>>> To: CloudStack Dev (dev@cloudstack.apache.org)
>>> Subject: [Blocker] test dupli

[GitHub] cloudstack pull request: CLOUDSTACK-8847: ListServiceOfferings is ...

2015-09-30 Thread nitin-maharana 
Github user nitin-maharana commented on the pull request:

https://github.com/apache/cloudstack/pull/823#issuecomment-144333001
  
Hi @remibergsma,
I rebased my commit against the current master. 
I added unit test for the change.

Thanks,
Nitin


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8848: ensure power state is up...

2015-09-30 Thread DaanHoogland 
Github user DaanHoogland commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/885#discussion_r40772428
  
--- Diff: engine/schema/src/com/cloud/vm/dao/VMInstanceDaoImpl.java ---
@@ -805,6 +805,12 @@ public Boolean doInTransaction(TransactionStatus 
status) {
 }
 
 @Override
+public boolean isPowerStateUpToDate(final long instanceId) {
+VMInstanceVO instance = findById(instanceId);
+return instance.getPowerStateUpdateCount() < 
MAX_CONSECUTIVE_SAME_STATE_UPDATE_COUNT;
--- End diff --

Are we sure instance in not null at this point?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8913: Search box in Templates ...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/891#issuecomment-144333775
  
@nitin-maharana LGTM +1 based on code review.
Maybe adding two snapshots to compare would help review (just a thought)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8848: ensure power state is up...

2015-09-30 Thread DaanHoogland 
Github user DaanHoogland commented on the pull request:

https://github.com/apache/cloudstack/pull/885#issuecomment-144334476
  
I think this will work but it is a fix on a broken state machine. The 
statemachine expects a power report every so and so time-interval and when it 
doesn't come , this is just regarded as an PowerOff event while it is not. I 
don't think a fix for should not go in this PR. We could let this go for now 
and make a better fix though. @resmo you said you were not in a hurry, are you?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: BVT report 9/29

2015-09-30 Thread Miguel Ferreira 
All,

Following the instructions I had posted in the original PR 
(https://github.com/apache/cloudstack/pull/741#issuecomment-135415998) I can 
reproduce the same result. That is, the test passes against the simulator with 
an Advanced zone:
[root@cs1 cloudstack]# nosetests --with-marvin 
--marvin-config=setup/dev/advanced.cfg   
test/integration/smoke/test_scale_vm.py -s -a 
tags=advanced,required_hardware=false   --zone=Sandbox-simulator 
--hypervisor=simulator

 Marvin Init Started 

=== Marvin Parse Config Successful ===

=== Marvin Setting TestData Successful===

 Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_42_56_AFB6G9. All logs 
will be available here 

=== Marvin Init Logging Successful===

 Marvin Init Successful 
=== TestName: test_02_scale_vm_without_hypervisor_specifics | Status : SUCCESS 
===

===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_AKT78U===


I could reproduce the error reported here 
https://issues.apache.org/jira/browse/CLOUDSTACK-8924 by running both test 1 
and test 2 together (toggling require hardware to false in test 1).
[root@cs1 cloudstack]# nosetests --with-marvin 
--marvin-config=setup/dev/advanced.cfg   
test/integration/smoke/test_scale_vm.py -s -a 
tags=advanced,required_hardware=false   --zone=Sandbox-simulator 
--hypervisor=simulator

 Marvin Init Started 

=== Marvin Parse Config Successful ===

=== Marvin Setting TestData Successful===

 Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_46_16_U8QJEI. All logs 
will be available here 

=== Marvin Init Logging Successful===

 Marvin Init Successful 
=== TestName: test_01_scale_vm | Status : SUCCESS ===

=== TestName: test_02_scale_vm_without_hypervisor_specifics | Status : 
EXCEPTION ===

===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_4DVZLG===


That seems to me like cleanup is not being performed between the two tests.
However, like Raja already indicated in the JIRA issue, we wouldn’t need test 2 
if test 1 works well in the simulator (as it seems to work).
In short, we could get rid of test 
“test_02_scale_vm_without_hypervisor_specifics” altogether.

Having adapted the basic.cfg (basic zone config) to enable vm scaling, I can 
reproduce the same results. Test 
“test_02_scale_vm_without_hypervisor_specifics" by it self passes.

[root@cs1 cloudstack]# nosetests --with-marvin 
--marvin-config=setup/dev/advanced.cfg   
test/integration/smoke/test_scale_vm.py -s -a 
tags=basic,required_hardware=false   --zone=Sandbox-simulator 
--hypervisor=simulator

 Marvin Init Started 

=== Marvin Parse Config Successful ===

=== Marvin Setting TestData Successful===

 Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_09_11_44_KWEPUS. All logs 
will be available here 

=== Marvin Init Logging Successful===

 Marvin Init Successful 
=== TestName: test_02_scale_vm_without_hypervisor_specifics | Status : SUCCESS 
===

===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_2IQ0MJ===


Running both tests together fails due to missing cleanup between tests:
[root@cs1 cloudstack]# nosetests --with-marvin 
--marvin-config=setup/dev/advanced.cfg   
test/integration/smoke/test_scale_vm.py -s -a 
tags=basic,required_hardware=false   --zone=Sandbox-simulator 
--hypervisor=simulator

 Marvin Init Started 

=== Marvin Parse Config Successful ===

=== Marvin Setting TestData Successful===

 Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_09_13_45_5NC2QK. All logs 
will be available here 

=== Marvin Init Logging Successful===

 Marvin Init Successful 
=== TestName: test_01_scale_vm | Status : SUCCESS ===

=== TestName: test_02_scale_vm_without_hypervisor_specifics | Status : 
EXCEPTION ===

===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_FUCV6R===


Cheers,
\ Miguel Ferreira
   mferre...@schubergphilis.com




On 30 Sep 2015, at 10:17, Raja Pullela 
mailto:raja.pull...@citrix.com>> wrote:

Miguel, please see the defect 
https://issues.apache.org/jira/browse/CLOUDSTACK-8924
Let me know if you have any questions,
Raja

-Original Message-
From: Miguel Ferreira [mailto:mferre...@schubergphilis.com]
Sent: Wednesday, September 30, 2015 1:43 PM
To: Sebastien Goasguen mailto:run...@gmail.com>>
Cc: dev mailto:dev@cloudstack.apache.org>>; Boris 
Schrijver mailto:bo...@pcextreme.nl>>; Pierre-Luc Dion 
mailto:pd...@cloudops.com>>; Milamber 
mailto:milam...@apache.org>>
Subject: Re: BVT report 9/29

Hi Sebastian,

On 29 Sep 2015, at 20:42, Sebastien Goasguen 
mailto:run...@gmail.com>> wrote:

@miguel, looks like smoke/test_scale_vm is reporting errors. It seems you were 
the last one to touch that test. Could you try to run the tests on some 
cloudstack setup you have and report back to use your finding. From below you 
can see, the test seems to be failing on simulator/basic.

It would be nice to have the output of the test

Re: BVT report 9/29

2015-09-30 Thread Sebastien Goasguen 
Thanks a lot Miguel, 

> On Sep 30, 2015, at 11:15 AM, Miguel Ferreira  
> wrote:
> 
> All,
> 
> Following the instructions I had posted in the original PR 
> (https://github.com/apache/cloudstack/pull/741#issuecomment-135415998) I can 
> reproduce the same result. That is, the test passes against the simulator 
> with an Advanced zone:
>> [root@cs1 cloudstack]# nosetests --with-marvin 
>> --marvin-config=setup/dev/advanced.cfg   
>> test/integration/smoke/test_scale_vm.py -s -a 
>> tags=advanced,required_hardware=false   --zone=Sandbox-simulator 
>> --hypervisor=simulator
>> 
>>  Marvin Init Started 
>> 
>> === Marvin Parse Config Successful ===
>> 
>> === Marvin Setting TestData Successful===
>> 
>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_42_56_AFB6G9. All 
>> logs will be available here 
>> 
>> === Marvin Init Logging Successful===
>> 
>>  Marvin Init Successful 
>> === TestName: test_02_scale_vm_without_hypervisor_specifics | Status : 
>> SUCCESS ===
>> 
>> ===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_AKT78U===
> 
> 
> I could reproduce the error reported here 
> https://issues.apache.org/jira/browse/CLOUDSTACK-8924 by running both test 1 
> and test 2 together (toggling require hardware to false in test 1).
>> [root@cs1 cloudstack]# nosetests --with-marvin 
>> --marvin-config=setup/dev/advanced.cfg   
>> test/integration/smoke/test_scale_vm.py -s -a 
>> tags=advanced,required_hardware=false   --zone=Sandbox-simulator 
>> --hypervisor=simulator
>> 
>>  Marvin Init Started 
>> 
>> === Marvin Parse Config Successful ===
>> 
>> === Marvin Setting TestData Successful===
>> 
>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_46_16_U8QJEI. All 
>> logs will be available here 
>> 
>> === Marvin Init Logging Successful===
>> 
>>  Marvin Init Successful 
>> === TestName: test_01_scale_vm | Status : SUCCESS ===
>> 
>> === TestName: test_02_scale_vm_without_hypervisor_specifics | Status : 
>> EXCEPTION ===
>> 
>> ===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_4DVZLG===
> 
> 
> That seems to me like cleanup is not being performed between the two tests.
> However, like Raja already indicated in the JIRA issue, we wouldn’t need test 
> 2 if test 1 works well in the simulator (as it seems to work). 
> In short, we could get rid of test 
> “test_02_scale_vm_without_hypervisor_specifics” altogether.
> 
> Having adapted the basic.cfg (basic zone config) to enable vm scaling, I can 
> reproduce the same results. Test 
> “test_02_scale_vm_without_hypervisor_specifics" by it self passes.
> 
>> [root@cs1 cloudstack]# nosetests --with-marvin 
>> --marvin-config=setup/dev/advanced.cfg   
>> test/integration/smoke/test_scale_vm.py -s -a 
>> tags=basic,required_hardware=false   --zone=Sandbox-simulator 
>> --hypervisor=simulator
>> 
>>  Marvin Init Started 
>> 
>> === Marvin Parse Config Successful ===
>> 
>> === Marvin Setting TestData Successful===
>> 
>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_09_11_44_KWEPUS. All 
>> logs will be available here 
>> 
>> === Marvin Init Logging Successful===
>> 
>>  Marvin Init Successful 
>> === TestName: test_02_scale_vm_without_hypervisor_specifics | Status : 
>> SUCCESS ===
>> 
>> ===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_2IQ0MJ===
> 
> 
> Running both tests together fails due to missing cleanup between tests:
>> [root@cs1 cloudstack]# nosetests --with-marvin 
>> --marvin-config=setup/dev/advanced.cfg   
>> test/integration/smoke/test_scale_vm.py -s -a 
>> tags=basic,required_hardware=false   --zone=Sandbox-simulator 
>> --hypervisor=simulator
>> 
>>  Marvin Init Started 
>> 
>> === Marvin Parse Config Successful ===
>> 
>> === Marvin Setting TestData Successful===
>> 
>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_09_13_45_5NC2QK. All 
>> logs will be available here 
>> 
>> === Marvin Init Logging Successful===
>> 
>>  Marvin Init Successful 
>> === TestName: test_01_scale_vm | Status : SUCCESS ===
>> 
>> === TestName: test_02_scale_vm_without_hypervisor_specifics | Status : 
>> EXCEPTION ===
>> 
>> ===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_FUCV6R===
> 
> 
> Cheers,
> \ Miguel Ferreira
>mferre...@schubergphilis.com
> 
> 
> 
> 
>> On 30 Sep 2015, at 10:17, Raja Pullela  wrote:
>> 
>> Miguel, please see the defect 
>> https://issues.apache.org/jira/browse/CLOUDSTACK-8924
>> Let me know if you have any questions,
>> Raja
>> 
>> -Original Message-
>> From: Miguel Ferreira [mailto:mferre...@schubergphilis.com] 
>> Sent: Wednesday, September 30, 2015 1:43 PM
>> To: Sebastien Goasguen 
>> Cc: dev ; Boris Schrijver ; 
>> Pierre-Luc Dion ; Milamber 
>> Subject: Re: BVT report 9/29
>> 
>> Hi Sebastian,
>> 
>> On 29 Sep 2015, at 20:42, Sebastien Goasguen 
>> mailto:run...@gmail.com>> wrote:
>> 
>> @miguel, looks like smoke/test_scale_vm is reporting errors. It seems you 
>> we

Re: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Rajani Karuturi 
I agree with Raja. BVT test case failures should be treated as blockers. Once 
the test issue is fixed, they might uncover new issues/regressions.

~Rajani



On 30-Sep-2015, at 2:32 pm, Raja Pullela  wrote:

> The problem needs to be fixed - "have tested a solution that was discussed 
> with koushik" - we will have to create PR with that change.  Once the PR is 
> pushed - we will have one less blocker/test failure.  
> 
> I agree this is not a cloudstack core code problem - but we should NOT make 
> that a criteria for priority of a bug - just my take.  We should include BVT 
> failures in the Blocker criteria (whether the fix is in the core 
> functionality/test script).  Otherwise, we will not hit 100% passrate on 
> BVTs. 
> 
> You are right - only a subset of these tests are being run on "travis" 
> otherwise we will catch more or some of these failures.  
> 
> -Original Message-
> From: Sebastien Goasguen [mailto:run...@gmail.com] 
> Sent: Wednesday, September 30, 2015 2:09 PM
> To: dev@cloudstack.apache.org
> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> 
> 
>> On Sep 30, 2015, at 10:28 AM, Raja Pullela  wrote:
>> 
>> Yup... btw, I am on top of this and goal is to get to 100% passrate on BVTs! 
>>  
>> 
> 
> Yes I got it, and we all have the same goal.
> 
> It does appear that not all smoke tests are run by Travis, otherwise we would 
> catch any errors on simulator for every PR.
> 
> My point is that if a failure in your BVT is due to the test itself it is not 
> a cloudstack failure per se and hence not a blocker. Which all said and done 
> is not a problem because it should be fixed now if I am understanding your 
> assessment and Koushik report of this failure correctly.
> 
> 
> 
>> -Original Message-
>> From: Sebastien Goasguen [mailto:run...@gmail.com]
>> Sent: Wednesday, September 30, 2015 1:48 PM
>> To: dev@cloudstack.apache.org
>> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
>> 
>> 
>>> On Sep 30, 2015, at 10:15 AM, Raja Pullela  wrote:
>>> 
>>> Sebastien, any BVT tests failing is a blocker and needs to be fixed - which 
>>> is the reason for Blocker.  We already have a fix.   
>>> 
>> 
>> Right, but that’s a fix in the test itself, no an issue with the cloudstack 
>> “core”.
>> 
>> In any case, great, one less blocker. 
>> 
>>> Koushik,
>>> 
>>> modified the test "test_01_scale_vm" with required_hardware=false on 
>>> simulator setup and it works.  So, I think we can let the second method go. 
>>>  I will also test this on XS.
>>> Raja
>>> 
>>> 
>>> root@localhost:~/cloudstack# nosetests --with-marvin 
>>> --marvin-config=/root/cloudstack/setup/dev/local1.cfg
>>> --zone=Sandbox-simulator --hypervisor=simulator -a 
>>> tags=basic,required_hardware=false
>>> /root/cloudstack/test/integration/smoke/test_scale_vm.py
>>> 
>>>  Marvin Init Started 
>>> 
>>> === Marvin Parse Config Successful ===
>>> 
>>> === Marvin Setting TestData Successful===
>>> 
>>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_06_32_AWNF1O. 
>>> All logs will be available here 
>>> 
>>> === Marvin Init Logging Successful===
>>> 
>>>  Marvin Init Successful 
>>> ===final results are now copied to: 
>>> /tmp//MarvinLogs/test_scale_vm_OPS7AD===
>>> root@localhost:~/cloudstack# cd /tmp//MarvinLogs/test_scale_vm_OPS7AD
>>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls 
>>> failed_plus_exceptions.txt  results.txt  runinfo.txt 
>>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# vi  results.txt 
>>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls -al total 48 
>>> drwxr-xr-x 2 root root  4096 Sep 30 08:07 .
>>> drwxr-xr-x 8 root root  4096 Sep 30 08:06 ..
>>> -rw-r--r-- 1 root root 0 Sep 30 08:06 failed_plus_exceptions.txt
>>> -rw-r--r-- 1 root root   186 Sep 30 08:06 results.txt
>>> -rw-r--r-- 1 root root 36164 Sep 30 08:06 runinfo.txt 
>>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD#
>>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# cat results.txt 
>>> Test scale virtual machine ... === TestName: test_01_scale_vm | 
>>> Status
>>> : SUCCESS === ok
>>> 
>>> -
>>> -
>>> Ran 1 test in 23.455s
>>> 
>>> OK
>>> 
>>> -Original Message-
>>> From: Sebastien Goasguen [mailto:run...@gmail.com]
>>> Sent: Wednesday, September 30, 2015 1:04 PM
>>> To: dev@cloudstack.apache.org
>>> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
>>> 
>>> 
 On Sep 30, 2015, at 9:10 AM, Koushik Das  wrote:
 
 Raja,
 The earlier scale vm test couldn't run on simulator because of the 
 validation steps (IIRC it tries to connect to the real VM created during 
 test). Since it wasn't possible to run with simulator, the new test was 
 added to run just on the simulator. Check the required_hardware tag.
 
>>> 
>>> Ok so that’s not really a blocker. 
>>> 
>>> Can we reduce the severity to major ?
>>> Or send a PR that will add this to

Re: test_nicira_controller.py is failing on all Advzone - XS, KVM

2015-09-30 Thread Miguel Ferreira 
Hi Raja,

That test needs a NSX cluster. With that in place, the configuration used to 
run the test must define a section called NiciraNvp, and that section should 
have an array os hosts with that name (see line 46 of the test).
In a Marvin config that materializes in something like this:
"niciraNvp": {
"hosts": [ "nsxcon1.cloud.lan", "nsxcon2.cloud.lan" ]
}

Furthermore, you need to have a zone configured to use NSX and that requires 
more work.
You can find a full Marvin config for it here: 
https://github.com/schubergphilis/MCT-shared/blob/master/marvin/mct-zone1-kvm1-NVP.cfg
In that same git repo there are config files for deploying a NSX cluster 
(https://github.com/schubergphilis/MCT-shared/blob/master/deploy/cloud/nsx_cluster.conf).
However, we have not yet fully automated all the steps needed to get the 
cluster up and running (ie. setting up the cluster internals, and adding a more 
controllers to the cluster).
I can help you with that if you need.

Cheers,
\ Miguel Ferreira
   mferre...@schubergphilis.com




On 30 Sep 2015, at 09:05, Raja Pullela 
mailto:raja.pull...@citrix.com>> wrote:

Hi Miguel or someone's familiar with this test,

Can you please provide documentation around how to get these tests running ?
BTW - looks like this is a new test that was added on Aug 25th 2015.

Thanks,
Raja

=== TestName: None | Status : EXCEPTION ===
ERROR

==
ERROR: test suite for 
--
Traceback (most recent call last):
 File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 209, in run
   self.setUp()
 File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 292, in setUp
   self.setupContext(ancestor)
 File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 315, in 
setupContext
   try_run(context, names)
 File "/usr/local/lib/python2.7/dist-packages/nose/util.py", line 470, in 
try_run
   return func()
 File "/root/cloudstack/test/integration/smoke/test_nicira_controller.py", line 
46, in setUpClass
   cls.nicira_hosts  = cls.config.niciraNvp.hosts
AttributeError: 'NoneType' object has no attribute 'hosts'
 >> begin captured stdout << -
=== TestName: None | Status : EXCEPTION ===


- >> end captured stdout << --
 >> begin captured logging << 
CSLog: CRITICAL: EXCEPTION: None: ['Traceback (most recent call last):\n', '  
File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 209, in run\n 
   self.setUp()\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 292, in setUp\n
self.setupContext(ancestor)\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 315, in 
setupContext\ntry_run(context, names)\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/util.py", line 470, in try_run\n   
 return func()\n', '  File 
"/root/cloudstack/test/integration/smoke/test_nicira_controller.py", line 46, 
in setUpClass\ncls.nicira_hosts  = cls.config.niciraNvp.hosts\n', 
"AttributeError: 'NoneType' object has no attribute 'hosts'\n"]
- >> end captured logging << -

--
XML: /root/marvinxKcIvFqe/results.xml
--
Ran 0 tests in 0.002s

FAILED (errors=1)

Re: jenkins disk full ?

2015-09-30 Thread Daan Hoogland 
H David, I just tried and it works indeed. Forgot about that. Does it make
sense to have a script containing du mail to dev@ if something like
/var/lib/jenkins/workspace or / exceeds a threshold? (yes me volunteering)

On Wed, Sep 30, 2015 at 10:48 AM, Raja Pullela 
wrote:

> Btw, edison, pradeep, rayeesn - are not active anymore - talluri may be?
>  I think.
>
> -Original Message-
> From: David Nalley [mailto:da...@gnsa.us]
> Sent: Wednesday, September 30, 2015 2:01 PM
> To: dev@cloudstack.apache.org
> Cc: Pierre-Luc Dion ; tall...@apache.org
> Subject: Re: jenkins disk full ?
>
> Right now these folks have access:
>
> ewanm:x:1002:1002::/home/ewanm:/bin/bash
> prasanna:x:1003:1003::/home/prasanna:/bin/bash
> salvatore:x:1004:1004::/home/salvatore:/bin/bash
> edison:x:1005:1005::/home/edison:/bin/bash
> pradeep:x:1006:1006::/home/pradeep:/bin/bash
> rayeesn:x:1007:1007::/home/rayeesn:/bin/bash
> hugot:x:1008:1008::/home/hugot:/bin/bash
> talluri:x:1009:1009::/home/talluri:/bin/bash
> dahn:x:1010:1010::/home/dahn:/bin/bash
>
> PL or other folks who want access, send me a ssh pub key off list.
>
> --David
>
> On Wed, Sep 30, 2015 at 4:20 AM, Rajani Karuturi <
> rajani.karut...@citrix.com> wrote:
> > Thanks david. Do you know if anyone else has access to this? if not, can
> you give access to PL please?
> >
> > ~Rajani
> >
> >
> >
> > On 30-Sep-2015, at 1:13 pm, David Nalley  wrote:
> >
> >> The below is before I cleaned up a bit. We now have 3.2GB free.
> >>
> >> [root@domU-12-31-39-15-22-2D jobs]# du -h -d 1 1.3G
> >> ./package-rhel63-master 200M ./cloudstack-4.3-maven-build-noredist
> >> 638M ./package-rhel63-4.5
> >> 1.1G ./cloudstack-4.4-systemvm64
> >> 1.3M ./build-4.5
> >> 8.0K ./cloudstack-master-with-patch
> >> 186M ./build-test-archive-4.4
> >> 2.9M ./test-smoke-matrix-master
> >> 100K ./Create-Release-Packages
> >> 1.5M ./test-packaging-4.4
> >> 214M ./build-test-archive-master
> >> 612K ./cloudstack.apt-get.eu-systemvm 88M ./built-test-archive 4.2M
> >> ./simulator-4.5-singlerun 424K ./test-tabnanny-4.4 2.2G
> >> ./build-master 124M ./cloudstack-4.4-systemvm 331M
> >> ./package-centos7-4.4.4-noredist 804K ./cloudstack-4.4-maven-build
> >> 3.4M ./cloudstack-4.3-maven-build 645M ./package-centos7-master 80M
> >> ./test-fetch-marvin-master 180M ./parameterized-slowbuild 508K
> >> ./cloudstack.apt-get.eu-noredis-rhel
> >> 104K ./dockerbuild-master-marvin
> >> 9.1M ./test-regression-matrix-master
> >> 345M ./cloudstack-4.3-package-deb
> >> 3.8G ./parameterized-sytemvm
> >> 26M ./HyperVAgent4.3
> >> 510M ./cloudstack-4.3-package-rpm
> >> 1.5M ./test-packaging-master
> >> 7.2M ./build-docs-admin-master
> >> 8.3M ./cloudstack-marvin-master
> >> 1013M ./cloudstack-4.3-systemvm
> >> 131M ./run-checkin-tests
> >> 2.5M ./simulator-gate
> >> 145M ./cloudstack-master-twiceweekly-coverity
> >> 3.2M ./cloudstack-4.4-hyperv-agent
> >> 104K ./test-setup-advancedzone-master 1.1G ./master-slowbuild 44M
> >> ./cloudstack-master 301M ./package-centos7-master-noredist 396K
> >> ./test-tabnanny-master 816K ./simulator-build 20K ./test-libcloud
> >> 236K ./test-smoke-matrix-4.3 4.9M ./dockerbuild-4.5-simulator 331M
> >> ./package-centos7-4.4-noredist 632K
> >> ./cloudstack.apt-get.eu-noredis-deb
> >> 144K ./dockerbuild-master-management_centos6
> >> 292M ./package-centos6-4.6
> >> 9.4M ./stop-jetty
> >> 326M ./cloudstack-4.4-package-rpm
> >> 40K ./mgmt-build-reviewboard-requests 20K ./build-test-centos-builtin
> >> 76K ./simulator-deploydb 20K ./Master - Python Static Code Analysis
> >> 53M ./test-smoke-matrix-4.4 442M ./build-master-slowbuild 376K
> >> ./build-docs-niciranvp-master 840K ./test-matrix-4.4 2.7M
> >> ./dockerbuild-master-simulator 21M ./build-docs-install-master 50M
> >> ./test-fetch-marvin-4.4 789M
> >> ./cloudstack-rpm-packages-with-branch-parameter
> >> 5.3G ./build-systemvm-4.5
> >> 1.1G ./cloudstack-4.3-systemvm64
> >> 3.2M ./build-docs-release-notes-master 8.0K
> >> ./cloudstack-master-codecoverage 121M ./fastsimulatorbuild 4.3M
> >> ./cloudstack-4.4-marvin 352M ./build-master-noredist 7.2M
> >> ./test-setup-advancedzone-4.4 3.3M ./cloudstack-master-hyperv-agent
> >> 1.9G ./build-systemvm64-master 29M ./start-jetty 3.4M
> >> ./simulator-4.4-integration-tests 264M ./build-4.5-noredist 2.0G
> >> ./package-deb-master 576K ./build-master-simulator 137M
> >> ./mgmt-update-nonoss-libs 11M ./test-matrix-extended-master 235M
> >> ./cloudstack-4.4-maven-build-noredist
> >> 5.3M ./simulator-hotfix-trigger
> >> 8.0K ./cloudstack-maven-build-with-branch-parameter
> >> 2.7M ./test-yumrepo-refresh-master
> >> 1.3G ./cloudstack-4.5-hyperv-agent
> >> 1.6M ./Build-by-Branch
> >> 3.5G ./build-systemvm-master
> >> 369M ./package-deb-4.6
> >> 172K ./test-maintenance-operations-4.4 48K
> >> ./cloudstack-4.3-package-rpm-noredist
> >> 532K ./build-docs-vxlan-master
> >> 18M ./build-docs-devguide-master
> >> 456K ./test-environment-refresh-master 876K ./test-matrix-master 2.1M
> >> ./test-yumrepo-refresh-4.4 51M ./t

Re: jenkins disk full ?

2015-09-30 Thread David Nalley 
SGTM, Feel free to.



On Wed, Sep 30, 2015 at 5:34 AM, Daan Hoogland  wrote:
> H David, I just tried and it works indeed. Forgot about that. Does it make
> sense to have a script containing du mail to dev@ if something like
> /var/lib/jenkins/workspace or / exceeds a threshold? (yes me volunteering)
>
> On Wed, Sep 30, 2015 at 10:48 AM, Raja Pullela 
> wrote:
>
>> Btw, edison, pradeep, rayeesn - are not active anymore - talluri may be?
>>  I think.
>>
>> -Original Message-
>> From: David Nalley [mailto:da...@gnsa.us]
>> Sent: Wednesday, September 30, 2015 2:01 PM
>> To: dev@cloudstack.apache.org
>> Cc: Pierre-Luc Dion ; tall...@apache.org
>> Subject: Re: jenkins disk full ?
>>
>> Right now these folks have access:
>>
>> ewanm:x:1002:1002::/home/ewanm:/bin/bash
>> prasanna:x:1003:1003::/home/prasanna:/bin/bash
>> salvatore:x:1004:1004::/home/salvatore:/bin/bash
>> edison:x:1005:1005::/home/edison:/bin/bash
>> pradeep:x:1006:1006::/home/pradeep:/bin/bash
>> rayeesn:x:1007:1007::/home/rayeesn:/bin/bash
>> hugot:x:1008:1008::/home/hugot:/bin/bash
>> talluri:x:1009:1009::/home/talluri:/bin/bash
>> dahn:x:1010:1010::/home/dahn:/bin/bash
>>
>> PL or other folks who want access, send me a ssh pub key off list.
>>
>> --David
>>
>> On Wed, Sep 30, 2015 at 4:20 AM, Rajani Karuturi <
>> rajani.karut...@citrix.com> wrote:
>> > Thanks david. Do you know if anyone else has access to this? if not, can
>> you give access to PL please?
>> >
>> > ~Rajani
>> >
>> >
>> >
>> > On 30-Sep-2015, at 1:13 pm, David Nalley  wrote:
>> >
>> >> The below is before I cleaned up a bit. We now have 3.2GB free.
>> >>
>> >> [root@domU-12-31-39-15-22-2D jobs]# du -h -d 1 1.3G
>> >> ./package-rhel63-master 200M ./cloudstack-4.3-maven-build-noredist
>> >> 638M ./package-rhel63-4.5
>> >> 1.1G ./cloudstack-4.4-systemvm64
>> >> 1.3M ./build-4.5
>> >> 8.0K ./cloudstack-master-with-patch
>> >> 186M ./build-test-archive-4.4
>> >> 2.9M ./test-smoke-matrix-master
>> >> 100K ./Create-Release-Packages
>> >> 1.5M ./test-packaging-4.4
>> >> 214M ./build-test-archive-master
>> >> 612K ./cloudstack.apt-get.eu-systemvm 88M ./built-test-archive 4.2M
>> >> ./simulator-4.5-singlerun 424K ./test-tabnanny-4.4 2.2G
>> >> ./build-master 124M ./cloudstack-4.4-systemvm 331M
>> >> ./package-centos7-4.4.4-noredist 804K ./cloudstack-4.4-maven-build
>> >> 3.4M ./cloudstack-4.3-maven-build 645M ./package-centos7-master 80M
>> >> ./test-fetch-marvin-master 180M ./parameterized-slowbuild 508K
>> >> ./cloudstack.apt-get.eu-noredis-rhel
>> >> 104K ./dockerbuild-master-marvin
>> >> 9.1M ./test-regression-matrix-master
>> >> 345M ./cloudstack-4.3-package-deb
>> >> 3.8G ./parameterized-sytemvm
>> >> 26M ./HyperVAgent4.3
>> >> 510M ./cloudstack-4.3-package-rpm
>> >> 1.5M ./test-packaging-master
>> >> 7.2M ./build-docs-admin-master
>> >> 8.3M ./cloudstack-marvin-master
>> >> 1013M ./cloudstack-4.3-systemvm
>> >> 131M ./run-checkin-tests
>> >> 2.5M ./simulator-gate
>> >> 145M ./cloudstack-master-twiceweekly-coverity
>> >> 3.2M ./cloudstack-4.4-hyperv-agent
>> >> 104K ./test-setup-advancedzone-master 1.1G ./master-slowbuild 44M
>> >> ./cloudstack-master 301M ./package-centos7-master-noredist 396K
>> >> ./test-tabnanny-master 816K ./simulator-build 20K ./test-libcloud
>> >> 236K ./test-smoke-matrix-4.3 4.9M ./dockerbuild-4.5-simulator 331M
>> >> ./package-centos7-4.4-noredist 632K
>> >> ./cloudstack.apt-get.eu-noredis-deb
>> >> 144K ./dockerbuild-master-management_centos6
>> >> 292M ./package-centos6-4.6
>> >> 9.4M ./stop-jetty
>> >> 326M ./cloudstack-4.4-package-rpm
>> >> 40K ./mgmt-build-reviewboard-requests 20K ./build-test-centos-builtin
>> >> 76K ./simulator-deploydb 20K ./Master - Python Static Code Analysis
>> >> 53M ./test-smoke-matrix-4.4 442M ./build-master-slowbuild 376K
>> >> ./build-docs-niciranvp-master 840K ./test-matrix-4.4 2.7M
>> >> ./dockerbuild-master-simulator 21M ./build-docs-install-master 50M
>> >> ./test-fetch-marvin-4.4 789M
>> >> ./cloudstack-rpm-packages-with-branch-parameter
>> >> 5.3G ./build-systemvm-4.5
>> >> 1.1G ./cloudstack-4.3-systemvm64
>> >> 3.2M ./build-docs-release-notes-master 8.0K
>> >> ./cloudstack-master-codecoverage 121M ./fastsimulatorbuild 4.3M
>> >> ./cloudstack-4.4-marvin 352M ./build-master-noredist 7.2M
>> >> ./test-setup-advancedzone-4.4 3.3M ./cloudstack-master-hyperv-agent
>> >> 1.9G ./build-systemvm64-master 29M ./start-jetty 3.4M
>> >> ./simulator-4.4-integration-tests 264M ./build-4.5-noredist 2.0G
>> >> ./package-deb-master 576K ./build-master-simulator 137M
>> >> ./mgmt-update-nonoss-libs 11M ./test-matrix-extended-master 235M
>> >> ./cloudstack-4.4-maven-build-noredist
>> >> 5.3M ./simulator-hotfix-trigger
>> >> 8.0K ./cloudstack-maven-build-with-branch-parameter
>> >> 2.7M ./test-yumrepo-refresh-master
>> >> 1.3G ./cloudstack-4.5-hyperv-agent
>> >> 1.6M ./Build-by-Branch
>> >> 3.5G ./build-systemvm-master
>> >> 369M ./package-deb-4.6
>> >> 172K ./test-maintenance-operations-4.4 48K
>> >> ./cloudstack-4.3-package-rpm

RE: BVT report 9/29

2015-09-30 Thread Raja Pullela 
thanks Miguel for confirming!  I will get the PR to close this out.  

-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: Wednesday, September 30, 2015 2:57 PM
To: Miguel Ferreira 
Cc: dev@cloudstack.apache.org
Subject: Re: BVT report 9/29

Thanks a lot Miguel, 

> On Sep 30, 2015, at 11:15 AM, Miguel Ferreira  
> wrote:
> 
> All,
> 
> Following the instructions I had posted in the original PR 
> (https://github.com/apache/cloudstack/pull/741#issuecomment-135415998) I can 
> reproduce the same result. That is, the test passes against the simulator 
> with an Advanced zone:
>> [root@cs1 cloudstack]# nosetests --with-marvin 
>> --marvin-config=setup/dev/advanced.cfg   
>> test/integration/smoke/test_scale_vm.py -s -a 
>> tags=advanced,required_hardware=false   --zone=Sandbox-simulator 
>> --hypervisor=simulator
>> 
>>  Marvin Init Started 
>> 
>> === Marvin Parse Config Successful ===
>> 
>> === Marvin Setting TestData Successful===
>> 
>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_42_56_AFB6G9. 
>> All logs will be available here 
>> 
>> === Marvin Init Logging Successful===
>> 
>>  Marvin Init Successful 
>> === TestName: test_02_scale_vm_without_hypervisor_specifics | Status 
>> : SUCCESS ===
>> 
>> ===final results are now copied to: 
>> /tmp//MarvinLogs/test_scale_vm_AKT78U===
> 
> 
> I could reproduce the error reported here 
> https://issues.apache.org/jira/browse/CLOUDSTACK-8924 by running both test 1 
> and test 2 together (toggling require hardware to false in test 1).
>> [root@cs1 cloudstack]# nosetests --with-marvin 
>> --marvin-config=setup/dev/advanced.cfg   
>> test/integration/smoke/test_scale_vm.py -s -a 
>> tags=advanced,required_hardware=false   --zone=Sandbox-simulator 
>> --hypervisor=simulator
>> 
>>  Marvin Init Started 
>> 
>> === Marvin Parse Config Successful ===
>> 
>> === Marvin Setting TestData Successful===
>> 
>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_46_16_U8QJEI. 
>> All logs will be available here 
>> 
>> === Marvin Init Logging Successful===
>> 
>>  Marvin Init Successful 
>> === TestName: test_01_scale_vm | Status : SUCCESS ===
>> 
>> === TestName: test_02_scale_vm_without_hypervisor_specifics | Status 
>> : EXCEPTION ===
>> 
>> ===final results are now copied to: 
>> /tmp//MarvinLogs/test_scale_vm_4DVZLG===
> 
> 
> That seems to me like cleanup is not being performed between the two tests.
> However, like Raja already indicated in the JIRA issue, we wouldn’t need test 
> 2 if test 1 works well in the simulator (as it seems to work). 
> In short, we could get rid of test 
> “test_02_scale_vm_without_hypervisor_specifics” altogether.
> 
> Having adapted the basic.cfg (basic zone config) to enable vm scaling, I can 
> reproduce the same results. Test 
> “test_02_scale_vm_without_hypervisor_specifics" by it self passes.
> 
>> [root@cs1 cloudstack]# nosetests --with-marvin 
>> --marvin-config=setup/dev/advanced.cfg   
>> test/integration/smoke/test_scale_vm.py -s -a 
>> tags=basic,required_hardware=false   --zone=Sandbox-simulator 
>> --hypervisor=simulator
>> 
>>  Marvin Init Started 
>> 
>> === Marvin Parse Config Successful ===
>> 
>> === Marvin Setting TestData Successful===
>> 
>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_09_11_44_KWEPUS. 
>> All logs will be available here 
>> 
>> === Marvin Init Logging Successful===
>> 
>>  Marvin Init Successful 
>> === TestName: test_02_scale_vm_without_hypervisor_specifics | Status 
>> : SUCCESS ===
>> 
>> ===final results are now copied to: 
>> /tmp//MarvinLogs/test_scale_vm_2IQ0MJ===
> 
> 
> Running both tests together fails due to missing cleanup between tests:
>> [root@cs1 cloudstack]# nosetests --with-marvin 
>> --marvin-config=setup/dev/advanced.cfg   
>> test/integration/smoke/test_scale_vm.py -s -a 
>> tags=basic,required_hardware=false   --zone=Sandbox-simulator 
>> --hypervisor=simulator
>> 
>>  Marvin Init Started 
>> 
>> === Marvin Parse Config Successful ===
>> 
>> === Marvin Setting TestData Successful===
>> 
>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_09_13_45_5NC2QK. 
>> All logs will be available here 
>> 
>> === Marvin Init Logging Successful===
>> 
>>  Marvin Init Successful 
>> === TestName: test_01_scale_vm | Status : SUCCESS ===
>> 
>> === TestName: test_02_scale_vm_without_hypervisor_specifics | Status 
>> : EXCEPTION ===
>> 
>> ===final results are now copied to: 
>> /tmp//MarvinLogs/test_scale_vm_FUCV6R===
> 
> 
> Cheers,
> \ Miguel Ferreira
>mferre...@schubergphilis.com
> 
> 
> 
> 
>> On 30 Sep 2015, at 10:17, Raja Pullela  wrote:
>> 
>> Miguel, please see the defect 
>> https://issues.apache.org/jira/browse/CLOUDSTACK-8924
>> Let me know if you have any questions, Raja
>> 
>> -Original Message-
>> From: Miguel Ferreira [mailto:mferre...@schubergphilis.com]
>> Sent: Wednesday, September 30, 2015 1:43 PM
>> To: Sebastien Goasguen 
>> Cc

Re: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Daan Hoogland 
I disagree, and let me carefully try to formulate why: BVT is useful and
'should' be run before any thing is declared good. The problem is the
ability for the community at large to run it and to fix it for any kind of
set-up. It should not be automatically treated as blockers but only if a
full analysis points to a root cause that can be considered a blocker.

that said we should still work towards a test set that can function as the
you describe the BVT and be automatically adding blockers.

regards,

On Wed, Sep 30, 2015 at 11:28 AM, Rajani Karuturi <
rajani.karut...@citrix.com> wrote:

> I agree with Raja. BVT test case failures should be treated as blockers.
> Once the test issue is fixed, they might uncover new issues/regressions.
>
> ~Rajani
>
>
>
> On 30-Sep-2015, at 2:32 pm, Raja Pullela  wrote:
>
> > The problem needs to be fixed - "have tested a solution that was
> discussed with koushik" - we will have to create PR with that change.  Once
> the PR is pushed - we will have one less blocker/test failure.
> >
> > I agree this is not a cloudstack core code problem - but we should NOT
> make that a criteria for priority of a bug - just my take.  We should
> include BVT failures in the Blocker criteria (whether the fix is in the
> core functionality/test script).  Otherwise, we will not hit 100% passrate
> on BVTs.
> >
> > You are right - only a subset of these tests are being run on "travis"
> otherwise we will catch more or some of these failures.
> >
> > -Original Message-
> > From: Sebastien Goasguen [mailto:run...@gmail.com]
> > Sent: Wednesday, September 30, 2015 2:09 PM
> > To: dev@cloudstack.apache.org
> > Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> >
> >
> >> On Sep 30, 2015, at 10:28 AM, Raja Pullela 
> wrote:
> >>
> >> Yup... btw, I am on top of this and goal is to get to 100% passrate on
> BVTs!
> >>
> >
> > Yes I got it, and we all have the same goal.
> >
> > It does appear that not all smoke tests are run by Travis, otherwise we
> would catch any errors on simulator for every PR.
> >
> > My point is that if a failure in your BVT is due to the test itself it
> is not a cloudstack failure per se and hence not a blocker. Which all said
> and done is not a problem because it should be fixed now if I am
> understanding your assessment and Koushik report of this failure correctly.
> >
> >
> >
> >> -Original Message-
> >> From: Sebastien Goasguen [mailto:run...@gmail.com]
> >> Sent: Wednesday, September 30, 2015 1:48 PM
> >> To: dev@cloudstack.apache.org
> >> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> >>
> >>
> >>> On Sep 30, 2015, at 10:15 AM, Raja Pullela 
> wrote:
> >>>
> >>> Sebastien, any BVT tests failing is a blocker and needs to be fixed -
> which is the reason for Blocker.  We already have a fix.
> >>>
> >>
> >> Right, but that’s a fix in the test itself, no an issue with the
> cloudstack “core”.
> >>
> >> In any case, great, one less blocker.
> >>
> >>> Koushik,
> >>>
> >>> modified the test "test_01_scale_vm" with required_hardware=false on
> simulator setup and it works.  So, I think we can let the second method
> go.  I will also test this on XS.
> >>> Raja
> >>>
> >>>
> >>> root@localhost:~/cloudstack# nosetests --with-marvin
> >>> --marvin-config=/root/cloudstack/setup/dev/local1.cfg
> >>> --zone=Sandbox-simulator --hypervisor=simulator -a
> >>> tags=basic,required_hardware=false
> >>> /root/cloudstack/test/integration/smoke/test_scale_vm.py
> >>>
> >>>  Marvin Init Started 
> >>>
> >>> === Marvin Parse Config Successful ===
> >>>
> >>> === Marvin Setting TestData Successful===
> >>>
> >>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_06_32_AWNF1O.
> >>> All logs will be available here 
> >>>
> >>> === Marvin Init Logging Successful===
> >>>
> >>>  Marvin Init Successful 
> >>> ===final results are now copied to:
> >>> /tmp//MarvinLogs/test_scale_vm_OPS7AD===
> >>> root@localhost:~/cloudstack# cd /tmp//MarvinLogs/test_scale_vm_OPS7AD
> >>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls
> >>> failed_plus_exceptions.txt  results.txt  runinfo.txt
> >>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# vi  results.txt
> >>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls -al total 48
> >>> drwxr-xr-x 2 root root  4096 Sep 30 08:07 .
> >>> drwxr-xr-x 8 root root  4096 Sep 30 08:06 ..
> >>> -rw-r--r-- 1 root root 0 Sep 30 08:06 failed_plus_exceptions.txt
> >>> -rw-r--r-- 1 root root   186 Sep 30 08:06 results.txt
> >>> -rw-r--r-- 1 root root 36164 Sep 30 08:06 runinfo.txt
> >>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD#
> >>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# cat results.txt
> >>> Test scale virtual machine ... === TestName: test_01_scale_vm |
> >>> Status
> >>> : SUCCESS === ok
> >>>
> >>> -
> >>> -
> >>> Ran 1 test in 23.455s
> >>>
> >>> OK
> >>>
> >>> -Original Message-
> >>> F

[GitHub] cloudstack pull request: CLOUDSTACK-8894: Restrict vGPU enabled VM...

2015-09-30 Thread anshul1886 
Github user anshul1886 commented on the pull request:

https://github.com/apache/cloudstack/pull/868#issuecomment-144341943
  
@runseb It seems like simulator does't have support for vGPU. If I find 
some time then I will try to add support for it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8911: VM start job got stuck i...

2015-09-30 Thread koushik-das 
Github user koushik-das commented on the pull request:

https://github.com/apache/cloudstack/pull/895#issuecomment-144343011
  
LGTM. Have verified the scenario for max. guest limit.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8924: Removed duplicate test f...

2015-09-30 Thread sanju1010 
GitHub user sanju1010 opened a pull request:

https://github.com/apache/cloudstack/pull/900

CLOUDSTACK-8924: Removed duplicate test from test_scale_vm.py

Please go through CS-8924 for more details.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sanju1010/cloudstack scale_vm

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/900.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #900


commit 33bdfc773a39d7ff245fb4f50299a7b6cc0391ef
Author: sanjeev 
Date:   2015-09-30T09:53:30Z

CLOUDSTACK-8924: Removed duplicate test from test_scale_vm.py




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8924: Removed duplicate test f...

2015-09-30 Thread sanju1010 
Github user sanju1010 commented on the pull request:

https://github.com/apache/cloudstack/pull/900#issuecomment-144344567
  
root@localhost:~/cloudstack# nosetests --with-marvin 
--marvin-config=/root/cloudstack/setup/dev/local1.cfg --zone=Sandbox-simulator 
--hypervisor=simulator -a tags=basic,required_hardware=false 
/root/cloudstack/test/integration/smoke/test_scale_vm.py

 Marvin Init Started 

=== Marvin Parse Config Successful ===

=== Marvin Setting TestData Successful===

 Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_06_32_AWNF1O. All 
logs will be available here 

=== Marvin Init Logging Successful===

 Marvin Init Successful 
===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_OPS7AD===
root@localhost:~/cloudstack# cd /tmp//MarvinLogs/test_scale_vm_OPS7AD
root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls
failed_plus_exceptions.txt  results.txt  runinfo.txt
root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# vi  results.txt
root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls -al
total 48
drwxr-xr-x 2 root root  4096 Sep 30 08:07 .
drwxr-xr-x 8 root root  4096 Sep 30 08:06 ..
-rw-r--r-- 1 root root 0 Sep 30 08:06 failed_plus_exceptions.txt
-rw-r--r-- 1 root root   186 Sep 30 08:06 results.txt
-rw-r--r-- 1 root root 36164 Sep 30 08:06 runinfo.txt
root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD#
root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# cat results.txt
Test scale virtual machine ... === TestName: test_01_scale_vm | Status : 
SUCCESS ===
ok

--
Ran 1 test in 23.455s

OK


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack-docs pull request: The help topic created for the DHCP/...

2015-09-30 Thread rajsekharkpally 
GitHub user rajsekharkpally opened a pull request:

https://github.com/apache/cloudstack-docs/pull/11

The help topic created for the DHCP/DNS offload and Config Drive support 
feature

The help topic that describes the DHCP/DNS offload and Config drive support 
feature has been added (external-dhcp-dns.xml). 

The design document for this feature is available at: 
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53740797 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/rajsekharkpally/cloudstack-docs 
DHCP-DNS-Offload

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack-docs/pull/11.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #11


commit 7b1bcd160785ed8f808b2be5ae96905816c72085
Author: Rajsekhar K 
Date:   2015-09-30T09:53:22Z

The help topic created for the DHCP/DNS offload and Config Drive support 
feature.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: Cloudstack-8885 added blocked connection ...

2015-09-30 Thread remibergsma 
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/857#issuecomment-144345855
  
@runseb In a prefect world, one would still run the tests against it to 
verify they still all pass. Maybe we can execute the basic VM life cycle test 
(smoke/test_vm_life_cycle.py) and merge if that passes?

```
nosetests --with-marvin --marvin-config=${marvinCfg} -s -a 
tags=advanced,required_hardware=false smoke/test_vm_life_cycle.py
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8924: Removed duplicate test f...

2015-09-30 Thread pvr9711 
Github user pvr9711 commented on the pull request:

https://github.com/apache/cloudstack/pull/900#issuecomment-144346102
  
LGTM!  Thanks Sanjeev!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8879: Depend in rados-java 0.2...

2015-09-30 Thread remibergsma 
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/889#issuecomment-144346492
  
@wido maybe @borisroman can execute smoke/test_vm_life_cycle.py to do a 
quick check? 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8879: Depend in rados-java 0.2...

2015-09-30 Thread borisroman 
Github user borisroman commented on the pull request:

https://github.com/apache/cloudstack/pull/889#issuecomment-144346818
  
Will do.


Best regards,

Boris Schrijver

TEL: +31633784542
MAIL: bo...@pcextreme.nl


> On September 30, 2015 at 12:11 PM Remi Bergsma 
> wrote:
> 
> 
> @wido  maybe @borisroman
>  can execute smoke/test_vm_life_cycle.py 
to do
> a quick check?
> 
> —
> Reply to this email directly or view it on GitHub
>  .
> 
>  
> 





---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8848: ensure power state is up...

2015-09-30 Thread resmo 
Github user resmo commented on the pull request:

https://github.com/apache/cloudstack/pull/885#issuecomment-144346880
  
well I need it in 4.5.3. I would suggest we take this fix for now for 4.6 
as well and make a proper refactor for 4.7/5.0.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8879: Depend in rados-java 0.2...

2015-09-30 Thread remibergsma 
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/889#issuecomment-144346920
  
@borisroman thank you!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8906: /var/log/cloud/ doesn't ...

2015-09-30 Thread koushik-das 
Github user koushik-das commented on the pull request:

https://github.com/apache/cloudstack/pull/883#issuecomment-144347154
  
@SudharmaJain Why can't the XenServer600Resource be used to handle XS 6.0.2 
hosts? The only change I see is the patch script 
(scripts/vm/hypervisor/xenserver/xenserver602/patch). If the content of the 
patch file is same as that of scripts/vm/hypervisor/xenserver/xenserver60/patch 
then there is no need for a separate 6.0.2 resource, PR #861 should be used 
instead.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8888: Xenserver 6.0.2 host stu...

2015-09-30 Thread koushik-das 
Github user koushik-das commented on the pull request:

https://github.com/apache/cloudstack/pull/861#issuecomment-144347634
  
I have updated #883 with my comments, looking at the changes it shouldn't 
be required. Lets wait for @SudharmaJain response


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8808: Successfully registered ...

2015-09-30 Thread karuturi 
GitHub user karuturi opened a pull request:

https://github.com/apache/cloudstack/pull/901

CLOUDSTACK-8808: Successfully registered VHD template is downloaded again 
due to missing virtualsize property in template.properties

We have multiple file processors to process different types of image
formats. The processor interface has two methods getVirtualSize() and
process().

1.  getVirtualSize() as the name says, returns the virtual size of
the file and is used at get the size while copying files from NFS to s3
2.  process() returns FormatInfo struct which has fileType, size,
virutalSize, filename.  on successfully downloading a template, each
file is passed to all the processors.process() and whichever returns a
FormatInfo, that will be used to create template.properties file.  If
process() throws an InternalErrorException, template installation fails.
But, if process() returns null, template registration is successful with
template.properties missing some attributes like virtualSize, file
format etc. which results in this bug on restart of ssvm/cloud
service/management server.

failing the template download if virutalsize or some other properties
cannot be determined.

The following changes are done:
getVirtualSize() to always return size(if it can calculate, get virtual
size else return file size). This would mean the following changes

1. QCOW2Processor.getVirtualSize() to return file size if virtual
size calculation fails
2. VHDProcessor.getVirtualSize() to return file size if virtual size
calculation fails

process() to throw InternalErrorException if virtual size calculation
fails or any other exceptions occur. This would mean the following
changes

1. OVAProcessor to throw InternalErrorException if untar fails
2. QCOW2Processor to throw InternalErrorException if virtual size
calculation fails
3. VHDProcessor to throw InternalErrorException if virtual size
calculation fails

Testing:
added unittests for the changes in the file processors.
manual test:
setup: host xenserver 6.5, management server centos 6.7
template: disk created using the process specified by andy at 
https://issues.apache.org/jira/browse/CLOUDSTACK-8808?focusedCommentId=14933368
tried to register the template and it failed with an error. Template never 
moved to Ready state.
![screen shot 2015-09-30 at 3 53 34 
pm](https://cloud.githubusercontent.com/assets/186833/10190608/76bcce92-678b-11e5-8f52-b449d149300b.png)



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/karuturi/cloudstack CLOUDSTACK-8808

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/901.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #901


commit 1056171aca8816492c16c5bdf8f963745f968b5d
Author: Rajani Karuturi 
Date:   2015-09-29T16:25:23Z

CLOUDSTACK-8808: Successfully registered VHD template is downloaded
again due to missing virtualsize property in template.properties

We have multiple file processors to process different types of image
formats. The processor interface has two methods getVirtualSize() and
process().

1. getVirtualSize() as the name says, returns the virtual size of
the file and is used at get the size while copying files from NFS to s3
2. process() returns FormatInfo struct which has fileType, size,
virutalSize, filename.  on successfully downloading a template, each
file is passed to all the processors.process() and whichever returns a
FormatInfo, that will be used to create template.properties file.  If
process() throws an InternalErrorException, template installation fails.
But, if process() returns null, template registration is successful with
template.properties missing some attributes like virtualSize, file
format etc. which results in this bug on restart of ssvm/cloud
service/management server.

failing the template download if virutalsize or some other properties
cannot be determined.

The following changes are done:
getVirtualSize() to always return size(if it can calculate, get virtual
size else return file size). This would mean the following changes

1. QCOW2Processor.getVirtualSize() to return file size if virtual
size calculation fails
2. VHDProcessor.getVirtualSize() to return file size if virtual size
calculation fails

process() to throw InternalErrorException if virtual size calculation
fails or any other exceptions occur. This would mean the following
changes

1. OVAProcessor to throw InternalErrorException if untar fails
2. QCOW2Processor to th

[GitHub] cloudstack pull request: CLOUDSTACK-8924: Removed duplicate test f...

2015-09-30 Thread koushik-das 
Github user koushik-das commented on the pull request:

https://github.com/apache/cloudstack/pull/900#issuecomment-144348817
  
LGTM. Since now test_01_scale_vm can be run on simulator, no need for the 
other one.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: CloudStack networking documentation

2015-09-30 Thread Sebastien Goasguen 
Pinging Paul Angus, who can surely answer these questions.
We can then edit the docs.

> On Sep 29, 2015, at 7:03 AM, Ron Wheeler  
> wrote:
> 
> http://docs.cloudstack.apache.org/en/master/concepts.html#what-is-apache-cloudstack
> 
> In the opening paragraph of About Physical Networks" it says
> "The network corresponds to a NIC on the hypervisor host."
> 
> In Basic Zone Network Traffic Types it says that there is only one physical 
> network in the zone but later on in the middle of discussing the various 
> traffic types there is a note
> "We strongly recommend the use of separate NICs for management traffic and 
> guest traffic".
> There is no reason given for this statement.
> No suggestion about what tradeoff is being made if you go with a single NIC.
> Is it performance or security concerns that prompts this?
> 
> It might be helpful to describe what is meant by a single physical network 
> with multiple NICs.
> 
> The note itself appears to be out of place since it is in the middle of some 
> definitions rather that in a discussion block.
> It also looks like it applies to Advanced Networks but is missing in that 
> section.
> 
> "CIDR of the pod" is used without any description of what this is and how it 
> gets setup.
> Might be helpful to add a sentence or two about this. It seems important.
> 
> "guest virtual router" is another concept that seems important but has no 
> definition or discussion.
> 
> Ron
> 
> -- 
> Ron Wheeler
> President
> Artifact Software Inc
> email: rwhee...@artifact-software.com
> skype: ronaldmwheeler
> phone: 866-970-2435, ext 102
>

Re: OVS documentation

2015-09-30 Thread Sebastien Goasguen 

> On Sep 29, 2015, at 2:06 PM, Ron Wheeler  
> wrote:
> 
> Can someone fix this?
> 

Honestly Ron, the issue is that very few people are actually using the GRE 
isolation.

One would need to test it with the latest cloudstack 4.5.2 and latest OVS to 
see if it works with newer versions….

-sebastien

> Does anyone know what the correct recommendation should be?
> 
> Is anyone interested in the documentation?

Of course...

> I am trying to read it all with an outsider's eye and identify areas that I 
> have trouble understanding.
> Is it customary to use the Dev list or just create JIRA Issues.
> 

for questions from the user side, usually it’s better to hit the users@ list.
But you can create JIRA issues as well, if it’s an error.

Ideally, once you test it on newer versions, you can also submit a github PR to 
make the required change in the docs. We will happily merge.

> 
> Ron
> 
> On 29/09/2015 2:18 AM, Nguyen Anh Tu wrote:
>> Dear Ron,
>> 
>> It's old I believe.
>> 
>> --Tuna
>> 
>> On Tue, Sep 29, 2015 at 1:05 PM, Ron Wheeler > > wrote:
>> 
>>http://docs.cloudstack.apache.org/en/master/networking/ovs-plugin.html
>>has the following sentence:
>>"CentOS 6.4 and OpenvSwitch 1.10 are recommended." These seem to
>>be very old. Are they really the recommended versions?
>> 
>>Ron
>> 
>>-- Ron Wheeler
>>President
>>Artifact Software Inc
>>email: rwhee...@artifact-software.com
>>
>>skype: ronaldmwheeler
>>phone: 866-970-2435, ext 102
>> 
>> 
> 
> 
> -- 
> Ron Wheeler
> President
> Artifact Software Inc
> email: rwhee...@artifact-software.com
> skype: ronaldmwheeler
> phone: 866-970-2435, ext 102
>

Re: jenkins disk full ?

2015-09-30 Thread Daan Hoogland 
So I did, expressing my worst operator practices I created a small script:


! /bin/bash

THRESHOLD=95
USAGE=`/bin/df -P /var/lib/jenkins/workspace  | /bin/grep -v Capacity |
/bin/cut -c 47-  | /bin/cut -c 6-7 `

function maildev() {
  /bin/mail -s 'disk usage at jenkins.bac.o' dev@cloudstack.apache.org <<
EOT
`/bin/df -P /var/lib/jenkins/workspace`
EOT
}

[[ $USAGE > $THRESHOLD ]] && maildev


and added it to cron:

*/10 * * * * ( cd /var/lib/jenkins && ./check_workspace.sh ) >/dev/null

There I noticed some traces of puppet usage. Should I implement this in
puppet somehow?

willing to do some more,
Daan

On Wed, Sep 30, 2015 at 11:40 AM, David Nalley  wrote:

> SGTM, Feel free to.
>
>
>
> On Wed, Sep 30, 2015 at 5:34 AM, Daan Hoogland 
> wrote:
> > H David, I just tried and it works indeed. Forgot about that. Does it
> make
> > sense to have a script containing du mail to dev@ if something like
> > /var/lib/jenkins/workspace or / exceeds a threshold? (yes me
> volunteering)
> >
> > On Wed, Sep 30, 2015 at 10:48 AM, Raja Pullela 
> > wrote:
> >
> >> Btw, edison, pradeep, rayeesn - are not active anymore - talluri may be?
> >>  I think.
> >>
> >> -Original Message-
> >> From: David Nalley [mailto:da...@gnsa.us]
> >> Sent: Wednesday, September 30, 2015 2:01 PM
> >> To: dev@cloudstack.apache.org
> >> Cc: Pierre-Luc Dion ; tall...@apache.org
> >> Subject: Re: jenkins disk full ?
> >>
> >> Right now these folks have access:
> >>
> >> ewanm:x:1002:1002::/home/ewanm:/bin/bash
> >> prasanna:x:1003:1003::/home/prasanna:/bin/bash
> >> salvatore:x:1004:1004::/home/salvatore:/bin/bash
> >> edison:x:1005:1005::/home/edison:/bin/bash
> >> pradeep:x:1006:1006::/home/pradeep:/bin/bash
> >> rayeesn:x:1007:1007::/home/rayeesn:/bin/bash
> >> hugot:x:1008:1008::/home/hugot:/bin/bash
> >> talluri:x:1009:1009::/home/talluri:/bin/bash
> >> dahn:x:1010:1010::/home/dahn:/bin/bash
> >>
> >> PL or other folks who want access, send me a ssh pub key off list.
> >>
> >> --David
> >>
> >> On Wed, Sep 30, 2015 at 4:20 AM, Rajani Karuturi <
> >> rajani.karut...@citrix.com> wrote:
> >> > Thanks david. Do you know if anyone else has access to this? if not,
> can
> >> you give access to PL please?
> >> >
> >> > ~Rajani
> >> >
> >> >
> >> >
> >> > On 30-Sep-2015, at 1:13 pm, David Nalley  wrote:
> >> >
> >> >> The below is before I cleaned up a bit. We now have 3.2GB free.
> >> >>
> >> >> [root@domU-12-31-39-15-22-2D jobs]# du -h -d 1 1.3G
> >> >> ./package-rhel63-master 200M ./cloudstack-4.3-maven-build-noredist
> >> >> 638M ./package-rhel63-4.5
> >> >> 1.1G ./cloudstack-4.4-systemvm64
> >> >> 1.3M ./build-4.5
> >> >> 8.0K ./cloudstack-master-with-patch
> >> >> 186M ./build-test-archive-4.4
> >> >> 2.9M ./test-smoke-matrix-master
> >> >> 100K ./Create-Release-Packages
> >> >> 1.5M ./test-packaging-4.4
> >> >> 214M ./build-test-archive-master
> >> >> 612K ./cloudstack.apt-get.eu-systemvm 88M ./built-test-archive 4.2M
> >> >> ./simulator-4.5-singlerun 424K ./test-tabnanny-4.4 2.2G
> >> >> ./build-master 124M ./cloudstack-4.4-systemvm 331M
> >> >> ./package-centos7-4.4.4-noredist 804K ./cloudstack-4.4-maven-build
> >> >> 3.4M ./cloudstack-4.3-maven-build 645M ./package-centos7-master 80M
> >> >> ./test-fetch-marvin-master 180M ./parameterized-slowbuild 508K
> >> >> ./cloudstack.apt-get.eu-noredis-rhel
> >> >> 104K ./dockerbuild-master-marvin
> >> >> 9.1M ./test-regression-matrix-master
> >> >> 345M ./cloudstack-4.3-package-deb
> >> >> 3.8G ./parameterized-sytemvm
> >> >> 26M ./HyperVAgent4.3
> >> >> 510M ./cloudstack-4.3-package-rpm
> >> >> 1.5M ./test-packaging-master
> >> >> 7.2M ./build-docs-admin-master
> >> >> 8.3M ./cloudstack-marvin-master
> >> >> 1013M ./cloudstack-4.3-systemvm
> >> >> 131M ./run-checkin-tests
> >> >> 2.5M ./simulator-gate
> >> >> 145M ./cloudstack-master-twiceweekly-coverity
> >> >> 3.2M ./cloudstack-4.4-hyperv-agent
> >> >> 104K ./test-setup-advancedzone-master 1.1G ./master-slowbuild 44M
> >> >> ./cloudstack-master 301M ./package-centos7-master-noredist 396K
> >> >> ./test-tabnanny-master 816K ./simulator-build 20K ./test-libcloud
> >> >> 236K ./test-smoke-matrix-4.3 4.9M ./dockerbuild-4.5-simulator 331M
> >> >> ./package-centos7-4.4-noredist 632K
> >> >> ./cloudstack.apt-get.eu-noredis-deb
> >> >> 144K ./dockerbuild-master-management_centos6
> >> >> 292M ./package-centos6-4.6
> >> >> 9.4M ./stop-jetty
> >> >> 326M ./cloudstack-4.4-package-rpm
> >> >> 40K ./mgmt-build-reviewboard-requests 20K ./build-test-centos-builtin
> >> >> 76K ./simulator-deploydb 20K ./Master - Python Static Code Analysis
> >> >> 53M ./test-smoke-matrix-4.4 442M ./build-master-slowbuild 376K
> >> >> ./build-docs-niciranvp-master 840K ./test-matrix-4.4 2.7M
> >> >> ./dockerbuild-master-simulator 21M ./build-docs-install-master 50M
> >> >> ./test-fetch-marvin-4.4 789M
> >> >> ./cloudstack-rpm-packages-with-branch-parameter
> >> >> 5.3G ./build-systemvm-4.5
> >> >> 1.1G ./cloudstack-4.3-systemvm64
> >> >> 3.2M ./build-docs-release-notes-m

[GitHub] cloudstack pull request: CLOUDSTACK-8913: Search box in Templates ...

2015-09-30 Thread nitin-maharana 
Github user nitin-maharana commented on the pull request:

https://github.com/apache/cloudstack/pull/891#issuecomment-144361240
  
Hi @runseb, Added two snapshots of before change and after change.

Before Change:

![pr_891_before_change](https://cloud.githubusercontent.com/assets/12583725/10191319/669fd8ce-6790-11e5-9a01-cccb96b7a500.png)

After Change:

![pr_891_after_change](https://cloud.githubusercontent.com/assets/12583725/10191325/7597eb1e-6790-11e5-93fb-bc9cdac2e15b.png)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8848: ensure power state is up...

2015-09-30 Thread DaanHoogland 
Github user DaanHoogland commented on the pull request:

https://github.com/apache/cloudstack/pull/885#issuecomment-144361517
  
ok, no further comment (please see the possible null pointer one)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8913: Search box in Templates ...

2015-09-30 Thread runseb 
Github user runseb commented on the pull request:

https://github.com/apache/cloudstack/pull/891#issuecomment-144361701
  
@nitin-maharana thanks for this. 
LGTM +1 based on code review and look at snapshot.
Somehow might want to compile and test fresh.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8656: tests ignoring exception...

2015-09-30 Thread DaanHoogland 
Github user DaanHoogland commented on the pull request:

https://github.com/apache/cloudstack/pull/850#issuecomment-144363576
  
@borisroman the expeted attribute is not there and as I understand with 
reason. The exceptions are part of the contract and need to be handled by the 
client. The test needs to verify the result irrespectively. @koushik-das Do I 
formulate this correct?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8808: Successfully registered ...

2015-09-30 Thread borisroman 
Github user borisroman commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/901#discussion_r40784661
  
--- Diff: core/src/com/cloud/storage/template/QCOW2Processor.java ---
@@ -75,6 +76,16 @@ public FormatInfo process(String templatePath, 
ImageFormat format, String templa
 
 @Override
 public long getVirtualSize(File file) throws IOException {
+try {
+long size = getTemplateVirtualSize(file);
--- End diff --

@karuturi Could you please use the QCOW2Utils.getVirtualSize() from the 
com.cloud.utils.storage package instead of using the function defined in the 
QCOW2Processor? :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8848: ensure power state is up...

2015-09-30 Thread remibergsma 
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/885#issuecomment-144377723
  
@resmo Just a heads-up that I am testing this as we speak. Running the BVT 
tests against this branch to verify it all works. Once everything is done I'll 
post results. It takes a while for it all to run.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

RE: test_nicira_controller.py is failing on all Advzone - XS, KVM

2015-09-30 Thread Raja Pullela 
thanks Miguel !

From: Miguel Ferreira [mailto:mferre...@schubergphilis.com]
Sent: Wednesday, September 30, 2015 3:01 PM
To: Raja Pullela 
Cc: dev 
Subject: Re: test_nicira_controller.py is failing on all Advzone - XS, KVM

Hi Raja,

That test needs a NSX cluster. With that in place, the configuration used to 
run the test must define a section called NiciraNvp, and that section should 
have an array os hosts with that name (see line 46 of the test).
In a Marvin config that materializes in something like this:
"niciraNvp": {

"hosts": [ "nsxcon1.cloud.lan", "nsxcon2.cloud.lan" ]
}

Furthermore, you need to have a zone configured to use NSX and that requires 
more work.
You can find a full Marvin config for it here: 
https://github.com/schubergphilis/MCT-shared/blob/master/marvin/mct-zone1-kvm1-NVP.cfg
In that same git repo there are config files for deploying a NSX cluster 
(https://github.com/schubergphilis/MCT-shared/blob/master/deploy/cloud/nsx_cluster.conf).
However, we have not yet fully automated all the steps needed to get the 
cluster up and running (ie. setting up the cluster internals, and adding a more 
controllers to the cluster).
I can help you with that if you need.

Cheers,
\ Miguel Ferreira
   mferre...@schubergphilis.com



On 30 Sep 2015, at 09:05, Raja Pullela 
mailto:raja.pull...@citrix.com>> wrote:

Hi Miguel or someone's familiar with this test,

Can you please provide documentation around how to get these tests running ?
BTW - looks like this is a new test that was added on Aug 25th 2015.

Thanks,
Raja

=== TestName: None | Status : EXCEPTION ===
ERROR

==
ERROR: test suite for 
--
Traceback (most recent call last):
 File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 209, in run
   self.setUp()
 File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 292, in setUp
   self.setupContext(ancestor)
 File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 315, in 
setupContext
   try_run(context, names)
 File "/usr/local/lib/python2.7/dist-packages/nose/util.py", line 470, in 
try_run
   return func()
 File "/root/cloudstack/test/integration/smoke/test_nicira_controller.py", line 
46, in setUpClass
   cls.nicira_hosts  = cls.config.niciraNvp.hosts
AttributeError: 'NoneType' object has no attribute 'hosts'
 >> begin captured stdout << -
=== TestName: None | Status : EXCEPTION ===


- >> end captured stdout << --
 >> begin captured logging << 
CSLog: CRITICAL: EXCEPTION: None: ['Traceback (most recent call last):\n', '  
File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 209, in run\n 
   self.setUp()\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 292, in setUp\n
self.setupContext(ancestor)\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 315, in 
setupContext\ntry_run(context, names)\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/util.py", line 470, in try_run\n   
 return func()\n', '  File 
"/root/cloudstack/test/integration/smoke/test_nicira_controller.py", line 46, 
in setUpClass\ncls.nicira_hosts  = cls.config.niciraNvp.hosts\n', 
"AttributeError: 'NoneType' object has no attribute 'hosts'\n"]
- >> end captured logging << -

--
XML: /root/marvinxKcIvFqe/results.xml
--
Ran 0 tests in 0.002s

FAILED (errors=1)

[GitHub] cloudstack pull request: CLOUDSTACK-8656: tests ignoring exception...

2015-09-30 Thread koushik-das 
Github user koushik-das commented on the pull request:

https://github.com/apache/cloudstack/pull/850#issuecomment-144384074
  
@DaanHoogland @borisroman The test needs to invoke a protected method from 
a class and so is done using reflection. The test case already asserts for the 
method not being null. Now reflection methods throws some standard exceptions 
which either needs to be handled or thrown as per Java method contract. Since 
the null check is already there, the exceptions can be safely ignored.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8924: Enable dynamic scaling t...

2015-09-30 Thread sanju1010 
GitHub user sanju1010 opened a pull request:

https://github.com/apache/cloudstack/pull/902

CLOUDSTACK-8924: Enable dynamic scaling to run test_scale_vm.py test on 
simulator

Simulator setup uses the config file from following location:
tools/marvin/marvin/config/setup.cfg
Added global setting parameter "enable.dynamic.scale.vm" to above config 
file, so that dynamic scale vm tests can be run on simulator.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sanju1010/cloudstack simulator

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/902.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #902


commit e81bf937da2f21d0b29b7fc16c126f76a0c85aff
Author: sanjeev 
Date:   2015-09-30T13:18:27Z

CLOUDSTACK-8924: Enable dynamic scaling to run test_scale_vm.py test on 
Simulator




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: OVS Plugin documentation issues

2015-09-30 Thread Ron Wheeler 

That was exactly what I needed.

I have cloned the master, tried to make a "dev".
I will make the suggested changes to the "dev" branch.

I am using Eclipse and seem to be having some trouble mapping the README 
to the corresponding Eclipse operations but that is a general 
"git/person in the chair" question rather than a Cloudstack problem and 
Google and I will sort that out.



I will still need some help with sections that are too vague for me to fix.

I hope that some of the experts and developers will respond to my 
specific questions to help make sure that my changes are correct.



Thanks.

Ron

On 30/09/2015 4:49 AM, Sebastien Goasguen wrote:

On Sep 29, 2015, at 2:40 PM, Ron Wheeler  wrote:

Don't mind making the changes.
I have a lot of SVN experience and have the git repo for Apache OFBiz 
configured but am still trying to figure out git.
What do I have to setup in Eclipse to access the "right" bits on git.

Seems to be a ton of git repo entries at 
https://git-wip-us.apache.org/repos/asf/cloudstack.git
I have cloned [4.5]. Is that right?

Where are the doc files?


There are several documentation repos depending on which guide you need to fix:

https://github.com/apache/cloudstack-docs
https://github.com/apache/cloudstack-docs-install
https://github.com/apache/cloudstack-docs-admin

Check the README file to see how to submit a patch.

thanks for your help



Ron

On 29/09/2015 4:25 AM, Erik Weber wrote:

On Tue, Sep 29, 2015 at 7:58 AM, Ron Wheeler mailto:rwhee...@artifact-software.com>> wrote:

On the page
http://docs.cloudstack.apache.org/en/master/networking/ovs-plugin.html
"Configuring the OVS Plugin"
starts with
"Prerequisites"
which opens with this sentence
"Before enabling the OVS plugin the hypervisor needs to be install
OpenvSwitch."
which needs to be fixed.
Does "Before enabling the OVS plugin, OpenvSwitch must be
installed on  the hypervisor ." express the idea correctly.

"Default, XenServer has already installed OpenvSwitch." might be
trying to say "Xenserver has OpenvSwitch installed by default."



Open a Pull Request for the proposed changes :-)
You can do it directly in the github ui by pressing the 'Edit the file on your 
fork of this project' if you are unfamiliar with git and its workflows.


If you for some reason don't want to/can't do that, let us know and we'll do 
our best to pick it up.


--
Erik



--
Ron Wheeler
President
Artifact Software Inc
email: rwhee...@artifact-software.com
skype: ronaldmwheeler
phone: 866-970-2435, ext 102





--
Ron Wheeler
President
Artifact Software Inc
email: rwhee...@artifact-software.com
skype: ronaldmwheeler
phone: 866-970-2435, ext 102

Re: OVS documentation

2015-09-30 Thread Ron Wheeler 

On 30/09/2015 6:33 AM, Sebastien Goasguen wrote:

On Sep 29, 2015, at 2:06 PM, Ron Wheeler  wrote:

Can someone fix this?


Honestly Ron, the issue is that very few people are actually using the GRE 
isolation.

One would need to test it with the latest cloudstack 4.5.2 and latest OVS to 
see if it works with newer versions….

Any suggestions about what to say or is it best left "as is"

-sebastien


Does anyone know what the correct recommendation should be?

Is anyone interested in the documentation?

Of course...

Sorry if that seemed rhetorical.
I was hoping to find an actual volunteer to work with or to help point 
me to areas that are known to need editing.





I am trying to read it all with an outsider's eye and identify areas that I 
have trouble understanding.
Is it customary to use the Dev list or just create JIRA Issues.


for questions from the user side, usually it’s better to hit the users@ list.
But you can create JIRA issues as well, if it’s an error.

Ideally, once you test it on newer versions, you can also submit a github PR to 
make the required change in the docs. We will happily merge.


I am not sure what you mean by testing.
I am probably going to limit my efforts to editing and will depend on 
others to suggest content and verify the accuracy of changes since I am 
too new to CloudStack and do not have a CloudStack test environment to 
use for testing.





Ron

On 29/09/2015 2:18 AM, Nguyen Anh Tu wrote:

Dear Ron,

It's old I believe.

--Tuna

On Tue, Sep 29, 2015 at 1:05 PM, Ron Wheeler mailto:rwhee...@artifact-software.com>> wrote:

http://docs.cloudstack.apache.org/en/master/networking/ovs-plugin.html
has the following sentence:
"CentOS 6.4 and OpenvSwitch 1.10 are recommended." These seem to
be very old. Are they really the recommended versions?

Ron

-- Ron Wheeler






--
Ron Wheeler
President
Artifact Software Inc
email: rwhee...@artifact-software.com
skype: ronaldmwheeler
phone: 866-970-2435, ext 102

[GitHub] cloudstack pull request: CLOUDSTACK-8848: ensure power state is up...

2015-09-30 Thread remibergsma 
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/885#issuecomment-144430354
  
@resmo I tested a series of BVT tests (not all of them) and the result is 
fine.

First test run:
```
marvinCfg=/data/shared/marvin/mct-zone1-kvm1.cfg
nosetests --with-marvin --marvin-config=${marvinCfg} -s -a 
tags=advanced,required_hardware=true \
component/test_vpc_redundant.py \
component/test_routers_iptables_default_policy.py \
component/test_vpc_router_nics.py
```

Results:
```
Create a redundant vpc with two networks with two vms in each network ... 
=== TestName: test_01a_create_redundant_VPC | Status : FAILED ===
FAIL
```
This failure is expected, it is due to CLOUDSTACK-8915 and not an issue in 
this PR

```
Test iptables default INPUT/FORWARD policy on RouterVM ... === TestName: 
test_02_routervm_iptables_policies | Status : SUCCESS ===
ok
Test iptables default INPUT/FORWARD policies on VPC router ... === 
TestName: test_01_single_VPC_iptables_policies | Status : SUCCESS ===
ok
```

The second run:
```
nosetests --with-marvin --marvin-config=${marvinCfg} -s -a 
tags=advanced,required_hardware=false \
smoke/test_routers.py \
smoke/test_network_acl.py \
smoke/test_privategw_acl.py \
smoke/test_reset_vm_on_reboot.py \
smoke/test_vm_life_cycle.py \
smoke/test_vpc_vpn.py \
smoke/test_service_offerings.py \
component/test_vpc_offerings.py \
component/test_vpc_routers.py
```

Results:
```
Test router internal advanced zone ... === TestName: 
test_02_router_internal_adv | Status : SUCCESS ===
ok
Test restart network ... === TestName: test_03_restart_network_cleanup | 
Status : SUCCESS ===
ok
Test router basic setup ... === TestName: test_05_router_basic | Status : 
SUCCESS ===
ok
Test router advanced setup ... === TestName: test_06_router_advanced | 
Status : SUCCESS ===
ok
Test stop router ... === TestName: test_07_stop_router | Status : SUCCESS 
===
ok
Test start router ... === TestName: test_08_start_router | Status : SUCCESS 
===
ok
Test reboot router ... === TestName: test_09_reboot_router | Status : 
SUCCESS ===
ok
test_privategw_acl (integration.smoke.test_privategw_acl.TestPrivateGwACL) 
... === TestName: test_privategw_acl | Status : SUCCESS ===
ok
Test reset virtual machine on reboot ... === TestName: 
test_01_reset_vm_on_reboot | Status : SUCCESS ===
ok
Test advanced zone virtual router ... === TestName: 
test_advZoneVirtualRouter | Status : SUCCESS ===
ok
Test Deploy Virtual Machine ... === TestName: test_deploy_vm | Status : 
SUCCESS ===
ok
Test Multiple Deploy Virtual Machine ... === TestName: 
test_deploy_vm_multiple | Status : SUCCESS ===
ok
Test Stop Virtual Machine ... === TestName: test_01_stop_vm | Status : 
SUCCESS ===
ok
Test Start Virtual Machine ... === TestName: test_02_start_vm | Status : 
SUCCESS ===
ok
Test Reboot Virtual Machine ... === TestName: test_03_reboot_vm | Status : 
SUCCESS ===
ok
Test destroy Virtual Machine ... === TestName: test_06_destroy_vm | Status 
: SUCCESS ===
ok
Test recover Virtual Machine ... === TestName: test_07_restore_vm | Status 
: SUCCESS ===
ok
Test migrate VM ... === TestName: test_08_migrate_vm | Status : SUCCESS ===
ok
Test destroy(expunge) Virtual Machine ... === TestName: test_09_expunge_vm 
| Status : SUCCESS ===
ok
Test VPN in VPC ... === TestName: test_vpc_remote_access_vpn | Status : 
SUCCESS ===
ok
Test VPN in VPC ... === TestName: test_vpc_site2site_vpn | Status : SUCCESS 
===
ok
Test to create service offering ... === TestName: 
test_01_create_service_offering | Status : SUCCESS ===
ok
Test to update existing service offering ... === TestName: 
test_02_edit_service_offering | Status : SUCCESS ===
ok
Test to delete service offering ... === TestName: 
test_03_delete_service_offering | Status : SUCCESS ===
ok
Test create VPC offering ... === TestName: test_01_create_vpc_offering | 
Status : SUCCESS ===
ok
Test VPC offering without load balancing service ... === TestName: 
test_03_vpc_off_without_lb | Status : SUCCESS ===
ok
Test VPC offering without static NAT service ... === TestName: 
test_04_vpc_off_without_static_nat | Status : SUCCESS ===
ok
Test VPC offering without port forwarding service ... === TestName: 
test_05_vpc_off_without_pf | Status : SUCCESS ===
ok
Test VPC offering with invalid services ... === TestName: 
test_06_vpc_off_invalid_services | Status : SUCCESS ===
ok
Test update VPC offering ... === TestName: test_07_update_vpc_off | Status 
: SUCCESS ===
ok
Test list VPC offering ... === TestName: test_08_list_vpc_off | Status : 
SUCCESS ===
ok
test_09_create_redundant_vpc_offering

[GitHub] cloudstack pull request: CLOUDSTACK-8808: Successfully registered ...

2015-09-30 Thread remibergsma 
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/901#issuecomment-144439566
  
Thanks @karuturi for picking this up. Will have a look soon!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

RE: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Somesh Naidu 
> that said we should still work towards a test set that can function as the

So essentially, we are saying that the existing BVT isn't really a BVT and that 
we have to come up with it. From a user/customer standpoint this doesn't 
inspire confidence.

Anyway, is anybody willing to do this, as in, come up with a BVT/smoke/sanity? 
Or do we have to rely on Citrix to do this?

Daan - do we have a tracker for this request?

Regards,
Somesh

-Original Message-
From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] 
Sent: Wednesday, September 30, 2015 5:44 AM
To: dev
Subject: Re: [Blocker] test duplicated in test_scale_vm.py

I disagree, and let me carefully try to formulate why: BVT is useful and
'should' be run before any thing is declared good. The problem is the
ability for the community at large to run it and to fix it for any kind of
set-up. It should not be automatically treated as blockers but only if a
full analysis points to a root cause that can be considered a blocker.

that said we should still work towards a test set that can function as the
you describe the BVT and be automatically adding blockers.

regards,

On Wed, Sep 30, 2015 at 11:28 AM, Rajani Karuturi <
rajani.karut...@citrix.com> wrote:

> I agree with Raja. BVT test case failures should be treated as blockers.
> Once the test issue is fixed, they might uncover new issues/regressions.
>
> ~Rajani
>
>
>
> On 30-Sep-2015, at 2:32 pm, Raja Pullela  wrote:
>
> > The problem needs to be fixed - "have tested a solution that was
> discussed with koushik" - we will have to create PR with that change.  Once
> the PR is pushed - we will have one less blocker/test failure.
> >
> > I agree this is not a cloudstack core code problem - but we should NOT
> make that a criteria for priority of a bug - just my take.  We should
> include BVT failures in the Blocker criteria (whether the fix is in the
> core functionality/test script).  Otherwise, we will not hit 100% passrate
> on BVTs.
> >
> > You are right - only a subset of these tests are being run on "travis"
> otherwise we will catch more or some of these failures.
> >
> > -Original Message-
> > From: Sebastien Goasguen [mailto:run...@gmail.com]
> > Sent: Wednesday, September 30, 2015 2:09 PM
> > To: dev@cloudstack.apache.org
> > Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> >
> >
> >> On Sep 30, 2015, at 10:28 AM, Raja Pullela 
> wrote:
> >>
> >> Yup... btw, I am on top of this and goal is to get to 100% passrate on
> BVTs!
> >>
> >
> > Yes I got it, and we all have the same goal.
> >
> > It does appear that not all smoke tests are run by Travis, otherwise we
> would catch any errors on simulator for every PR.
> >
> > My point is that if a failure in your BVT is due to the test itself it
> is not a cloudstack failure per se and hence not a blocker. Which all said
> and done is not a problem because it should be fixed now if I am
> understanding your assessment and Koushik report of this failure correctly.
> >
> >
> >
> >> -Original Message-
> >> From: Sebastien Goasguen [mailto:run...@gmail.com]
> >> Sent: Wednesday, September 30, 2015 1:48 PM
> >> To: dev@cloudstack.apache.org
> >> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> >>
> >>
> >>> On Sep 30, 2015, at 10:15 AM, Raja Pullela 
> wrote:
> >>>
> >>> Sebastien, any BVT tests failing is a blocker and needs to be fixed -
> which is the reason for Blocker.  We already have a fix.
> >>>
> >>
> >> Right, but that's a fix in the test itself, no an issue with the
> cloudstack "core".
> >>
> >> In any case, great, one less blocker.
> >>
> >>> Koushik,
> >>>
> >>> modified the test "test_01_scale_vm" with required_hardware=false on
> simulator setup and it works.  So, I think we can let the second method
> go.  I will also test this on XS.
> >>> Raja
> >>>
> >>>
> >>> root@localhost:~/cloudstack# nosetests --with-marvin
> >>> --marvin-config=/root/cloudstack/setup/dev/local1.cfg
> >>> --zone=Sandbox-simulator --hypervisor=simulator -a
> >>> tags=basic,required_hardware=false
> >>> /root/cloudstack/test/integration/smoke/test_scale_vm.py
> >>>
> >>>  Marvin Init Started 
> >>>
> >>> === Marvin Parse Config Successful ===
> >>>
> >>> === Marvin Setting TestData Successful===
> >>>
> >>>  Log Folder Path: /tmp//MarvinLogs//Sep_30_2015_08_06_32_AWNF1O.
> >>> All logs will be available here 
> >>>
> >>> === Marvin Init Logging Successful===
> >>>
> >>>  Marvin Init Successful 
> >>> ===final results are now copied to:
> >>> /tmp//MarvinLogs/test_scale_vm_OPS7AD===
> >>> root@localhost:~/cloudstack# cd /tmp//MarvinLogs/test_scale_vm_OPS7AD
> >>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls
> >>> failed_plus_exceptions.txt  results.txt  runinfo.txt
> >>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# vi  results.txt
> >>> root@localhost:/tmp/MarvinLogs/test_scale_vm_OPS7AD# ls -al total 48
> >>> drwxr-xr-x 2 root root  4096 Sep 30 08:07 .
> >>> drwxr-xr-x 8 root root

[GitHub] cloudstack pull request: CLOUDSTACK-8848: ensure power state is up...

2015-09-30 Thread remibergsma 
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/885#issuecomment-16693
  
The functionality of this PR also seems to work:

```
WARN  [c.c.v.VirtualMachinePowerStateSyncImpl] 
(AgentManager-Handler-5:null) Detected missing VM but power state is outdated, 
wait for another process report run for VM id: 93
WARN  [c.c.v.VirtualMachinePowerStateSyncImpl] 
(AgentManager-Handler-5:null) Detected missing VM but power state is outdated, 
wait for another process report run for VM id: 94

INFO  [c.c.v.VirtualMachineManagerImpl] (AgentManager-Handler-2:null) VM 
r-93-VM is at Running and we received a power-off report while there is no 
pending jobs on it
INFO  [c.c.v.VirtualMachineManagerImpl] (AgentManager-Handler-2:null) 
Detected out-of-band stop of a HA enabled VM r-93-VM, will schedule restart

INFO  [c.c.v.VirtualMachineManagerImpl] (AgentManager-Handler-2:null) VM 
i-2-94-VM is at Running and we received a power-off report while there is no 
pending jobs on it
INFO  [c.c.v.VirtualMachineManagerImpl] (AgentManager-Handler-2:null) VM 
i-2-94-VM is sync-ed to at Stopped state according to power-off report from 
hypervisor

```

I tested it with a router and an instance. The router was restarted, the 
instance was sync'ed to stopped (it was non-HA).

This is a HA-enabled instance:

```
INFO  [c.c.v.VirtualMachineManagerImpl] (AgentManager-Handler-6:null) There 
is pending job or HA tasks working on the VM. vm id: 93, postpone power-change 
report by resetting power-change counters

WARN  [c.c.v.VirtualMachinePowerStateSyncImpl] 
(AgentManager-Handler-1:null) Detected missing VM but power state is outdated, 
wait for another process report run for VM id: 96
INFO  [c.c.v.VirtualMachineManagerImpl] (AgentManager-Handler-13:null) VM 
i-2-96-VM is at Running and we received a power-off report while there is no 
pending jobs on it
INFO  [c.c.v.VirtualMachineManagerImpl] (AgentManager-Handler-13:null) 
Detected out-of-band stop of a HA enabled VM i-2-96-VM, will schedule restart
INFO  [c.c.h.HighAvailabilityManagerImpl] (AgentManager-Handler-13:null) 
Schedule vm for HA:  VM[User|i-2-96-VM]
INFO  [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-2:ctx-3c02c86b work-4) 
Processing work HAWork[4-HA-96-Running-Investigating]
INFO  [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-2:ctx-3c02c86b work-4) 
HA on VM[User|i-2-96-VM]
INFO  [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-2:ctx-3c02c86b work-4) 
SimpleInvestigator found VM[User|i-2-96-VM] to be alive? false

INFO  [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-2:ctx-3c02c86b work-4) 
VM is now restarted: 96 on 4
INFO  [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-2:ctx-3c02c86b work-4) 
Completed work HAWork[4-HA-96-Running-Scheduled]
```

This gets started again as expected, so that also works fine. The only 
thing I notice, and that is to be expected, that is now takes longer before HA 
kicks in and recovery starts.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

RE: VR refactoring, concerns and a way out ?

2015-09-30 Thread Somesh Naidu 
> To sum it up: it’s easy to sit-down and wait for other people to work on 
> features/test/fixes.

Wilder - essentially are you saying these failures are due to a. Ramnath and 
folks didn't contribute at the time and b. you did but weren't able to 
completely nail it down?

Raja/Ramnath - would it help and be better for the community as well as you if 
you'd just let ACS build be in the current state (as per you unstable router), 
create your own branch, implement your approach and fix the router (stable as 
per your opinion) for your users.

This way everyone would be happy.

Regards,
Somesh


-Original Message-
From: Wilder Rodrigues [mailto:wrodrig...@schubergphilis.com] 
Sent: Thursday, September 24, 2015 8:48 AM
To: dev@cloudstack.apache.org
Subject: Re: VR refactoring, concerns and a way out ? 

Raja,

A nice way out would be to have more people knowing about coding and git. I 
have no idea from where you got this non-sense approach, but I would say it can 
be compared with the previous git flow the community had: not tests; no PRs; no 
review.

@Ramanath: you, and many others, should have pitched in when the code was 
merged, months ago, and when effort to help testing was requested.

To sum it up: it’s easy to sit-down and wait for other people to work on 
features/test/fixes.

Cheers,
Wilder


> On 24 Sep 2015, at 14:33, Sebastien Goasguen  wrote:
> 
> 
>> On Sep 24, 2015, at 2:00 PM, Ramanath Katru  
>> wrote:
>> 
>> My vote is for the approach no.1 - to backout completely. Most of VR 
>> functionalities are broken and are in a mess to say the least. It definitely 
>> will take some time and effort from several folks to get it to a stable 
>> state.
>> 
> 
> So which VR changes are we talking about. If it was merged it should mean 
> that tests passed and it worked at least in a controlled environment.
> 
>> Ram Katru
>> 
>> 
>> -Original Message-
>> From: Raja Pullela [mailto:raja.pull...@citrix.com] 
>> Sent: Thursday, September 24, 2015 2:06 PM
>> To: dev@cloudstack.apache.org
>> Subject: VR refactoring, concerns and a way out ? 
>> 
>> Hi,
>> 
>> 
>> 
>> I understand a concern on the VR changes was raised earlier.  My apologies 
>> to restart this thread again.
>> 
>> 
>> 
>> However, my last conversation with Jayapal, who has fixed/have been fixing 
>> lot of VR issues, about the VR issues and he is pretty concerned about the 
>> refactoring that has happened.  I have had the same concern for sometime now 
>>  (VR issues have been on the list of issues to be looked into for at least 
>> 4+ weeks) and wanted to see a good solution for this- with VR being very 
>> fundamental to the system.
>> 
>> 
>> 
>> Couple of solutions/proposals –
>> 
>> 1)  Back out the VR changes – Pros: VR has been stable for some time and 
>> it is working well.
>> 
>> 2)  Continue to fix/stability VR changes -   Concerns: is the unknowns, 
>> what we will find out and how long this will take to stabilize the VR 
>> functionality.
>> 
>> 
>> 
>> Please chime in if you have any thoughts or concerns around this,
>> 
>> 
>> 
>> best,
>> 
>> Raja
>

Re: OVS documentation

2015-09-30 Thread Sebastien Goasguen 

> On Sep 30, 2015, at 4:20 PM, Ron Wheeler  
> wrote:
> 
> On 30/09/2015 6:33 AM, Sebastien Goasguen wrote:
>>> On Sep 29, 2015, at 2:06 PM, Ron Wheeler  
>>> wrote:
>>> 
>>> Can someone fix this?
>>> 
>> Honestly Ron, the issue is that very few people are actually using the GRE 
>> isolation.
>> 
>> One would need to test it with the latest cloudstack 4.5.2 and latest OVS to 
>> see if it works with newer versions….
> Any suggestions about what to say or is it best left "as is"
>> -sebastien
>> 
>>> Does anyone know what the correct recommendation should be?
>>> 
>>> Is anyone interested in the documentation?
>> Of course...
> Sorry if that seemed rhetorical.
> I was hoping to find an actual volunteer to work with or to help point me to 
> areas that are known to need editing.
> 
>> 
>>> I am trying to read it all with an outsider's eye and identify areas that I 
>>> have trouble understanding.
>>> Is it customary to use the Dev list or just create JIRA Issues.
>>> 
>> for questions from the user side, usually it’s better to hit the users@ list.
>> But you can create JIRA issues as well, if it’s an error.
>> 
>> Ideally, once you test it on newer versions, you can also submit a github PR 
>> to make the required change in the docs. We will happily merge.
> 
> I am not sure what you mean by testing.

I mean actually deploying a GRE based network for cloudstack. That way you will 
know if it works with the latest version of centos and OVS.

> I am probably going to limit my efforts to editing and will depend on others 
> to suggest content and verify the accuracy of changes since I am too new to 
> CloudStack and do not have a CloudStack test environment to use for testing.

Maybe you could try to deploy it on one node, that will help you understand and 
check the docs.

> 
>> 
>>> Ron
>>> 
>>> On 29/09/2015 2:18 AM, Nguyen Anh Tu wrote:
 Dear Ron,
 
 It's old I believe.
 
 --Tuna
 
 On Tue, Sep 29, 2015 at 1:05 PM, Ron Wheeler 
 mailto:rwhee...@artifact-software.com>> 
 wrote:
 
http://docs.cloudstack.apache.org/en/master/networking/ovs-plugin.html
has the following sentence:
"CentOS 6.4 and OpenvSwitch 1.10 are recommended." These seem to
be very old. Are they really the recommended versions?
 
Ron
 
-- Ron Wheeler
 
>> 
> 
> 
> -- 
> Ron Wheeler
> President
> Artifact Software Inc
> email: rwhee...@artifact-software.com
> skype: ronaldmwheeler
> phone: 866-970-2435, ext 102

Re: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Sebastien Goasguen 
@somesh, again your message is not helping all.

> On Sep 30, 2015, at 5:09 PM, Somesh Naidu  wrote:
> 
>> that said we should still work towards a test set that can function as the
> 
> So essentially, we are saying that the existing BVT isn't really a BVT and 
> that we have to come up with it. From a user/customer standpoint this doesn't 
> inspire confidence.
> 

Folks on this list, even though they talk as themselves, are users of ACS.They 
have built businesses based on ACS and rely on it heavily. I could give you a 
long list. They have a lot at stake in having a quality release of ACS. I am 
certain that they would not release something that they would not trust or have 
not tested.

The issue is that folks test for there particular setup and that as a group we 
still don’t have a complete view of the entire matrix that is possible with ACS 
(what Daan was alluding to). And BVT is just an indication of a certain level 
of quality it by no means says that all features of CloudStack work in every 
possible deployment.

> Anyway, is anybody willing to do this, as in, come up with a BVT/smoke/sanity?

It’s not a clear question.
Travis runs part of the simulator checks every single commits.
So does Jenkins, so do people with their own infra (not just Citrix, but actual 
users of ACS).

The issue with the particular test I was referring to (test_scale_vm) is that 
for some reason it is not running in the current Travis runs. My personal view 
is that the current failure of test_scale_vm is not symptomatic of a failure in 
ACS code, if I understood things correctly, hence I don’t consider this a 
blocker.

> Or do we have to rely on Citrix to do this?

If you are talking about Citrix running their set of BVT, the question is not 
to rely on it or not.
From my standpoint it would have been nice to see weekly (if not daily) status 
of all BVT tests run by Citrix (to the form of what Raja is now currently 
sending).

> 
> Daan - do we have a tracker for this request?
> 

Not a clear question either. I don’t know what request you are talking about.

But for now, let’s leave this thread as is and wait for the next couple PRs to 
hit master and we will see how BVT behaves.


> Regards,
> Somesh
> 
> -Original Message-
> From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] 
> Sent: Wednesday, September 30, 2015 5:44 AM
> To: dev
> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> 
> I disagree, and let me carefully try to formulate why: BVT is useful and
> 'should' be run before any thing is declared good. The problem is the
> ability for the community at large to run it and to fix it for any kind of
> set-up. It should not be automatically treated as blockers but only if a
> full analysis points to a root cause that can be considered a blocker.
> 
> that said we should still work towards a test set that can function as the
> you describe the BVT and be automatically adding blockers.
> 
> regards,
> 
> On Wed, Sep 30, 2015 at 11:28 AM, Rajani Karuturi <
> rajani.karut...@citrix.com> wrote:
> 
>> I agree with Raja. BVT test case failures should be treated as blockers.
>> Once the test issue is fixed, they might uncover new issues/regressions.
>> 
>> ~Rajani
>> 
>> 
>> 
>> On 30-Sep-2015, at 2:32 pm, Raja Pullela  wrote:
>> 
>>> The problem needs to be fixed - "have tested a solution that was
>> discussed with koushik" - we will have to create PR with that change.  Once
>> the PR is pushed - we will have one less blocker/test failure.
>>> 
>>> I agree this is not a cloudstack core code problem - but we should NOT
>> make that a criteria for priority of a bug - just my take.  We should
>> include BVT failures in the Blocker criteria (whether the fix is in the
>> core functionality/test script).  Otherwise, we will not hit 100% passrate
>> on BVTs.
>>> 
>>> You are right - only a subset of these tests are being run on "travis"
>> otherwise we will catch more or some of these failures.
>>> 
>>> -Original Message-
>>> From: Sebastien Goasguen [mailto:run...@gmail.com]
>>> Sent: Wednesday, September 30, 2015 2:09 PM
>>> To: dev@cloudstack.apache.org
>>> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
>>> 
>>> 
 On Sep 30, 2015, at 10:28 AM, Raja Pullela 
>> wrote:
 
 Yup... btw, I am on top of this and goal is to get to 100% passrate on
>> BVTs!
 
>>> 
>>> Yes I got it, and we all have the same goal.
>>> 
>>> It does appear that not all smoke tests are run by Travis, otherwise we
>> would catch any errors on simulator for every PR.
>>> 
>>> My point is that if a failure in your BVT is due to the test itself it
>> is not a cloudstack failure per se and hence not a blocker. Which all said
>> and done is not a problem because it should be fixed now if I am
>> understanding your assessment and Koushik report of this failure correctly.
>>> 
>>> 
>>> 
 -Original Message-
 From: Sebastien Goasguen [mailto:run...@gmail.com]
 Sent: Wednesday, September 30

Re: VR refactoring, concerns and a way out ?

2015-09-30 Thread Sebastien Goasguen 
@somesh you message is not helping at all.

The problems is being worked on by a lot of people. Folks know the current 
blockers and I am expecting to see PR come in to fix them in the coming days. 
We will then see what the results of BVT are.

Please read the full thread before replying.


> On Sep 30, 2015, at 5:37 PM, Somesh Naidu  wrote:
> 
>> To sum it up: it’s easy to sit-down and wait for other people to work on 
>> features/test/fixes.
> 
> Wilder - essentially are you saying these failures are due to a. Ramnath and 
> folks didn't contribute at the time and b. you did but weren't able to 
> completely nail it down?
> 
> Raja/Ramnath - would it help and be better for the community as well as you 
> if you'd just let ACS build be in the current state (as per you unstable 
> router), create your own branch, implement your approach and fix the router 
> (stable as per your opinion) for your users.
> 
> This way everyone would be happy.
> 
> Regards,
> Somesh
> 
> 
> -Original Message-
> From: Wilder Rodrigues [mailto:wrodrig...@schubergphilis.com] 
> Sent: Thursday, September 24, 2015 8:48 AM
> To: dev@cloudstack.apache.org
> Subject: Re: VR refactoring, concerns and a way out ? 
> 
> Raja,
> 
> A nice way out would be to have more people knowing about coding and git. I 
> have no idea from where you got this non-sense approach, but I would say it 
> can be compared with the previous git flow the community had: not tests; no 
> PRs; no review.
> 
> @Ramanath: you, and many others, should have pitched in when the code was 
> merged, months ago, and when effort to help testing was requested.
> 
> To sum it up: it’s easy to sit-down and wait for other people to work on 
> features/test/fixes.
> 
> Cheers,
> Wilder
> 
> 
>> On 24 Sep 2015, at 14:33, Sebastien Goasguen  wrote:
>> 
>> 
>>> On Sep 24, 2015, at 2:00 PM, Ramanath Katru  
>>> wrote:
>>> 
>>> My vote is for the approach no.1 - to backout completely. Most of VR 
>>> functionalities are broken and are in a mess to say the least. It 
>>> definitely will take some time and effort from several folks to get it to a 
>>> stable state.
>>> 
>> 
>> So which VR changes are we talking about. If it was merged it should mean 
>> that tests passed and it worked at least in a controlled environment.
>> 
>>> Ram Katru
>>> 
>>> 
>>> -Original Message-
>>> From: Raja Pullela [mailto:raja.pull...@citrix.com] 
>>> Sent: Thursday, September 24, 2015 2:06 PM
>>> To: dev@cloudstack.apache.org
>>> Subject: VR refactoring, concerns and a way out ? 
>>> 
>>> Hi,
>>> 
>>> 
>>> 
>>> I understand a concern on the VR changes was raised earlier.  My apologies 
>>> to restart this thread again.
>>> 
>>> 
>>> 
>>> However, my last conversation with Jayapal, who has fixed/have been fixing 
>>> lot of VR issues, about the VR issues and he is pretty concerned about the 
>>> refactoring that has happened.  I have had the same concern for sometime 
>>> now  (VR issues have been on the list of issues to be looked into for at 
>>> least 4+ weeks) and wanted to see a good solution for this- with VR being 
>>> very fundamental to the system.
>>> 
>>> 
>>> 
>>> Couple of solutions/proposals –
>>> 
>>> 1)  Back out the VR changes – Pros: VR has been stable for some time 
>>> and it is working well.
>>> 
>>> 2)  Continue to fix/stability VR changes -   Concerns: is the unknowns, 
>>> what we will find out and how long this will take to stabilize the VR 
>>> functionality.
>>> 
>>> 
>>> 
>>> Please chime in if you have any thoughts or concerns around this,
>>> 
>>> 
>>> 
>>> best,
>>> 
>>> Raja
>> 
>

RE: CloudStack networking documentation

2015-09-30 Thread Giles Sirett 
Paul is travelling this week - I'll ping somebody else to answer Rons questions

Regards

Giles

-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com]
Sent: 30 September 2015 11:34
To: dev@cloudstack.apache.org; Paul Angus 
Subject: Re: CloudStack networking documentation

Pinging Paul Angus, who can surely answer these questions.
We can then edit the docs.

> On Sep 29, 2015, at 7:03 AM, Ron Wheeler  
> wrote:
>
> http://docs.cloudstack.apache.org/en/master/concepts.html#what-is-apac
> he-cloudstack
>
> In the opening paragraph of About Physical Networks" it says "The
> network corresponds to a NIC on the hypervisor host."
>
> In Basic Zone Network Traffic Types it says that there is only one
> physical network in the zone but later on in the middle of discussing the 
> various traffic types there is a note "We strongly recommend the use of 
> separate NICs for management traffic and guest traffic".
> There is no reason given for this statement.
> No suggestion about what tradeoff is being made if you go with a single NIC.
> Is it performance or security concerns that prompts this?
>
> It might be helpful to describe what is meant by a single physical network 
> with multiple NICs.
>
> The note itself appears to be out of place since it is in the middle of some 
> definitions rather that in a discussion block.
> It also looks like it applies to Advanced Networks but is missing in that 
> section.
>
> "CIDR of the pod" is used without any description of what this is and how it 
> gets setup.
> Might be helpful to add a sentence or two about this. It seems important.
>
> "guest virtual router" is another concept that seems important but has no 
> definition or discussion.
>
> Ron
>
> --
> Ron Wheeler
> President
> Artifact Software Inc
> email: rwhee...@artifact-software.com
> skype: ronaldmwheeler
> phone: 866-970-2435, ext 102
>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: CloudStack networking documentation

2015-09-30 Thread Dag Sonstebo 
Hi Ron,

In the opening paragraph of About Physical Networks" it says "The
network corresponds to a NIC on the hypervisor host."
>> Yes - a physical network can be associated with a NIC or more typically
>>in production environments - a bonded pair of NICs for resilience.


In Basic Zone Network Traffic Types it says that there is only one
physical network in the zone but later on in the middle of discussing the
various traffic types there is a note "We strongly recommend the use of
separate NICs for management traffic and guest traffic".
There is no reason given for this statement.
>> Have a look at Paul¹s blog post at
>>http://www.shapeblue.com/understanding-cloudstacks-physical-networking-ar
>>chitecture/ which will give you more in depth information.

No suggestion about what tradeoff is being made if you go with a single
NIC.
Is it performance or security concerns that prompts this?
>> Both - while security is covered by the internal networking model many
>>CloudStack users still choose to separate the management traffic from
>>the guest traffic. More importantly though the guest traffic is at the
>>end of the day open for use by the public - and you can get yourself
>>into scenarios where guest traffic floods a physical network which then
>>negatively impacts the management traffic - in other words a customer
>>could in theory take down your CloudStack back end if there is no other
>>network equipment / throttling in place. A similar concept applies when
>>you use IP storage - you generally try to isolate storage traffic to
>>it¹s own network to prevent performance / bandwidth issues for other
>>CloudStack traffic.


"CIDR of the pod" is used without any description of what this is and how
it gets setup.
>> The CIDR is the overlying layer 3 network IP range you configure in
>>CloudStack for guests to use.


"guest virtual router" is another concept that seems important but has no
definition or discussion.
>> In advanced zones each guest network has it¹s own layer 2 network -
>>using either VLANs or another software defined networking isolation
>>models. This in itself does not provide layer 3 routing - which is where
>>the virtual router comes into play. The virtual router is a small VM
>>with multiple interfaces - one linked to the customers private network,
>>one pointing to the public internet and one connected to the management
>>network. This VR provides networking services (DHCP, etc), routing and
>>firewall services to the end user private network. More information at
>>http://docs.cloudstack.apache.org/en/master/administration_guide.html?hig
>>hlight=virtual%20router#virtual-router

Hope this helps, please ask if anything unclear. We will look into getting
the sections you¹ve mentioned updated in the official documentation.




Regards,
Dag Sonstebo
ShapeBlue





On 30/09/2015 17:12, "Giles Sirett"  wrote:

>Paul is travelling this week - I'll ping somebody else to answer Rons
>questions
>
>Regards
>
>Giles
>
>-Original Message-
>From: Sebastien Goasguen [mailto:run...@gmail.com]
>Sent: 30 September 2015 11:34
>To: dev@cloudstack.apache.org; Paul Angus 
>Subject: Re: CloudStack networking documentation
>
>Pinging Paul Angus, who can surely answer these questions.
>We can then edit the docs.
>
>> On Sep 29, 2015, at 7:03 AM, Ron Wheeler
>> wrote:
>>
>> http://docs.cloudstack.apache.org/en/master/concepts.html#what-is-apac
>> he-cloudstack
>>
>> In the opening paragraph of About Physical Networks" it says "The
>> network corresponds to a NIC on the hypervisor host."
>>
>> In Basic Zone Network Traffic Types it says that there is only one
>> physical network in the zone but later on in the middle of discussing
>>the various traffic types there is a note "We strongly recommend the use
>>of separate NICs for management traffic and guest traffic".
>> There is no reason given for this statement.
>> No suggestion about what tradeoff is being made if you go with a single
>>NIC.
>> Is it performance or security concerns that prompts this?
>>
>> It might be helpful to describe what is meant by a single physical
>>network with multiple NICs.
>>
>> The note itself appears to be out of place since it is in the middle of
>>some definitions rather that in a discussion block.
>> It also looks like it applies to Advanced Networks but is missing in
>>that section.
>>
>> "CIDR of the pod" is used without any description of what this is and
>>how it gets setup.
>> Might be helpful to add a sentence or two about this. It seems
>>important.
>>
>> "guest virtual router" is another concept that seems important but has
>>no definition or discussion.
>>
>> Ron
>>
>> --
>> Ron Wheeler
>> President
>> Artifact Software Inc
>> email: rwhee...@artifact-software.com
>> skype: ronaldmwheeler
>> phone: 866-970-2435, ext 102
>>
>
>Find out more about ShapeBlue and our range of CloudStack related services
>
>IaaS Cloud Design &
>Build
>CSForge ­ rapid IaaS deployment

RE: [Blocker] test duplicated in test_scale_vm.py

2015-09-30 Thread Somesh Naidu 
Ok, I will stop. I was only trying to help. I was just trying to say that we 
would greatly benefit from a CI practice that runs against an automated BVT and 
any failure should result in reverting the check-in (essentially a blocker). If 
the BVT is doing more than it should then tune it accordingly but maintain BVT 
failures as blockers. I believe this should greatly help avoiding regressions. 
That's all.

Regards,
Somesh


-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: Wednesday, September 30, 2015 11:56 AM
To: dev@cloudstack.apache.org; Somesh Naidu
Subject: Re: [Blocker] test duplicated in test_scale_vm.py

@somesh, again your message is not helping all.

> On Sep 30, 2015, at 5:09 PM, Somesh Naidu  wrote:
> 
>> that said we should still work towards a test set that can function as the
> 
> So essentially, we are saying that the existing BVT isn't really a BVT and 
> that we have to come up with it. From a user/customer standpoint this doesn't 
> inspire confidence.
> 

Folks on this list, even though they talk as themselves, are users of ACS.They 
have built businesses based on ACS and rely on it heavily. I could give you a 
long list. They have a lot at stake in having a quality release of ACS. I am 
certain that they would not release something that they would not trust or have 
not tested.

The issue is that folks test for there particular setup and that as a group we 
still don’t have a complete view of the entire matrix that is possible with ACS 
(what Daan was alluding to). And BVT is just an indication of a certain level 
of quality it by no means says that all features of CloudStack work in every 
possible deployment.

> Anyway, is anybody willing to do this, as in, come up with a BVT/smoke/sanity?

It’s not a clear question.
Travis runs part of the simulator checks every single commits.
So does Jenkins, so do people with their own infra (not just Citrix, but actual 
users of ACS).

The issue with the particular test I was referring to (test_scale_vm) is that 
for some reason it is not running in the current Travis runs. My personal view 
is that the current failure of test_scale_vm is not symptomatic of a failure in 
ACS code, if I understood things correctly, hence I don’t consider this a 
blocker.

> Or do we have to rely on Citrix to do this?

If you are talking about Citrix running their set of BVT, the question is not 
to rely on it or not.
From my standpoint it would have been nice to see weekly (if not daily) status 
of all BVT tests run by Citrix (to the form of what Raja is now currently 
sending).

> 
> Daan - do we have a tracker for this request?
> 

Not a clear question either. I don’t know what request you are talking about.

But for now, let’s leave this thread as is and wait for the next couple PRs to 
hit master and we will see how BVT behaves.


> Regards,
> Somesh
> 
> -Original Message-
> From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] 
> Sent: Wednesday, September 30, 2015 5:44 AM
> To: dev
> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
> 
> I disagree, and let me carefully try to formulate why: BVT is useful and
> 'should' be run before any thing is declared good. The problem is the
> ability for the community at large to run it and to fix it for any kind of
> set-up. It should not be automatically treated as blockers but only if a
> full analysis points to a root cause that can be considered a blocker.
> 
> that said we should still work towards a test set that can function as the
> you describe the BVT and be automatically adding blockers.
> 
> regards,
> 
> On Wed, Sep 30, 2015 at 11:28 AM, Rajani Karuturi <
> rajani.karut...@citrix.com> wrote:
> 
>> I agree with Raja. BVT test case failures should be treated as blockers.
>> Once the test issue is fixed, they might uncover new issues/regressions.
>> 
>> ~Rajani
>> 
>> 
>> 
>> On 30-Sep-2015, at 2:32 pm, Raja Pullela  wrote:
>> 
>>> The problem needs to be fixed - "have tested a solution that was
>> discussed with koushik" - we will have to create PR with that change.  Once
>> the PR is pushed - we will have one less blocker/test failure.
>>> 
>>> I agree this is not a cloudstack core code problem - but we should NOT
>> make that a criteria for priority of a bug - just my take.  We should
>> include BVT failures in the Blocker criteria (whether the fix is in the
>> core functionality/test script).  Otherwise, we will not hit 100% passrate
>> on BVTs.
>>> 
>>> You are right - only a subset of these tests are being run on "travis"
>> otherwise we will catch more or some of these failures.
>>> 
>>> -Original Message-
>>> From: Sebastien Goasguen [mailto:run...@gmail.com]
>>> Sent: Wednesday, September 30, 2015 2:09 PM
>>> To: dev@cloudstack.apache.org
>>> Subject: Re: [Blocker] test duplicated in test_scale_vm.py
>>> 
>>> 
 On Sep 30, 2015, at 10:28 AM, Raja Pullela 
>> wrote:
 
 Yup... btw, I am on top of this and goal is to get to 100

RE: test_nicira_controller.py is failing on all Advzone - XS, KVM

2015-09-30 Thread Raja Pullela 
Hi Miguel,

Can you please add some checking in the setup method for the configuration 
parameters and if it is not available, can you skip this test?

Raja

-Original Message-
From: Raja Pullela [mailto:raja.pull...@citrix.com] 
Sent: Wednesday, September 30, 2015 5:52 PM
To: Miguel Ferreira 
Cc: dev 
Subject: RE: test_nicira_controller.py is failing on all Advzone - XS, KVM

thanks Miguel !

From: Miguel Ferreira [mailto:mferre...@schubergphilis.com]
Sent: Wednesday, September 30, 2015 3:01 PM
To: Raja Pullela 
Cc: dev 
Subject: Re: test_nicira_controller.py is failing on all Advzone - XS, KVM

Hi Raja,

That test needs a NSX cluster. With that in place, the configuration used to 
run the test must define a section called NiciraNvp, and that section should 
have an array os hosts with that name (see line 46 of the test).
In a Marvin config that materializes in something like this:
"niciraNvp": {

"hosts": [ "nsxcon1.cloud.lan", "nsxcon2.cloud.lan" ]
}

Furthermore, you need to have a zone configured to use NSX and that requires 
more work.
You can find a full Marvin config for it here: 
https://github.com/schubergphilis/MCT-shared/blob/master/marvin/mct-zone1-kvm1-NVP.cfg
In that same git repo there are config files for deploying a NSX cluster 
(https://github.com/schubergphilis/MCT-shared/blob/master/deploy/cloud/nsx_cluster.conf).
However, we have not yet fully automated all the steps needed to get the 
cluster up and running (ie. setting up the cluster internals, and adding a more 
controllers to the cluster).
I can help you with that if you need.

Cheers,
\ Miguel Ferreira
   mferre...@schubergphilis.com



On 30 Sep 2015, at 09:05, Raja Pullela 
mailto:raja.pull...@citrix.com>> wrote:

Hi Miguel or someone's familiar with this test,

Can you please provide documentation around how to get these tests running ?
BTW - looks like this is a new test that was added on Aug 25th 2015.

Thanks,
Raja

=== TestName: None | Status : EXCEPTION === ERROR

==
ERROR: test suite for 
--
Traceback (most recent call last):
 File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 209, in run
   self.setUp()
 File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 292, in setUp
   self.setupContext(ancestor)
 File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 315, in 
setupContext
   try_run(context, names)
 File "/usr/local/lib/python2.7/dist-packages/nose/util.py", line 470, in 
try_run
   return func()
 File "/root/cloudstack/test/integration/smoke/test_nicira_controller.py", line 
46, in setUpClass
   cls.nicira_hosts  = cls.config.niciraNvp.hosts
AttributeError: 'NoneType' object has no attribute 'hosts'
 >> begin captured stdout << - === 
TestName: None | Status : EXCEPTION ===


- >> end captured stdout << --
 >> begin captured logging << 
CSLog: CRITICAL: EXCEPTION: None: ['Traceback (most recent call last):\n', '  
File "/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 209, in run\n 
   self.setUp()\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 292, in setUp\n
self.setupContext(ancestor)\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/suite.py", line 315, in 
setupContext\ntry_run(context, names)\n', '  File 
"/usr/local/lib/python2.7/dist-packages/nose/util.py", line 470, in try_run\n   
 return func()\n', '  File 
"/root/cloudstack/test/integration/smoke/test_nicira_controller.py", line 46, 
in setUpClass\ncls.nicira_hosts  = cls.config.niciraNvp.hosts\n', 
"AttributeError: 'NoneType' object has no attribute 'hosts'\n"]
- >> end captured logging << -

--
XML: /root/marvinxKcIvFqe/results.xml
--
Ran 0 tests in 0.002s

FAILED (errors=1)

[GitHub] cloudstack pull request: Strongswan vpn feature

2015-09-30 Thread remibergsma 
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/872#issuecomment-144499793
  
@jayapalu Before you run the tests, please rebase as you'll otherwise find 
many false-positives.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8888: Xenserver 6.0.2 host stu...

2015-09-30 Thread remibergsma 
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/861#issuecomment-144500362
  
@koushik-das Thanks!

Another benefit: this is an easier change that doesn't require much testing 
(all it does it execute a SQL query at upgrade time).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: VR refactoring, concerns and a way out ?

2015-09-30 Thread Abhinandan Prateek 
 I can understand Citrix concern of some critical scenarios being missed. 
Citrix supports several customers with sometimes weird setups requiring that 
extra step in fixing and making the code that works in all those scenarios.

The current code has been contributed by community, by people who just want to 
see cloudstack become better. The code was contributed as per process and has 
been there for more than 6 months, not including the time that this effort 
took, which is over an year.

Can someone from Citrix consolidate all the VR issues and consolidate those 
under an umbrella ticket. As I can see the importance of those bugs is being 
lost in this chatter. Will request Citrix to take that extra effort in 
identifying the bugs, putting in enough details so that the use cases it breaks 
are understood in the community. Then it is just a number game — how many are 
squashed and how fast by the resilient community.

-abhi


> On 24-Sep-2015, at 9:06 pm, David Nalley  wrote:
>
> Everything else aside, do we really think that this could be backed
> out cleanly? The initial merge should be easy to pull out, but 6
> months of follow on work? There's no way that's coming out cleanly.
>
> --David
>
> On Thu, Sep 24, 2015 at 11:21 AM, Raja Pullela  
> wrote:
>> @wilder, Not sure why you would think it as a nonsense approach? sure, you 
>> realize amount of code churn and blockers we are dealing with when 4.6 is 
>> ready to go out.
>>
>> Agreed, the refactoring happened several months ago and we could have taken 
>> a closer look then-   the recent blockers filed have uncovered areas where 
>> in the implementation didn't exist.  I will post the bug details around this.
>>
>> Obviously, the refactoring changes missed multiple critical test scenarios 
>> and will take substantial time to test/stabilize.
>>
>> The BVTs are coming good for basic zone and Adv zone there are still a 
>> number of failures and it will take us good time to get those fixed.
>>
>> Besides the BVTs, regression tests are in a very bad shape.  Hope to get to 
>> these starting next week.
>>
>> Please see my latest bvt report, I will post in another 2 hrs, waiting for a 
>> new run to complete.
>>
>>> On Sep 24, 2015, at 7:00 PM, sebgoa  wrote:
>>>
>>>
 On Sep 24, 2015, at 3:17 PM, Remi Bergsma  
 wrote:

 Are you serious? You consider to revert a PR that was merged over 6 months 
 ago? And expect it to become more stable?
>>>
>>> I have not followed all the latest development, but if we are talking about 
>>> the VR refactoring, indeed it happened several months back. Reverting it 
>>> now does not seem like a good idea.
>>>
>>> I am probably missed a beat here, but the latest BVT results sent by Raja 
>>> showed XS tests almost at 100%, there were only some issues with KVM.
>>>
 The problem, in MHO, is not that we find bugs that we consider blockers. 
 The problem is we are unable to resolve them effectively because master is 
 unstable. There currently isn’t a single PR that solves it, hence there is 
 no way to test PRs. This is because we have many PRs open and they were 
 all branched off of a master that doesn’t work. I simply can't test 
 proposed PRs.

 This problem occurred about 3 weeks ago, because before that master worked 
 and we could solve issues and merge PRs. I’m not saying it was bug-free, 
 but at least we could work on stabilising it. Most likely, we accepted a 
 “fix” that made things worse. Probably even multiple of them.
>>>
>>> Master seemed stable and PR where being merged towards 4.6 with success (it 
>>> seemed), so indeed if we have issues now of stability, we should identify 
>>> what caused it
>>>
 To get out of this, I think we need to combine a few PRs that make it 
 stable. I’ll have a look today with Wilder and Funs to see if what fixes 
 we need to combine to make it work again. O
 nce we merge it and master actually works again, we can rebase any open PR 
 with current master and work from there.
>>>
>>> Potentially, if you identify the commit or commits that brought the 
>>> instability you could revert to that point and play forward PRs that did 
>>> not render master unstable.
>>>
>>> Thanks for looking into it.
>>>
>>> -seb
>>>
 Regards,
 Remi




> On 24/09/15 14:00, "Ramanath Katru"  wrote:
>
> My vote is for the approach no.1 - to backout completely. Most of VR 
> functionalities are broken and are in a mess to say the least. It 
> definitely will take some time and effort from several folks to get it to 
> a stable state.
>
> Ram Katru
>
>
> -Original Message-
> From: Raja Pullela [mailto:raja.pull...@citrix.com]
> Sent: Thursday, September 24, 2015 2:06 PM
> To: dev@cloudstack.apache.org
> Subject: VR refactoring, concerns and a way out ?
>
> Hi,
>
>
>
> I understand a concern on the VR changes wa

[GitHub] cloudstack pull request: Notify listeners when a host has been add...

2015-09-30 Thread mike-tutkowski 
Github user mike-tutkowski commented on the pull request:

https://github.com/apache/cloudstack/pull/816#issuecomment-144619954
  
So, I've been paging through the diff files to see what might be a good 
candidate for unit testing.

Unfortunately, I don't really see much.

What I do see (in terms of added/changed code) is the following:

* Removal of a constructor (compiler would catch any issues here).
* Renaming of variables (typically adding a "_" before a member variable).
* Some new setters and getters (technically could do unit testing here to 
confirm that what we place in the object is what we get out of it, but most of 
the time we are just directly setting a member variable and retrieving from it, 
so it's pretty low risk).
* Adding "private" and "protected" where previously we had "public" (the 
compiler should catch issues here).
* Making a previously private method public and making it accessible via an 
interface.
* Adding three methods to the HypervisorHostListener interface: hostAdded, 
hostAboutToBeRemoved, and hostRemoved (but not really having any hooks into the 
system to be able to "pretend" like I'm adding or removing a host).
* Removing the word "public" from the methods of an interface since all 
methods in an interface are public in Java.
* Adding three methods to the Listener interface: processHostAdded, 
processHostAboutToBeRemoved, and processHostRemoved (but not really having any 
hooks into the system to be able to "pretend" like I'm adding or removing a 
host). Also, this leads to a need to make a simple, default "do nothing" 
implementation of these methods for about 30 classes.
* Adding an extra command to allow while a host is in maintenance mode (but 
not having any way to simulate maintenance mode via unit testing).
* Adding a new command that VmwareResource can respond to. However, the 
command requires interaction with an ESXi host, so can't really be tested in 
isolation (i.e. via unit testing).
* Changes to the way DB locking is performed in a couple scenarios with the 
SolidFire storage plug-ins (requiring an underlying DB).
* Reformatting of text to better conform to ACS formatting guidelines.
* Removal of "dead" code that I came across while working on this ticket.

I'd be happy to entertain ideas on unit testing this PR, but I'm thinking 
we'd get more "mileage" here out of adding integration tests.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8808: Successfully registered ...

2015-09-30 Thread karuturi 
Github user karuturi commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/901#discussion_r40881668
  
--- Diff: core/src/com/cloud/storage/template/QCOW2Processor.java ---
@@ -75,6 +76,16 @@ public FormatInfo process(String templatePath, 
ImageFormat format, String templa
 
 @Override
 public long getVirtualSize(File file) throws IOException {
+try {
+long size = getTemplateVirtualSize(file);
--- End diff --

The utils one should be a recent implementation. I wonder why the author 
hasnt done cleanup and left two implementation of the same. I will take a look 
at the code later and see if it can be reused here.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: CLOUDSTACK-8896: allocated percentage of ...

2015-09-30 Thread karuturi 
Github user karuturi commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/873#discussion_r40881830
  
--- Diff: server/src/com/cloud/storage/StorageManagerImpl.java ---
@@ -1736,7 +1737,10 @@ public boolean 
storagePoolHasEnoughSpace(List volumes, StoragePool pool)
 allocatedSizeWithtemplate = 
_capacityMgr.getAllocatedPoolCapacity(poolVO, tmpl);
 }
 }
-if (volumeVO.getState() != Volume.State.Ready) {
+// A ready state volume is already allocated in a pool. so the 
asking size is zero for it.
+// In case the volume is moving across pools or is not ready 
yet, the asking size has to be computed
+s_logger.debug("pool id for the volume with id: " + 
volumeVO.getId() + " is: " + volumeVO.getPoolId());
--- End diff --

@wido numeric ids in logs are easy to understand/debug than uuids. names 
might me more readable but ids are unique and hence no ambiguity. 
The current pool-id is already logged and the pool-id of the the volume 
would help me see if the volume is moving across pools. That was the 
information I was looking for while debugging this issue and was hard to find 
given nothing was logged before.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---