Review Request 31180: CLOUDSTACK-8269: Code changes in primary storage test cases as per recent change in product behavior

[Gaurav Aradhye]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31180/
---

Review request for cloudstack and SrikanteswaraRao Talluri.


Bugs: CLOUDSTACK-8269
https://issues.apache.org/jira/browse/CLOUDSTACK-8269


Repository: cloudstack-git


Description
---

1. Earlier volume would get deleted when vm is deleted, now the volume does not 
get deleted and it remains in detached state unless account is removed. This 
volume gets counted in primary storage count of the account.

2. Earlier when volume was detached from VM, the primary storage count of the 
account would get reduced by the volume size. Now the primary storage count 
does not get reduced unless the volume is deleted.

The patch contains appropriate changes in the test cases as per changed 
behavior in product as stated above.


Diffs
-

  test/integration/component/test_ps_domain_limits.py d9c1018 
  test/integration/component/test_ps_limits.py c9a754b 

Diff: https://reviews.apache.org/r/31180/diff/


Testing
---

Test primary storage limit of domain and its sub-domains ... === TestName: 
test_01_multiple_domains_primary_storage_limits | Status :
SUCCESS ===
ok
Test primary storage counts in multiple child domains ... === TestName: 
test_02_multiple_domains_primary_storage_limits | Status :
SUCCESS ===
ok
Test primary storage counts in multiple child domains ... === TestName: 
test_03_multiple_domains_multiple_volumes | Status : SUCCESS ===
ok
Test create snapshot and templates from volume ... === TestName: 
test_04_create_template_snapshot | Status : SUCCESS ===
ok
Test assign virtual machine to account belonging to different domain ... === 
TestName: test_05_assign_virtual_machine_different_domain
| Status : SUCCESS ===
ok
Test primary storage counts while destroying and recovering VM ... === 
TestName: test_06_destroy_recover_vm | Status : SUCCESS ===
ok

--
Ran 6 tests in 1619.606s

OK


Test Deploy multiple VMs with & verify the usage ... === TestName: 
test_deploy_multiple_vm_1_root_domain_admin | Status : SUCCESS ===
ok
Test Deploy multiple VMs with & verify the usage ... === TestName: 
test_deploy_multiple_vm_2_child_domain_admin | Status : SUCCESS ===
ok

--
Ran 2 tests in 399.904s

OK


Thanks,

Gaurav Aradhye

Re: [devcloud-kvm] what is the password for root?

[Wilder Rodrigues]

Thanks, Rohit!

I got all sorted out yesterday.

After Nux sent the details about girt-manager, I found an issue with 
authentication which lead me to a “bug” on virt-manager that was fixed with 
simple configuration changes. So, that’s why “bug”. :)

I’m putting all the information together and will write a blog with the whole 
shebang.

My test environment is comprised of the following:

* CentOS 6.4 running under VMWare zone in Apache CloudStack 4.4.2
* Updated Kernel in order to have nested virtualisation with CentOS 6.4
* KVM + libvirt
* ACS 4.6.0 - persistent systemvm + rVPC branch
* MySQL

I’m building the packages now in order to get the cloudstack-agente running so 
I can deploy my 1st data centre in the new environment.

Thanks a lot to all replies and support. Once the blog is out, I will let you 
know.

Cheers,
Wilder

P.S.: I also want to make it automated in some way and available via github.

On 19 Feb 2015, at 08:13, Rohit Yadav 
mailto:rohit.ya...@shapeblue.com>> wrote:

Hi Wilder,

I use this ansible based tool to setup my one node DevCloud KVM setup
locally on a VM or baremetal: https://github.com/bhaisaab/peppercorn
(may need suitable changes as per your environment).

Every time I build stuff, I copy jars from local build dir to KVM host's
/usr/share/cloudstack-agent and cloudstack-common. In fact, I use this
using CloudStack. So a VM running in basic zone no SG can be used as a
KVM host using peppercorn.

On Wednesday 18 February 2015 10:50 PM, Wilder Rodrigues wrote:
It works!

But I won’t celebrate that much because in the past 2 ours I have changed a ton 
of things.

[ekho@devcloud-kvm-ekho-vm devcloud-kvm]$ ssh 
root@192.168.100.10
root@192.168.100.10's 
password:
Last login: Tue Apr  1 09:15:00 2014 from 192.168.100.1
[root@devcloud-kvm ~]#
[root@devcloud-kvm ~]#
[root@devcloud-kvm ~]# ls
Desktop  Documents  Downloads  Music  Pictures  Public  Templates  Videos  
anaconda-ks.cfg  install.log  install.log.syslog
[root@devcloud-kvm ~]#


I will go on for now but will recreate the environment, really from scratch!

Thanks for the support, guys!

Cheers,
Wilder


On 18 Feb 2015, at 18:16, Wilder Rodrigues 
mailto:wrodrig...@schubergphilis.com>>
 wrote:

Hi there guys,

@Nux: thanks a lot… went through and and some other links I found and am now 
connected to the machine

@Marcus: really weird! I found some presentations (form you) around April last 
year and they also mention “password” as being the passed. I think my 
environment is not properly done yet.

I’m using the CentOS one and the host OS is also CentOS, but the 6.4 version. I 
had to update the kernel in order to get KVM nested stuff enable. Been through 
a lot today, but I think it’s moving towards the right direction now.

current situation here: 
https://twitter.com/wilderrodrigues/status/568096520161140736  :)

I will take care of children’s dinner and will be back to you tomorrow.

Cheers,
Wilder

On 18 Feb 2015, at 17:01, Marcus 
mailto:shadow...@gmail.com>> 
wrote:

Are you using the Ubuntu or CentOS version? The Ubuntu one may not
allow root by default (standard for Ubuntu), but might be user
'ubuntu' and password 'password', from which you can sudo.

On Wed, Feb 18, 2015 at 7:56 AM, Marcus 
mailto:shadow...@gmail.com>> 
wrote:
It should be 'password', I've redeployed one just recently.

On Wed, Feb 18, 2015 at 6:57 AM, Nux! 
mailto:n...@li.nux.ro>> wrote:
You can use virt-manager for that, similar to the virtualbox interface.
http://virt-manager.org/

On the server:
yum install virt-manager xorg-x11-xauth dejavu-lgc-sans-fonts

Logout from the ssh session, start X11 on your OSX and re-login to the server 
with "ssh -X", then type "virt-manager", this GUI will run over SSH. This will 
allow you to stop/start/VNC etc.

HTH
Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -
From: "Wilder Rodrigues" 
To: "Nux!" 
Cc: dev@cloudstack.apache.org, "Wido den Hollander" , "ilya 
mailing lists"
, "Marcus Schaefer - KLM - External" 
, "Funs Kessen"
, "Hugo Trippaers" , 
"int-cloud"
, "int-toolkit" , 
"Daan Hoogland"

Sent: Wednesday, 18 February, 2015 14:43:10
Subject: Re: [devcloud-kvm] what is the password for root?

That bit I know… But have to get to the guest VM console.

I have a CentOS 6.4 with qemu-kvm and libvirt. Everything is running fine.

I’m trying this here:
http://askubuntu.com/questions/569418/how-to-start-a-kvm-guest-as-single-user-mode

Will let you know if it works.

Thanks for the quick replies. :)

Cheers,
Wilder



On 18 Feb 2015, at 15:35, Nux! mailto:n...@li.nux.ro>> wrote:

Well, What OS is that? Never used devcloud.
BUT a few pointers:
http://askubuntu.com/questions/24006/how-do-i-reset-a-lost-admini

Re: Review Request 31155: CLOUDSTACK-8264: Adding missing change in test_data.py caused due to commit 500baea9b6c816caae93ab2f8d0ba31f99c3f8fc

[SrikanteswaraRao Talluri]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31155/#review73116
---

Ship it!


7629000ffe96afdbe83d268e9be38b7fdb2ba300 master

- SrikanteswaraRao Talluri


On Feb. 18, 2015, 11:54 a.m., Gaurav Aradhye wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31155/
> ---
> 
> (Updated Feb. 18, 2015, 11:54 a.m.)
> 
> 
> Review request for cloudstack and SrikanteswaraRao Talluri.
> 
> 
> Bugs: CLOUDSTACK-8264
> https://issues.apache.org/jira/browse/CLOUDSTACK-8264
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Adding missing change in test_data.py caused due to commit 
> 500baea9b6c816caae93ab2f8d0ba31f99c3f8fc
> 
> 
> Diffs
> -
> 
>   tools/marvin/marvin/config/test_data.py f8cadf5 
> 
> Diff: https://reviews.apache.org/r/31155/diff/
> 
> 
> Testing
> ---
> 
> N/A
> 
> 
> Thanks,
> 
> Gaurav Aradhye
> 
>

Review Request 31181: CLOUDSTACK-8268: Code improvement - test_stopped_vm.py

[Gaurav Aradhye]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31181/
---

Review request for cloudstack and SrikanteswaraRao Talluri.


Bugs: CLOUDSTACK-8268
https://issues.apache.org/jira/browse/CLOUDSTACK-8268


Repository: cloudstack-git


Description
---

1. Read all the test data from test_data.py
2. Remove hard coded test data (Services class) from the test suite
3. Fix autopep8 issues
4. Move bootableVolume to configurableData section and make relevant changes in 
test case to read the data according to hypervisor


Diffs
-

  test/integration/component/test_stopped_vm.py 1cefc07 
  tools/marvin/marvin/config/test_data.py e8365ed 

Diff: https://reviews.apache.org/r/31181/diff/


Testing
---

Test Deploy HA enabled Virtual Machine with startvm=false ... === TestName: 
test_01_deploy_ha_vm_startvm_false | Status : SUCCESS ===
ok
Test Deploy HA enabled Virtual Machine from ISO ... SKIP: Bootable Iso URL not 
present in test data for xenserver
Test Deploy HA enabled Virtual Machine from ISO with startvm=false ... === 
TestName: test_03_deploy_ha_vm_iso_startvm_false | Status :
SUCCESS ===
ok
Test deploy VM on specific host ... === TestName: test_deployVmOnGivenHost | 
Status : SUCCESS ===
ok
Test Deploy Virtual Machine with no startVM parameter ... === TestName: 
test_01_deploy_vm_no_startvm | Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=true parameter ... === TestName: 
test_02_deploy_vm_startvm_true | Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false parameter ... === TestName: 
test_03_deploy_vm_startvm_false | Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false and attach volume ... === 
TestName: test_04_deploy_startvm_false_attach_volume |
Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false and change service offering ... 
=== TestName: test_05_deploy_startvm_false_change_so |
Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false and ... === TestName: 
test_06_deploy_startvm_attach_detach | Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false and attach ISO ... === TestName: 
test_07_deploy_startvm_attach_iso | Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false and attach volume already 
attached to different machine ... === TestName:
test_08_deploy_attached_volume | Status : SUCCESS ===
ok
Test Stopped Virtual Machine's ROOT volume migration ... SKIP: No cluster with 
more than one primary storage pool to perform migrate
volume test
Test Deploy Virtual Machine with startVM=false & enabledpassword in ... === 
TestName: test_deploy_vm_password_enabled | Status :
SUCCESS ===
ok
Test Deploy Virtual Machine with no startVM parameter ... === TestName: 
test_01_deploy_vm_no_startvm | Status : SUCCESS ===
ok
Test Upload volume and attach to VM in stopped state ... === TestName: 
test_upload_attach_volume | Status : SUCCESS ===
ok
Test VM limit per account ... === TestName: test_vm_per_account | Status : 
SUCCESS ===
ok

--
Ran 17 tests in 1834.202s

OK (SKIP=2)


Thanks,

Gaurav Aradhye

Re: Libvirt & RBD caching

[ilya musayev]

Logan

Side note: it would help great if you can post your notes/guide on 
setting up Ceph as primary with CloudStack.

There arent any docs out there.

Thanks
ilya
On 2/18/15 12:00 PM, Logan Barfield wrote:

Our current deployment is KVM with Ceph RBD primary storage.  We have
rbd_cache enabled, and use "cache=none" in Qemu by default.

I've been running some tests to try to figure out why our write speeds
with FreeBSD are significantly lower than Linux.  I was testing both
RBD and local SSD storage, with various cache configurations.  Out of
all of them the only one that performed close to our standard Linux
images was local SSD, Qemu cache=writeback, FreeBSD gpt journal
enabled.

I've been reading on various lists the reasons and risks for
cache=none vs cache=writeback:
- cache=none: Safer for live migration
- cache=writeback: Ceph RBD docs claim that this is required for data
integrity when using rbd_cache

 From what I can tell performance is generally the same with both,
except in the case of FreeBSD.

What is the current line of thinking on this?  Should be using 'none'
or 'writeback' with RBD by default?  Is 'writeback' considered safe
for live migration?

Jenkins build is still unstable: simulator-singlerun #979

[jenkins]

See 

Jenkins build is back to normal : cloudstack-4.4-maven-build-noredist #446

[jenkins]

See 

[GitHub] cloudstack pull request: mvn on buildslaves that don't have it in ...

[DaanHoogland]

GitHub user DaanHoogland opened a pull request:

https://github.com/apache/cloudstack/pull/82

mvn on buildslaves that don't have it in path



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/DaanHoogland/cloudstack master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/82.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #82


commit 45a3ad21861f97089746983be442bece5511f7b8
Author: Daan Hoogland 
Date:   2015-02-19T10:58:40Z

mvn on buildslaves that don't have it in path




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] cloudstack pull request: mvn on buildslaves that don't have it in ...

[karuturi]

Github user karuturi commented on the pull request:

https://github.com/apache/cloudstack/pull/82#issuecomment-75036256
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Jenkins build is still unstable: simulator-singlerun #980

[jenkins]

See 

Re: Review Request 30661: LDAP:automation:added missing scenrio and additional checks for better debugging

[suresh sadhu]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30661/
---

(Updated Feb. 19, 2015, 12:04 p.m.)


Review request for cloudstack, sanjeev n and SrikanteswaraRao Talluri.


Bugs: CLOUDSTACK-8218
https://issues.apache.org/jira/browse/CLOUDSTACK-8218


Repository: cloudstack-git


Description
---

added missing scenrio and additional checks for better debugging


Diffs (updated)
-

  test/integration/component/test_ldap.py 3464022 

Diff: https://reviews.apache.org/r/30661/diff/


Testing
---

Yes


Thanks,

suresh sadhu

Re: Review Request 25885: CLOUDSTACK-7594: Adding automation test cases for Stopped VM test path

[suresh sadhu]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25885/#review73130
---

Ship it!


Ship It!

- suresh sadhu


On Feb. 16, 2015, 5:16 a.m., Ashutosh Kelkar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/25885/
> ---
> 
> (Updated Feb. 16, 2015, 5:16 a.m.)
> 
> 
> Review request for cloudstack, suresh sadhu and SrikanteswaraRao Talluri.
> 
> 
> Bugs: CLOUDSTACK-7594
> https://issues.apache.org/jira/browse/CLOUDSTACK-7594
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Automation test cases for Stopped VM test path.
> 
> 
> Diffs
> -
> 
>   test/integration/testpaths/testpath_stopped_vm.py PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/25885/diff/
> 
> 
> Testing
> ---
> 
> Yes.
> 
> Advanced zone:
> Positive test for stopped VM test path - T1 ... === TestName: 
> test_01_pt_deploy_vm_without_startvm | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T1 variant ... === TestName: 
> test_02_pt_deploy_vm_with_startvm_true | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T2 ... === TestName: 
> test_03_pt_deploy_vm_with_startvm_false | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T3 and variant, T9 ... === TestName: 
> test_04_pt_startvm_false_attach_disk | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T4 ... === TestName: 
> test_05_pt_startvm_false_attach_disk_change_SO | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T5 ... === TestName: 
> test_06_pt_startvm_false_attach_iso | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T5 variant ... === TestName: 
> test_07_pt_startvm_false_attach_iso_running_vm | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T10 ... === TestName: 
> test_08_pt_startvm_false_password_enabled_template | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T11 ... === TestName: 
> test_09_pt_destroy_stopped_vm | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T12 ... === TestName: 
> test_10_max_account_limit | Status : SUCCESS ===
> ok
> 
> 
> Basic zone:
> 
> Positive test for stopped VM test path - T1 ... === TestName: 
> test_01_pt_deploy_vm_without_startvm | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T1 variant ... === TestName: 
> test_02_pt_deploy_vm_with_startvm_true | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T2 ... === TestName: 
> test_03_pt_deploy_vm_with_startvm_false | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T3 and variant, T9 ... === TestName: 
> test_04_pt_startvm_false_attach_disk | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T4 ... === TestName: 
> test_05_pt_startvm_false_attach_disk_change_SO | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T5 ... === TestName: 
> test_06_pt_startvm_false_attach_iso | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T5 variant ... === TestName: 
> test_07_pt_startvm_false_attach_iso_running_vm | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T10 ... === TestName: 
> test_08_pt_startvm_false_password_enabled_template | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T11 ... === TestName: 
> test_09_pt_destroy_stopped_vm | Status : SUCCESS ===
> ok
> Positive test for stopped VM test path - T12 ... === TestName: 
> test_10_max_account_limit | Status : SUCCESS ===
> ok
> 
> --
> Ran 10 tests in 2792.968s
> 
> OK
> 
> 
> Thanks,
> 
> Ashutosh Kelkar
> 
>

Re: pending issues on 4.4.2 and 4.3.2

[Abhinandan Prateek]

I went thru the tickets most of them look like minor or corner cases.

https://issues.apache.org/jira/browse/CLOUDSTACK-6270 - VMWare issue
https://issues.apache.org/jira/browse/CLOUDSTACK-4879 - Doc ticket not required 
for RC’s
https://issues.apache.org/jira/browse/CLOUDSTACK-6307 - Vsphere
https://issues.apache.org/jira/browse/CLOUDSTACK-6871 - This is a capacity 
issue, more logs will be required to root cause it.
https://issues.apache.org/jira/browse/CLOUDSTACK-4890 - This one is minor, and 
also looks like expected behaviour.

I think following are worth looking into:

https://issues.apache.org/jira/browse/CLOUDSTACK-7539 — patch has been posted 
but not reviewed yet.
https://issues.apache.org/jira/browse/CLOUDSTACK-8085 - Rohit is looking into 
it.
https://issues.apache.org/jira/browse/CLOUDSTACK-5123 - VMWare

-abhi

> On 19-Feb-2015, at 11:38 am, Rajani Karuturi  wrote:
>
> Thanks for taking care of 4.4 Daan.
>
> I triaged for 4.3 and moved some of them to Future and a few to 4.5
>
> I marked 4.4.2 and 4.3.2 as released in Jira.
>
> Here is what I followed
> 1. all sub-tasks or marker tasks moved to Future
> 2. moved some of the doc issues to Future and a few to 4.5
> 3. resolved bugs with commit ids in the comments
> 4. moved a few issues which i thought are critical to 4.5
>
> These are the issues which I think should be fixed in 4.5:
> 1. https://issues.apache.org/jira/browse/CLOUDSTACK-7539
> 2. https://issues.apache.org/jira/browse/CLOUDSTACK-7539
> 3. https://issues.apache.org/jira/browse/CLOUDSTACK-6270
> 4. https://issues.apache.org/jira/browse/CLOUDSTACK-8085
> 5. https://issues.apache.org/jira/browse/CLOUDSTACK-4879
> 6. https://issues.apache.org/jira/browse/CLOUDSTACK-5123
> 7. https://issues.apache.org/jira/browse/CLOUDSTACK-6307
> 8. https://issues.apache.org/jira/browse/CLOUDSTACK-6871
> 9. https://issues.apache.org/jira/browse/CLOUDSTACK-4890
>
>
> ~Rajani
>
> On Wed, Feb 18, 2015 at 4:15 PM, Daan Hoogland 
> wrote:
>
>> Don't spend to much time. if there is a 4.3.3 mark the 4.3 ones as
>> such. I'll look at the 4.4 ones.
>>
>> On Wed, Feb 18, 2015 at 9:58 AM, Rajani Karuturi 
>> wrote:
>>> No Daan. I haven't triaged yet. I tried to mark them as released in jira
>>> and it showed me the open issues.
>>> I will try git grep for any commits in 4.3, 4.4 or 4.5. But, it would be
>>> difficult to co-relate unless the commits have bug ids.
>>>
>>> 4.3.2 has 158 issues[1] and 4.4.2 has 2 open issues[2]
>>>
>>> [1]
>> https://issues.apache.org/jira/browse/CLOUDSTACK/fixforversion/12329046/
>>> [2]
>> https://issues.apache.org/jira/browse/CLOUDSTACK/fixforversion/12328985/
>>>
>>>
>>> ~Rajani
>>>
>>> On Wed, Feb 18, 2015 at 1:35 PM, Daan Hoogland 
>>> wrote:
>>>
 Rajani, did you triage them? Maybe some of those are fixed in commits
 after the release. In that case they can be marked with all of 4.3.3,
 4.4.3 and 4.5.0. Otherwise we can still decide to put them on higher
 versions or on 'future'

 On Wed, Feb 18, 2015 at 7:26 AM, Abhinandan Prateek
  wrote:
> Since we are still voting and fixing 4.5 RC, these should be moved to
 4.5.
> If these are not fixed now then they can be moved to 4.6 after 4.5 is
 released.
>
> -abhi
>
>> On 18-Feb-2015, at 12:13 pm, Rajani Karuturi 
>> wrote:
>>
>> Hi all,
>> There are some open issues on 4.4.2 on 4.3.2.
>> Since they are already released, what should be the target release
>> for
>> these issues?
>> Should I move them to 4.6 (since we dont have 4.3.3 or 4.4.3
>> planned)?
>>
>> Thanks,
>> ~Rajani
>
> Find out more about ShapeBlue and our range of CloudStack related
 services
>
> IaaS Cloud Design & Build<
 http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<
>> http://shapeblue.com/csforge/>
> CloudStack Consulting
> CloudStack Software Engineering<
 http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure Support<
 http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<
 http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are
 intended solely for the use of the individual to whom it is addressed.
>> Any
 views or opinions expressed are solely those of the author and do not
 necessarily represent those of Shape Blue Ltd or related companies. If
>> you
 are not the intended recipient of this email, you must neither take any
 action based upon its contents, nor copy or show it to anyone. Please
 contact the sender if you believe you have received this email in error.
 Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
 Services India LLP is a company incorporated in India and is operated
>> under
 license from Shape Blue Ltd. Shape

Re: Google Summer of Code 2015 is coming

[Tilak Raj Singh]

Reagarding CLOUDSTACK-8266 (
https://issues.apache.org/jira/browse/CLOUDSTACK-8266?filter=12330309)

I am interested in implementing this feature in cloudstack this GSOC 2015.
I am a final year student from NIT Allahabad, India pursuing my Bachelors
in Information Technology. I went through the youtube video link present in
the project description and currently am getting familiarised with the
cloudstack database to gather the metrics that can be used to support this
feature.

Regards

On Thu, Feb 12, 2015 at 9:09 PM, Sebastien Goasguen 
wrote:

> First, ASF needs to be selected as a mentoring organization.
>
> Then students will apply and send proposals for listed projects. And we
> will accept or reject student proposals. We dont reject projects.
>
> Most likely however, if u want ur project to have a student u need to
> actively look for a student. Orherwise chances are there wont be proposals
> for ur project.
>
> -Sebastien
>
> > On 12 Feb 2015, at 16:08, Daan Hoogland  wrote:
> >
> > So Sebastien, What if anything is expected of potential mentors before
> > acceptance of projects?
> >
> >> On Thu, Feb 12, 2015 at 2:29 PM, Sebastien Goasguen 
> wrote:
> >>
> >>> On Feb 12, 2015, at 6:30 AM, Adrian Lewis 
> wrote:
> >>>
> >>> Would it be bad form to suggest ideas if we're neither student, nor a
> >>> mentor?
> >>
> >> not bad form, but there is an implicit suggestion that if you put up an
> idea in JIRA, then you will mentor a student that gets accepted for that
> project.
> >>
> >>>
> >>> -Original Message-
> >>> From: Tilak Raj Singh [mailto:tila...@gmail.com]
> >>> Sent: 06 February 2015 19:03
> >>> To: dev@cloudstack.apache.org
> >>> Subject: Re: Google Summer of Code 2015 is coming
> >>>
> >>> Hi,
> >>>
> >>> I posted my project idea for the same above in this thread. Have also
> >>> created a ticket for the same.
> >>> Link is https://issues.apache.org/jira/browse/CLOUDSTACK-8227
> >>>
> >>> On Fri, Feb 6, 2015 at 2:01 PM, Rohit Yadav  >
> >>> wrote:
> >>>
>  Tilak, I think you need to log in to see the filter. Nevertheless,
>  here are my proposed ideas:
> 
>  Integration Infra:
>  https://issues.apache.org/jira/browse/CLOUDSTACK-8208
>  Tooling: https://issues.apache.org/jira/browse/CLOUDSTACK-8207
>  Bhyve: https://issues.apache.org/jira/browse/CLOUDSTACK-8206
>  Docker: https://issues.apache.org/jira/browse/CLOUDSTACK-8205
> 
>  If you're interested in work on them, we can discuss here or if you
>  want a mentor you need to propose an idea here and also create a
>  ticket with tag 'gsoc2015' under CloudStack project.
> 
> 
> > On Thursday 05 February 2015 09:41 PM, Tilak Raj Singh wrote:
> >
> > @Rohit : Hi I just viewed the the link
> > https://issues.apache.org/jira/issues/?filter=12330309 and couldnt
> > find any projects. Did you add them somewhere else?
> >
> > @All : I am a student and want a mentor for my project on Cloudstack
> > Community. Can I also post a project idea there?
> >
> > Regards
> >
> > On Wed, Feb 4, 2015 at 2:08 PM, Andrei Mikhailovsky
> > 
> > wrote:
> >
> > +1 for support of Ceph in Xenserver
> >>
> >> Andrei
> >> - Original Message -
> >>
> >> From: "Erik Weber" 
> >>> To: "dev" 
> >>> Sent: Wednesday, 4 February, 2015 7:35:39 AM
> >>> Subject: Re: Google Summer of Code 2015 is coming
> >>
> >> Pure Xen support would be nice :-)
> >>
> >> (and Ceph in XenServer, but that's not really a CloudStack issue)
> >>
> >> --
> >>> Erik
> >>
> >> On Tue, Feb 3, 2015 at 9:42 AM, Sebastien Goasguen
> >> 
> >>> wrote:
> >>
> >> GSoC 2015 is back.
>  Time to enter your project proposals in jira if you want to
> mentor.
> 
>  Begin forwarded message:
> 
>  From: Ulrich Stärk 
> > Subject: Google Summer of Code 2015 is coming
> > Date: February 2, 2015 5:44:52 PM EST
> > To: ment...@community.apache.org
> > Reply-To: ment...@community.apache.org
> > Reply-To: ment...@community.apache.org
> >
> > Hello PMCs (incubator Mentors, please forward this email to your
>  podlings),
> 
> >
> > Google Summer of Code [1] is a program sponsored by Google
> > allowing
>  students to spend their summer
> 
> > working on open source software. Students will receive stipends
> > for
>  developing open source software
> 
> > full-time for three months. Projects will provide mentoring and
> > project
>  ideas, and in return have
> 
> > the chance to get new code developed and - most importantly - to
>  identify and bring in new committers.
> 
> >
> > The ASF will apply as a participating organization meaning
> > individual
> 

Jenkins build is still unstable: simulator-4.5-singlerun #161

[jenkins]

See 

Re: cloudstack ui plugin

[Daniel Vega Simões]

Hi, Ramzi

Check out the documentation for UI widgets instead:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/UI+widget+samples

DetailView widget allows for multiple tabs (and you can nest a listView
under it as well).

You can also take a look at the javascript files that already have multiple
tabs implemented (account.js, configuration.js, domains.js, instances.js
and so on) so you have an idea how to develop your own.

Hope this helped.



--
Daniel Simões
Time Evolução Infra - Globo.com
E-mail: daniel.sim...@corp.globo.com
Tel.: +55 21 2483-6977

2015-02-06 18:25 GMT-02:00 Mike Tutkowski :

> I've CCed a couple people who commonly develop GUI code for CloudStack.
>
> Hopefully one or both can help you out, Ramzi.
>
> On Fri, Feb 6, 2015 at 2:41 AM, Ramzi Youssefi 
> wrote:
>
> > Hello everyone!
> >
> > I'm trying to develop a UI plugin in javascript for cloudstack.
> > I have read a lot but I think the documentation for this purpose is very
> > little.
> > For instance, I'm trying to use tabs to divide the content of the plugin
> in
> > many parts. Each tab will show different data and so on.
> >
> > What I have read until now is that you can either show the content
> through
> >
> > show: function() {
> >
> > }
> >
> > or
> >
> > listView: {
> >
> > }
> >
> > None of these methods allow me to place tabs.
> > Is there any alternative to do this? or even better, is there any
> > documentation on how to develop plugins? the existing documentation in
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/UI+Plugin+Tutorial
> > is not sufficient.
> >
> > Thanks a lot!!
> >
> > --
> > Ramzi Youssefi
> > Görlitzer Str. 49
> > 01099 Dresden, Germany.
> > Cell: +49 173 1965465
> > Email: ryouss...@gmail.com
> >
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the cloud
> *™*
>

Re: Libvirt & RBD caching

[Andrei Mikhailovsky]

Ilya, i have followed the instructions on ceph website and it worked perfectly 
well. The only addition is to enable rbd caching in the ceph.conf 

Andrei 

- Original Message -

> From: "ilya musayev" 
> To: dev@cloudstack.apache.org
> Sent: Thursday, 19 February, 2015 10:21:22 AM
> Subject: Re: Libvirt & RBD caching

> Logan

> Side note: it would help great if you can post your notes/guide on
> setting up Ceph as primary with CloudStack.
> There arent any docs out there.

> Thanks
> ilya
> On 2/18/15 12:00 PM, Logan Barfield wrote:
> > Our current deployment is KVM with Ceph RBD primary storage. We
> > have
> > rbd_cache enabled, and use "cache=none" in Qemu by default.
> >
> > I've been running some tests to try to figure out why our write
> > speeds
> > with FreeBSD are significantly lower than Linux. I was testing both
> > RBD and local SSD storage, with various cache configurations. Out
> > of
> > all of them the only one that performed close to our standard Linux
> > images was local SSD, Qemu cache=writeback, FreeBSD gpt journal
> > enabled.
> >
> > I've been reading on various lists the reasons and risks for
> > cache=none vs cache=writeback:
> > - cache=none: Safer for live migration
> > - cache=writeback: Ceph RBD docs claim that this is required for
> > data
> > integrity when using rbd_cache
> >
> > From what I can tell performance is generally the same with both,
> > except in the case of FreeBSD.
> >
> > What is the current line of thinking on this? Should be using
> > 'none'
> > or 'writeback' with RBD by default? Is 'writeback' considered safe
> > for live migration?

Review Request 31189: skip password assignment from services

[sanjeev n]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31189/
---

Review request for cloudstack and SrikanteswaraRao Talluri.


Repository: cloudstack-git


Description
---

If self.password is available skip password assignement from test data


Diffs
-

  tools/marvin/marvin/lib/base.py 7443373 

Diff: https://reviews.apache.org/r/31189/diff/


Testing
---

yes


Thanks,

sanjeev n

Jenkins build is still unstable: simulator-singlerun #981

[jenkins]

See 

[GitHub] cloudstack pull request: mvn on buildslaves that don't have it in ...

[DaanHoogland]

Github user DaanHoogland commented on the pull request:

https://github.com/apache/cloudstack/pull/82#issuecomment-75069672
  
it does retrieve the version from the pom now but the build still fails on 
rpm dependencies. feel free to merge.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Libvirt & RBD caching

[Logan Barfield]

Hi Ilya,

I would like to document or blog about a great many things.
Unfortunately my time for that is limited right now.

As for what tests were run:  I was basically just doing a standard
'dd' test, which isn't a great indicator of real world usage, but
works well enough for comparison testing.

We were running write and read tests with 'bs=1M count=1024' and
'oflag/iflag=direct' in Linux.  The tests are all relative though, so
any options should work.

On Linux backed by RBD we were seeing roughly 150MB/s writes and
175MB/s+ reads.  On FreeBSD on RBD (with VirtIO) we were seeing
roughly 30MB/s writes and 100MB/s reads.

For FreeBSD we tested the following configurations (write speeds
indicated, reads were always reasonable @ ~100-200MB/s), we ran each
test a few times to get an average:
- RBD - Qemu 'cache=none': 30MB/s
- RBD - Qemu 'cache=writeback': 50MB/s
- Local SSD - Qemu 'cache=none': 50MB/s
- Local SSD - Qemu 'cache=writeback': ~125MB/s

As I mentioned before the 'Local SSD: writeback' configuration was the
only one that got us even close to Linux speeds.

I got a response on the Ceph list that I've yet to fully look over,
but it seems to indicate that there may be an issue with the FreeBSD
I/O sizes.  I'm also thinking it may just be a problem with the
FreeBSD VirtIO drivers, as they are still fairly new.

We'd like to be able to offer FreeBSD services on RBD, but right now
it's looking like we'd have to go with local storage to make it
viable.


Thank You,

Logan Barfield
Tranquil Hosting


On Thu, Feb 19, 2015 at 8:23 AM, Andrei Mikhailovsky  wrote:
> Ilya, i have followed the instructions on ceph website and it worked 
> perfectly well. The only addition is to enable rbd caching in the ceph.conf
>
> Andrei
>
> - Original Message -
>
>> From: "ilya musayev" 
>> To: dev@cloudstack.apache.org
>> Sent: Thursday, 19 February, 2015 10:21:22 AM
>> Subject: Re: Libvirt & RBD caching
>
>> Logan
>
>> Side note: it would help great if you can post your notes/guide on
>> setting up Ceph as primary with CloudStack.
>> There arent any docs out there.
>
>> Thanks
>> ilya
>> On 2/18/15 12:00 PM, Logan Barfield wrote:
>> > Our current deployment is KVM with Ceph RBD primary storage. We
>> > have
>> > rbd_cache enabled, and use "cache=none" in Qemu by default.
>> >
>> > I've been running some tests to try to figure out why our write
>> > speeds
>> > with FreeBSD are significantly lower than Linux. I was testing both
>> > RBD and local SSD storage, with various cache configurations. Out
>> > of
>> > all of them the only one that performed close to our standard Linux
>> > images was local SSD, Qemu cache=writeback, FreeBSD gpt journal
>> > enabled.
>> >
>> > I've been reading on various lists the reasons and risks for
>> > cache=none vs cache=writeback:
>> > - cache=none: Safer for live migration
>> > - cache=writeback: Ceph RBD docs claim that this is required for
>> > data
>> > integrity when using rbd_cache
>> >
>> > From what I can tell performance is generally the same with both,
>> > except in the case of FreeBSD.
>> >
>> > What is the current line of thinking on this? Should be using
>> > 'none'
>> > or 'writeback' with RBD by default? Is 'writeback' considered safe
>> > for live migration?

Re: [MERGE] Redundant VPC routers and persistent router config

[Ian Southam]

Hi All,

We have had a discussion about this development in-house and have decided to 
slow things down just a little.  We just want a few days to get our own 
integration test coverage better.  We hope that way to be able to merge code 
with a much fewer faults.

We do not however have the resources to test everything and of course we known 
there will be use cases out there that we have not properly considered.

Our plan, is to test Xen and KVM as thoroughly as we can.  We will not test 
VMware, OVM or Hyperv.  We hope that we can reply on the community to help us 
there!

The plan is then to aim to merge master on the 5 March (in two weeks time).

@Marcus.

Persistent config means that the configuration can survive reboots and crashes. 
 It should not affect recreate operations.

In the case of the VPC we explicitly provide both options, restart and recreate.

To be honest some of the things we do, do slightly challenge the cloud paradigm 
as our model does contain some elements of self healing.   Also we let VRRP 
make its own decisions about master and backup (whilst ensuring the the 
orchestration layer knows what is happening).  If you have some concerns about 
this, I am happy o discuss.

—
Grts!
Ian



On 18 Feb 2015, at 08:37, Daan Hoogland  wrote:

> Good point Marcus. I'll look into that.
> 
> On Tue, Feb 17, 2015 at 9:38 PM, Marcus  wrote:
>> Yes, I just want to make sure that it doesn't require/assume
>> persistency when some people rely on recreate.systemvm.enabled=true to
>> provide clean/fresh systemvms with every reboot, consistent with the
>> cloud paradigm.
>> 
>> On Tue, Feb 17, 2015 at 12:09 PM, Daan Hoogland  
>> wrote:
>>> Yes, the delete works. Dont know if we included the option recreate in
>>> our tests. Should not be a biggy though. It is not relevant for the
>>> persistency.
>>> 
>>> On Tue, Feb 17, 2015 at 8:05 PM, Marcus  wrote:
 But a recreate will still work, right? If you delete the router or set
 recreate.systemvm.enabled=true it will still result in a working
 router?
 
 On Tue, Feb 17, 2015 at 11:05 AM, Daan Hoogland  
 wrote:
> It means that cloudstack doesn't have to reconfigure them on reboot as
> they have the config on disk.
> 
> On Tue, Feb 17, 2015 at 4:16 PM, Marcus  wrote:
>> Can someone expand on what's meant by 'systemvm persistent config'?
>> Somehow this makes me think that the systemvms would no longer be
>> easily rebuildable.
>> 
>> On Tue, Feb 17, 2015 at 5:11 AM, Wilder Rodrigues
>>  wrote:
>>> Hi there,
>>> 
>>> I’m building a devcloud-kvm in order to test our changes with a 
>>> different environment as well.
>>> 
>>> Cheers,
>>> Wilder
>>> 
>>> 
>>> On 17 Feb 2015, at 01:46, Wilder Rodrigues 
>>>  wrote:
>>> 
 Hi all,
 
 I have been some tests on the branch in order to give you all some 
 confidence.
 
 During the tests I found 1 bug related to communication from VM A on 
 Tier 1 to VM B on Tier 2 in a Single VPC. I can reproduce the bug and 
 it disappears when I convert the Single VPC to a redundant one. I 
 already talked to Ian and he is on it.
 
 Results follow below.
 
 Cheers,
 Wilder
 
 Environment:
 
 Xen 6.2 running on VMware zone within our Betacloud (ACS 4.4.2)
 MySQL running on MacBook Pro
 Management Server on MacBook Pro
 
 ::: Manual Tests:::
 
 Isolated Networks
 
 * Create Network
 * Create 2 VMs using new Network
 * Create FW rules
 * Create PF rules
 * SSH to the VMs
 * SSH from one VM onto the other in the same isolated network
 * Destroy Master router
 * Restart the Network
 * Restart the Network with Clean-up option
 * Repeat steps above
 
 Redundant Isolated Networks
 
 * Create Redundant Network Offering
 * Create 2 VMs using new offering
 * Create FW rules
 * Create PF rules
 * SSH to the VMs
 * SSH from one VM onto the other in the same redundant isolated network
 * Destroy Master router
 * Restart the Network
 * Stop the Master Router
 
 Single VPC
 
 * Create VPC
 * Create 2 Tiers
 * Create ACLS
 * Create 1 Vm for each Tier
 * Associate 2 IP address
 * Add PF rules
 * SSH onto VMs
 * SSH from 1 VM onto another
 * Restart VPC - Make it redundant
 * Repeat steps above
 
 Redundant VPC
 
 * Create VPC
 * Create 2 Tiers
 * Create ACLS
 * Create 1 Vm for each Tier
 * Associate 2 IP address
 * Add PF rules
 * SSH onto VMs
 * SSH from 1 VM onto another

Re: [MERGE] Redundant VPC routers and persistent router config

[Nux!]

Ian,

Thanks for the clarification and effort.
I'm trying to make some time for testing as well, between 4.5 RCs. 

Can you guys remind me again where I can get your version from (ie git repo)?

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -
> From: "Ian Southam" 
> To: "Daan Hoogland" 
> Cc: "dev" , "John Kinsella" , 
> "int-cloud" 
> Sent: Thursday, 19 February, 2015 16:39:22
> Subject: Re: [MERGE] Redundant VPC routers and persistent router config

> Hi All,
> 
> We have had a discussion about this development in-house and have decided to
> slow things down just a little.  We just want a few days to get our own
> integration test coverage better.  We hope that way to be able to merge code
> with a much fewer faults.
> 
> We do not however have the resources to test everything and of course we known
> there will be use cases out there that we have not properly considered.
> 
> Our plan, is to test Xen and KVM as thoroughly as we can.  We will not test
> VMware, OVM or Hyperv.  We hope that we can reply on the community to help us
> there!
> 
> The plan is then to aim to merge master on the 5 March (in two weeks time).
> 
> @Marcus.
> 
> Persistent config means that the configuration can survive reboots and 
> crashes.
> It should not affect recreate operations.
> 
> In the case of the VPC we explicitly provide both options, restart and 
> recreate.
> 
> To be honest some of the things we do, do slightly challenge the cloud 
> paradigm
> as our model does contain some elements of self healing.   Also we let VRRP
> make its own decisions about master and backup (whilst ensuring the the
> orchestration layer knows what is happening).  If you have some concerns about
> this, I am happy o discuss.
> 
> —
> Grts!
> Ian
> 
> 
> 
> On 18 Feb 2015, at 08:37, Daan Hoogland  wrote:
> 
>> Good point Marcus. I'll look into that.
>> 
>> On Tue, Feb 17, 2015 at 9:38 PM, Marcus  wrote:
>>> Yes, I just want to make sure that it doesn't require/assume
>>> persistency when some people rely on recreate.systemvm.enabled=true to
>>> provide clean/fresh systemvms with every reboot, consistent with the
>>> cloud paradigm.
>>> 
>>> On Tue, Feb 17, 2015 at 12:09 PM, Daan Hoogland  
>>> wrote:
 Yes, the delete works. Dont know if we included the option recreate in
 our tests. Should not be a biggy though. It is not relevant for the
 persistency.
 
 On Tue, Feb 17, 2015 at 8:05 PM, Marcus  wrote:
> But a recreate will still work, right? If you delete the router or set
> recreate.systemvm.enabled=true it will still result in a working
> router?
> 
> On Tue, Feb 17, 2015 at 11:05 AM, Daan Hoogland  
> wrote:
>> It means that cloudstack doesn't have to reconfigure them on reboot as
>> they have the config on disk.
>> 
>> On Tue, Feb 17, 2015 at 4:16 PM, Marcus  wrote:
>>> Can someone expand on what's meant by 'systemvm persistent config'?
>>> Somehow this makes me think that the systemvms would no longer be
>>> easily rebuildable.
>>> 
>>> On Tue, Feb 17, 2015 at 5:11 AM, Wilder Rodrigues
>>>  wrote:
 Hi there,
 
 I’m building a devcloud-kvm in order to test our changes with a 
 different
 environment as well.
 
 Cheers,
 Wilder
 
 
 On 17 Feb 2015, at 01:46, Wilder Rodrigues 
 
 wrote:
 
> Hi all,
> 
> I have been some tests on the branch in order to give you all some 
> confidence.
> 
> During the tests I found 1 bug related to communication from VM A on 
> Tier 1 to
> VM B on Tier 2 in a Single VPC. I can reproduce the bug and it 
> disappears when
> I convert the Single VPC to a redundant one. I already talked to Ian 
> and he is
> on it.
> 
> Results follow below.
> 
> Cheers,
> Wilder
> 
> Environment:
> 
> Xen 6.2 running on VMware zone within our Betacloud (ACS 4.4.2)
> MySQL running on MacBook Pro
> Management Server on MacBook Pro
> 
> ::: Manual Tests:::
> 
> Isolated Networks
> 
> * Create Network
> * Create 2 VMs using new Network
> * Create FW rules
> * Create PF rules
> * SSH to the VMs
> * SSH from one VM onto the other in the same isolated network
> * Destroy Master router
> * Restart the Network
> * Restart the Network with Clean-up option
> * Repeat steps above
> 
> Redundant Isolated Networks
> 
> * Create Redundant Network Offering
> * Create 2 VMs using new offering
> * Create FW rules
> * Create PF rules
> * SSH to the VMs
> * SSH from one VM onto the other in the same redundant isolated 

jenkins jobs

[Daan Hoogland]

LS,

for your convenience and use in possible gate implementation I fixed
the parameterized rpm build job and added a parameterized slow build.
I am still testing the latter. don't hesitate to join me in that
effort;)

There is still a number of jobs disfunctional. Please help me fix
them. Though I think some can be deleted a number of them can be fixed
by documenters or testers maybe?

regards,
-- 
Daan

Re: [MERGE] Redundant VPC routers and persistent router config

[Nux!]

Ok, I'm building 
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/feature/systemvm-persistent-config

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -
> From: "Nux!" 
> To: dev@cloudstack.apache.org
> Cc: "Daan Hoogland" , "John Kinsella" 
> , "int-cloud"
> 
> Sent: Thursday, 19 February, 2015 17:11:26
> Subject: Re: [MERGE] Redundant VPC routers and persistent router config

> Ian,
> 
> Thanks for the clarification and effort.
> I'm trying to make some time for testing as well, between 4.5 RCs.
> 
> Can you guys remind me again where I can get your version from (ie git repo)?
> 
> Lucian
> 
> --
> Sent from the Delta quadrant using Borg technology!
> 
> Nux!
> www.nux.ro
> 
> - Original Message -
>> From: "Ian Southam" 
>> To: "Daan Hoogland" 
>> Cc: "dev" , "John Kinsella" ,
>> "int-cloud" 
>> Sent: Thursday, 19 February, 2015 16:39:22
>> Subject: Re: [MERGE] Redundant VPC routers and persistent router config
> 
>> Hi All,
>> 
>> We have had a discussion about this development in-house and have decided to
>> slow things down just a little.  We just want a few days to get our own
>> integration test coverage better.  We hope that way to be able to merge code
>> with a much fewer faults.
>> 
>> We do not however have the resources to test everything and of course we 
>> known
>> there will be use cases out there that we have not properly considered.
>> 
>> Our plan, is to test Xen and KVM as thoroughly as we can.  We will not test
>> VMware, OVM or Hyperv.  We hope that we can reply on the community to help us
>> there!
>> 
>> The plan is then to aim to merge master on the 5 March (in two weeks time).
>> 
>> @Marcus.
>> 
>> Persistent config means that the configuration can survive reboots and 
>> crashes.
>> It should not affect recreate operations.
>> 
>> In the case of the VPC we explicitly provide both options, restart and 
>> recreate.
>> 
>> To be honest some of the things we do, do slightly challenge the cloud 
>> paradigm
>> as our model does contain some elements of self healing.   Also we let VRRP
>> make its own decisions about master and backup (whilst ensuring the the
>> orchestration layer knows what is happening).  If you have some concerns 
>> about
>> this, I am happy o discuss.
>> 
>> —
>> Grts!
>> Ian
>> 
>> 
>> 
>> On 18 Feb 2015, at 08:37, Daan Hoogland  wrote:
>> 
>>> Good point Marcus. I'll look into that.
>>> 
>>> On Tue, Feb 17, 2015 at 9:38 PM, Marcus  wrote:
 Yes, I just want to make sure that it doesn't require/assume
 persistency when some people rely on recreate.systemvm.enabled=true to
 provide clean/fresh systemvms with every reboot, consistent with the
 cloud paradigm.
 
 On Tue, Feb 17, 2015 at 12:09 PM, Daan Hoogland  
 wrote:
> Yes, the delete works. Dont know if we included the option recreate in
> our tests. Should not be a biggy though. It is not relevant for the
> persistency.
> 
> On Tue, Feb 17, 2015 at 8:05 PM, Marcus  wrote:
>> But a recreate will still work, right? If you delete the router or set
>> recreate.systemvm.enabled=true it will still result in a working
>> router?
>> 
>> On Tue, Feb 17, 2015 at 11:05 AM, Daan Hoogland 
>>  wrote:
>>> It means that cloudstack doesn't have to reconfigure them on reboot as
>>> they have the config on disk.
>>> 
>>> On Tue, Feb 17, 2015 at 4:16 PM, Marcus  wrote:
 Can someone expand on what's meant by 'systemvm persistent config'?
 Somehow this makes me think that the systemvms would no longer be
 easily rebuildable.
 
 On Tue, Feb 17, 2015 at 5:11 AM, Wilder Rodrigues
  wrote:
> Hi there,
> 
> I’m building a devcloud-kvm in order to test our changes with a 
> different
> environment as well.
> 
> Cheers,
> Wilder
> 
> 
> On 17 Feb 2015, at 01:46, Wilder Rodrigues 
> 
> wrote:
> 
>> Hi all,
>> 
>> I have been some tests on the branch in order to give you all some 
>> confidence.
>> 
>> During the tests I found 1 bug related to communication from VM A on 
>> Tier 1 to
>> VM B on Tier 2 in a Single VPC. I can reproduce the bug and it 
>> disappears when
>> I convert the Single VPC to a redundant one. I already talked to Ian 
>> and he is
>> on it.
>> 
>> Results follow below.
>> 
>> Cheers,
>> Wilder
>> 
>> Environment:
>> 
>> Xen 6.2 running on VMware zone within our Betacloud (ACS 4.4.2)
>> MySQL running on MacBook Pro
>> Management Server on MacBook Pro
>> 
>> ::: Manual Tests:::
>> 
>> Isolated Networks
>> 
>> * Create Network
>> * Create 2 VMs using

Re: [MERGE] Redundant VPC routers and persistent router config

[Wilder Rodrigues]

Hey Nux,

Please stop building that one. :)

We got 2 bugs fixed in our working branch, which is in the Shuberg Philis 
public repo. We did not merge it back to the Apache branch because we want to 
test more (I’m working on the KVM test environment myself) and deliver a rock 
solid branch.

You should get this branch: 
https://github.com/schubergphilis/cloudstack/tree/feature/systemvm-persistent-config-4

And the latest systemvms ar available here (kvm, xen, hyperv, ovm): 
http://178.237.34.95:8000/

Spread the word.

Cheers,
Wilder


On 19 Feb 2015, at 19:00, Nux! mailto:n...@li.nux.ro>> wrote:

Ok, I'm building 
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/feature/systemvm-persistent-config

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -
From: "Nux!" 
To: dev@cloudstack.apache.org
Cc: "Daan Hoogland" , "John Kinsella" 
, "int-cloud"

Sent: Thursday, 19 February, 2015 17:11:26
Subject: Re: [MERGE] Redundant VPC routers and persistent router config

Ian,

Thanks for the clarification and effort.
I'm trying to make some time for testing as well, between 4.5 RCs.

Can you guys remind me again where I can get your version from (ie git repo)?

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -
From: "Ian Southam" 
To: "Daan Hoogland" 
Cc: "dev" , "John Kinsella" ,
"int-cloud" 
Sent: Thursday, 19 February, 2015 16:39:22
Subject: Re: [MERGE] Redundant VPC routers and persistent router config

Hi All,

We have had a discussion about this development in-house and have decided to
slow things down just a little.  We just want a few days to get our own
integration test coverage better.  We hope that way to be able to merge code
with a much fewer faults.

We do not however have the resources to test everything and of course we known
there will be use cases out there that we have not properly considered.

Our plan, is to test Xen and KVM as thoroughly as we can.  We will not test
VMware, OVM or Hyperv.  We hope that we can reply on the community to help us
there!

The plan is then to aim to merge master on the 5 March (in two weeks time).

@Marcus.

Persistent config means that the configuration can survive reboots and crashes.
It should not affect recreate operations.

In the case of the VPC we explicitly provide both options, restart and recreate.

To be honest some of the things we do, do slightly challenge the cloud paradigm
as our model does contain some elements of self healing.   Also we let VRRP
make its own decisions about master and backup (whilst ensuring the the
orchestration layer knows what is happening).  If you have some concerns about
this, I am happy o discuss.

—
Grts!
Ian



On 18 Feb 2015, at 08:37, Daan Hoogland  wrote:

Good point Marcus. I'll look into that.

On Tue, Feb 17, 2015 at 9:38 PM, Marcus  wrote:
Yes, I just want to make sure that it doesn't require/assume
persistency when some people rely on recreate.systemvm.enabled=true to
provide clean/fresh systemvms with every reboot, consistent with the
cloud paradigm.

On Tue, Feb 17, 2015 at 12:09 PM, Daan Hoogland  wrote:
Yes, the delete works. Dont know if we included the option recreate in
our tests. Should not be a biggy though. It is not relevant for the
persistency.

On Tue, Feb 17, 2015 at 8:05 PM, Marcus  wrote:
But a recreate will still work, right? If you delete the router or set
recreate.systemvm.enabled=true it will still result in a working
router?

On Tue, Feb 17, 2015 at 11:05 AM, Daan Hoogland  wrote:
It means that cloudstack doesn't have to reconfigure them on reboot as
they have the config on disk.

On Tue, Feb 17, 2015 at 4:16 PM, Marcus  wrote:
Can someone expand on what's meant by 'systemvm persistent config'?
Somehow this makes me think that the systemvms would no longer be
easily rebuildable.

On Tue, Feb 17, 2015 at 5:11 AM, Wilder Rodrigues
 wrote:
Hi there,

I’m building a devcloud-kvm in order to test our changes with a different
environment as well.

Cheers,
Wilder


On 17 Feb 2015, at 01:46, Wilder Rodrigues 
wrote:

Hi all,

I have been some tests on the branch in order to give you all some confidence.

During the tests I found 1 bug related to communication from VM A on Tier 1 to
VM B on Tier 2 in a Single VPC. I can reproduce the bug and it disappears when
I convert the Single VPC to a redundant one. I already talked to Ian and he is
on it.

Results follow below.

Cheers,
Wilder

Environment:

Xen 6.2 running on VMware zone within our Betacloud (ACS 4.4.2)
MySQL running on MacBook Pro
Management Server on MacBook Pro

::: Manual Tests:::

Isolated Networks

* Create Network
* Create 2 VMs using new Network
* Create FW rules
* Create PF rules
* SSH to the VMs
* SSH from one VM onto the other in the same isolated network
* Destroy Master router
* Restart the Network
* Restart the Network with Clean-up option
* Repeat steps above

Redundant Isolate

Jenkins build is still unstable: simulator-4.5-singlerun #162

[jenkins]

See 

Jenkins build is still unstable: simulator-singlerun #982

[jenkins]

See 

Re: Review Request 31181: CLOUDSTACK-8268: Code improvement - test_stopped_vm.py

[Gaurav Aradhye]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31181/
---

(Updated Feb. 20, 2015, 12:02 p.m.)


Review request for cloudstack and SrikanteswaraRao Talluri.


Bugs: CLOUDSTACK-8268
https://issues.apache.org/jira/browse/CLOUDSTACK-8268


Repository: cloudstack-git


Description
---

1. Read all the test data from test_data.py
2. Remove hard coded test data (Services class) from the test suite
3. Fix autopep8 issues
4. Move bootableVolume to configurableData section and make relevant changes in 
test case to read the data according to hypervisor


Diffs (updated)
-

  test/integration/component/test_stopped_vm.py 1cefc07 
  tools/marvin/marvin/config/test_data.py e8365ed 

Diff: https://reviews.apache.org/r/31181/diff/


Testing
---

Test Deploy HA enabled Virtual Machine with startvm=false ... === TestName: 
test_01_deploy_ha_vm_startvm_false | Status : SUCCESS ===
ok
Test Deploy HA enabled Virtual Machine from ISO ... SKIP: Bootable Iso URL not 
present in test data for xenserver
Test Deploy HA enabled Virtual Machine from ISO with startvm=false ... === 
TestName: test_03_deploy_ha_vm_iso_startvm_false | Status :
SUCCESS ===
ok
Test deploy VM on specific host ... === TestName: test_deployVmOnGivenHost | 
Status : SUCCESS ===
ok
Test Deploy Virtual Machine with no startVM parameter ... === TestName: 
test_01_deploy_vm_no_startvm | Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=true parameter ... === TestName: 
test_02_deploy_vm_startvm_true | Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false parameter ... === TestName: 
test_03_deploy_vm_startvm_false | Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false and attach volume ... === 
TestName: test_04_deploy_startvm_false_attach_volume |
Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false and change service offering ... 
=== TestName: test_05_deploy_startvm_false_change_so |
Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false and ... === TestName: 
test_06_deploy_startvm_attach_detach | Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false and attach ISO ... === TestName: 
test_07_deploy_startvm_attach_iso | Status : SUCCESS ===
ok
Test Deploy Virtual Machine with startVM=false and attach volume already 
attached to different machine ... === TestName:
test_08_deploy_attached_volume | Status : SUCCESS ===
ok
Test Stopped Virtual Machine's ROOT volume migration ... SKIP: No cluster with 
more than one primary storage pool to perform migrate
volume test
Test Deploy Virtual Machine with startVM=false & enabledpassword in ... === 
TestName: test_deploy_vm_password_enabled | Status :
SUCCESS ===
ok
Test Deploy Virtual Machine with no startVM parameter ... === TestName: 
test_01_deploy_vm_no_startvm | Status : SUCCESS ===
ok
Test Upload volume and attach to VM in stopped state ... === TestName: 
test_upload_attach_volume | Status : SUCCESS ===
ok
Test VM limit per account ... === TestName: test_vm_per_account | Status : 
SUCCESS ===
ok

--
Ran 17 tests in 1834.202s

OK (SKIP=2)


Thanks,

Gaurav Aradhye

RE: Google Summer of Code 2015 is coming

[Rajesh Battala]

Hi Tilak, 
Great to see you are interested In GSOC and Cloudstack.

Thanks
Rajesh Battala

-Original Message-
From: Tilak Raj Singh [mailto:tila...@gmail.com] 
Sent: Thursday, February 19, 2015 5:54 PM
To: dev@cloudstack.apache.org
Subject: Re: Google Summer of Code 2015 is coming

Reagarding CLOUDSTACK-8266 (
https://issues.apache.org/jira/browse/CLOUDSTACK-8266?filter=12330309)

I am interested in implementing this feature in cloudstack this GSOC 2015.
I am a final year student from NIT Allahabad, India pursuing my Bachelors in 
Information Technology. I went through the youtube video link present in the 
project description and currently am getting familiarised with the cloudstack 
database to gather the metrics that can be used to support this feature.

Regards

On Thu, Feb 12, 2015 at 9:09 PM, Sebastien Goasguen 
wrote:

> First, ASF needs to be selected as a mentoring organization.
>
> Then students will apply and send proposals for listed projects. And 
> we will accept or reject student proposals. We dont reject projects.
>
> Most likely however, if u want ur project to have a student u need to 
> actively look for a student. Orherwise chances are there wont be 
> proposals for ur project.
>
> -Sebastien
>
> > On 12 Feb 2015, at 16:08, Daan Hoogland  wrote:
> >
> > So Sebastien, What if anything is expected of potential mentors 
> > before acceptance of projects?
> >
> >> On Thu, Feb 12, 2015 at 2:29 PM, Sebastien Goasguen 
> >> 
> wrote:
> >>
> >>> On Feb 12, 2015, at 6:30 AM, Adrian Lewis 
> >>> 
> wrote:
> >>>
> >>> Would it be bad form to suggest ideas if we're neither student, 
> >>> nor a mentor?
> >>
> >> not bad form, but there is an implicit suggestion that if you put 
> >> up an
> idea in JIRA, then you will mentor a student that gets accepted for 
> that project.
> >>
> >>>
> >>> -Original Message-
> >>> From: Tilak Raj Singh [mailto:tila...@gmail.com]
> >>> Sent: 06 February 2015 19:03
> >>> To: dev@cloudstack.apache.org
> >>> Subject: Re: Google Summer of Code 2015 is coming
> >>>
> >>> Hi,
> >>>
> >>> I posted my project idea for the same above in this thread. Have 
> >>> also created a ticket for the same.
> >>> Link is https://issues.apache.org/jira/browse/CLOUDSTACK-8227
> >>>
> >>> On Fri, Feb 6, 2015 at 2:01 PM, Rohit Yadav 
> >>>  >
> >>> wrote:
> >>>
>  Tilak, I think you need to log in to see the filter. 
>  Nevertheless, here are my proposed ideas:
> 
>  Integration Infra:
>  https://issues.apache.org/jira/browse/CLOUDSTACK-8208
>  Tooling: https://issues.apache.org/jira/browse/CLOUDSTACK-8207
>  Bhyve: https://issues.apache.org/jira/browse/CLOUDSTACK-8206
>  Docker: https://issues.apache.org/jira/browse/CLOUDSTACK-8205
> 
>  If you're interested in work on them, we can discuss here or if 
>  you want a mentor you need to propose an idea here and also 
>  create a ticket with tag 'gsoc2015' under CloudStack project.
> 
> 
> > On Thursday 05 February 2015 09:41 PM, Tilak Raj Singh wrote:
> >
> > @Rohit : Hi I just viewed the the link
> > https://issues.apache.org/jira/issues/?filter=12330309 and 
> > couldnt find any projects. Did you add them somewhere else?
> >
> > @All : I am a student and want a mentor for my project on 
> > Cloudstack Community. Can I also post a project idea there?
> >
> > Regards
> >
> > On Wed, Feb 4, 2015 at 2:08 PM, Andrei Mikhailovsky 
> > 
> > wrote:
> >
> > +1 for support of Ceph in Xenserver
> >>
> >> Andrei
> >> - Original Message -
> >>
> >> From: "Erik Weber" 
> >>> To: "dev" 
> >>> Sent: Wednesday, 4 February, 2015 7:35:39 AM
> >>> Subject: Re: Google Summer of Code 2015 is coming
> >>
> >> Pure Xen support would be nice :-)
> >>
> >> (and Ceph in XenServer, but that's not really a CloudStack 
> >> issue)
> >>
> >> --
> >>> Erik
> >>
> >> On Tue, Feb 3, 2015 at 9:42 AM, Sebastien Goasguen 
> >> 
> >>> wrote:
> >>
> >> GSoC 2015 is back.
>  Time to enter your project proposals in jira if you want to
> mentor.
> 
>  Begin forwarded message:
> 
>  From: Ulrich Stärk 
> > Subject: Google Summer of Code 2015 is coming
> > Date: February 2, 2015 5:44:52 PM EST
> > To: ment...@community.apache.org
> > Reply-To: ment...@community.apache.org
> > Reply-To: ment...@community.apache.org
> >
> > Hello PMCs (incubator Mentors, please forward this email to 
> > your
>  podlings),
> 
> >
> > Google Summer of Code [1] is a program sponsored by Google 
> > allowing
>  students to spend their summer
> 
> > working on open source software. Students will receive 
> > stipends for
>  developing open source software
> 
> > full-time for thre

Re: Review Request 30821: CLOUDSTACK-8236: Automation test cases for storage migration test path

[Ashutosh Kelkar]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30821/
---

(Updated Feb. 20, 2015, 7:38 a.m.)


Review request for cloudstack and SrikanteswaraRao Talluri.


Changes
---

Addded 10 more scenarios and code re-factor of existing code.


Bugs: CLOUDSTACK-8236
https://issues.apache.org/jira/browse/CLOUDSTACK-8236


Repository: cloudstack-git


Description
---

First few test scenarios for storage migration test path.


Diffs (updated)
-

  test/integration/testpaths/testpath_storage_migration.py PRE-CREATION 
  tools/marvin/marvin/codes.py a7e8ec8 
  tools/marvin/marvin/config/test_data.py e8365ed 
  tools/marvin/marvin/lib/base.py 7443373 

Diff: https://reviews.apache.org/r/30821/diff/


Testing
---

Some scenarios are failing, e.g migrating volume from CWSP to ZWSP should raise 
exception, but it is not. Investigating on that.


Thanks,

Ashutosh Kelkar

[DISCUSS] Improving VR services such as password server

[Rohit Yadav]

Hi,

I'm trying to explore how to make systemvms more robust and
fault-tolerant, and the manual/automated QA of systemvms. One of the
common user facing issues related to scalability was the reset
password/key servers where the VR serves data using socat etc using
forking mechanisms and global locks. This slows down the processes such
as reset password.

More here: https://issues.apache.org/jira/browse/CLOUDSTACK-8272

One of the blindly thrown solutions includes increasing the VR RAM which
works for at scale but then seems to fail again when the load is
increased beyond a point. I don't know of any performance and stress
testing reports that tell us about these bottlenecks. Please share if
you have done anything in this regard.

I want to do couple of things:

- Explore systemvm build changes using newer tools such as packer
- Cleanup script execution and code in resource layer
- Start replacing bash scripts with more robust implementations, perhaps
a single or few agents on VRs that provide non-hardcoded well-documented
interfaces
- Right now everything in VR/systemvms is sort of hardcoded and the
services/interfaces are not well-documented. The idea is to refactor and
wrap everything we want to do with the systemvms in a general agents
framework that provides monitoring and managing the VRs (do stuff like
upgrades etc to combat things like ghost, poodle issues):
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Agents+Framework

What are the other issues you've had in past that you would like to be
improved?

--
Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 8826230892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab
PS. If you see any footer below, I did not add it :)
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended solely 
for the use of the individual to whom it is addressed. Any views or opinions 
expressed are solely those of the author and do not necessarily represent those of 
Shape Blue Ltd or related companies. If you are not the intended recipient of this 
email, you must neither take any action based upon its contents, nor copy or show 
it to anyone. Please contact the sender if you believe you have received this email 
in error. Shape Blue Ltd is a company incorporated in England & Wales. 
ShapeBlue Services India LLP is a company incorporated in India and is operated 
under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company 
incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue 
SA Pty Ltd is a company registered by The Republic of South Africa and is traded 
under license from Shape Blue Ltd. ShapeBlue is a registered trademark.