Re: Review Request 15746: Service Offering being created without host tags due to mismatch with base for test_vpc_vm_life_cycle.py.

2013-11-26 Thread Girish Shilamkar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15746/#review29426
---

Ship it!


Ship It!

- Girish Shilamkar


On Nov. 21, 2013, 1:28 a.m., Parth Jagirdar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15746/
> ---
> 
> (Updated Nov. 21, 2013, 1:28 a.m.)
> 
> 
> Review request for cloudstack, edison su and Girish Shilamkar.
> 
> 
> Bugs: https://issues.apache.org/jira/browse/CLOUDSTACK-5223
> 
> https://issues.apache.org/jira/browse/https://issues.apache.org/jira/browse/CLOUDSTACK-5223
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Service Offering being created without host tags due to mismatch with base.
> 
> 
> Diffs
> -
> 
>   test/integration/component/test_vpc_vm_life_cycle.py beb5b99 
> 
> Diff: https://reviews.apache.org/r/15746/diff/
> 
> 
> Testing
> ---
> 
> Yes
> 
> 
> Thanks,
> 
> Parth Jagirdar
> 
>



[JENKINS] Disappearing jobs

2013-11-26 Thread Hugo Trippaers
Hey guys,

Some of the main build jobs in 4.2 and 4.3 have disappeared. I’m restoring them 
now.

I’ve removed the jobs for the 4.0 and 4.1 branches as no further releases will 
be done on those branches afaik.

Cheers,

Hugo



Re: Review Request #15566 - CLOUDSTACK-4969

2013-11-26 Thread Daan Hoogland
Yichi,

Can you update your patch? I will apply it but it doesn't apply to master now.

regards

On Fri, Nov 22, 2013 at 8:37 PM, Yichi Lu  wrote:
> -- Forwarded message --
> From: Yichi Lu 
> Date: Fri, Nov 22, 2013 at 9:38 AM
> Subject: Review Request #15566 - CLOUDSTACK-4969
> To: us...@cloudstack.apache.org
>
>
> Dear Committers:
> I submitted this review request a week ago, but have not received any
> response. I'd appreciate if someone could review this for me. (My another
> request, # 15633, CLOUDSTACK-5079 is about 5 days old). Thanks.
>
> Yichi


Re: Review Request 15505: Usage details are not getting populated when using dynamic offerings.

2013-11-26 Thread bharat kumar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15505/
---

(Updated Nov. 26, 2013, 8:42 a.m.)


Review request for cloudstack, Kishan Kavala and Koushik Das.


Changes
---

updated with review comments.


Bugs: CLOUDSTACK-5162
https://issues.apache.org/jira/browse/CLOUDSTACK-5162


Repository: cloudstack-git


Description
---

Usage details are not getting populated when using dynamic offerings.
CLOUDSTACK-5162


Diffs (updated)
-

  engine/schema/src/com/cloud/service/ServiceOfferingVO.java 67fea00 
  server/src/com/cloud/vm/UserVmManagerImpl.java 00d8063 

Diff: https://reviews.apache.org/r/15505/diff/


Testing
---

tested on master.


Thanks,

bharat kumar



Build failed in Jenkins: build-systemvm64-4.2 #97

2013-11-26 Thread jenkins
See 

Changes:

[girish] CLOUDSTACK-5257: Fixed Network ACL issue related to Egress traffic

[girish] CLOUDSTACK-5223: Fix hosttags.

--
[...truncated 327 lines...]
++ GREP_OPTIONS=
++ grep -v /home/jenkins/.rvm
++ builtin command -v ruby
++ GREP_OPTIONS=
++ grep '/home/jenkins/.rvm/bin/ruby$'
++ [[ -s /home/jenkins/.rvm/environments/default ]]
++ [[ '' != \s\w\i\t\c\h ]]
++ source /home/jenkins/.rvm/environments/default
+++ export PATH
+++ 
PATH=/home/jenkins/.rvm/gems/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385@global/bin:/home/jenkins/.rvm/rubies/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/bin:/home/jenkins/.rvm/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385@global/bin:/home/jenkins/.rvm/rubies/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games
+++ export rvm_env_string
+++ rvm_env_string=ruby-1.9.3-p385
+++ export rvm_path
+++ rvm_path=/home/jenkins/.rvm
+++ export rvm_ruby_string
+++ rvm_ruby_string=ruby-1.9.3-p385
+++ unset rvm_gemset_name
+++ export RUBY_VERSION
+++ RUBY_VERSION=ruby-1.9.3-p385
+++ export GEM_HOME
+++ GEM_HOME=/home/jenkins/.rvm/gems/ruby-1.9.3-p385
+++ export GEM_PATH
+++ 
GEM_PATH=/home/jenkins/.rvm/gems/ruby-1.9.3-p385:/home/jenkins/.rvm/gems/ruby-1.9.3-p385@global
+++ export MY_RUBY_HOME
+++ MY_RUBY_HOME=/home/jenkins/.rvm/rubies/ruby-1.9.3-p385
+++ export IRBRC
+++ IRBRC=/home/jenkins/.rvm/rubies/ruby-1.9.3-p385/.irbrc
+++ unset MAGLEV_HOME
+++ unset RBXOPT
++ __rvm_conditionally_add_bin_path
++ [[ 
:/home/jenkins/.rvm/gems/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385@global/bin:/home/jenkins/.rvm/rubies/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/bin:/home/jenkins/.rvm/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385@global/bin:/home/jenkins/.rvm/rubies/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:
 =~ :/home/jenkins/\.rvm/bin: ]]
++ ((  0 == 1  ))
++ rvm_loaded_flag=1
++ unset rvm_prefix_needs_trailing_slash rvm_gems_cache_path rvm_gems_path 
rvm_project_rvmrc_default rvm_gemset_separator rvm_reload_flag
++ [[ -t 0 ]]
++ __rvm_teardown
++ builtin command -v __rvm_cleanup_tmp
++ __rvm_cleanup_tmp
++ [[ -d /home/jenkins/.rvm/tmp/ ]]
++ case "${rvm_tmp_path%\/}" in
++ __rvm_rm_rf '/home/jenkins/.rvm/tmp/26777*'
++ __rvm_rm_rf_verbose '/home/jenkins/.rvm/tmp/26777*'
++ typeset result target
++ result=1
++ target='/home/jenkins/.rvm/tmp/26777*'
++ [[ -n '' ]]
++ [[ -n 4.2.24(1)-release ]]
++ shopt -s extglob
++ case "${target}" in
++ [[ -n /home/jenkins/.rvm/tmp/26777* ]]
++ [[ -d /home/jenkins/.rvm/tmp/26777* ]]
++ [[ -f /home/jenkins/.rvm/tmp/26777* ]]
++ [[ -L /home/jenkins/.rvm/tmp/26777* ]]
++ result=0
++ return 0
++ return 0
++ export __rvm_env_loaded
++ : __rvm_env_loaded:1:
++ : __rvm_env_loaded:1:
++ : __rvm_env_loaded:0:
++ [[ -z /home/jenkins/.rvm/tmp ]]
++ ((  __rvm_env_loaded > 0  ))
++ [[ -n 4.2.24(1)-release ]]
++ trap - 0 1 2 3 15
++ [[ -n '' ]]
++ [[ -n 0002 ]]
++ umask 0002
++ unset rvm_stored_umask
++ [[ '' == \1 ]]
++ __variables_definition unset
++ typeset -a __variables_list __array_list
++ typeset __method
++ __method=unset
++ __variables_list=(rvm_head_flag rvm_ruby_selected_flag rvm_user_install_flag 
rvm_path_flag rvm_cron_flag rvm_static_flag rvm_default_flag rvm_loaded_flag 
rvm_llvm_flag rvm_skip_autoreconf_flag rvm_18_flag rvm_19_flag 
rvm_force_autoconf_flag rvm_dump_environment_flag rvm_verbose_flag 
rvm_debug_flag rvm_trace_flag rvm_pretty_print_flag rvm_create_flag 
rvm_remove_flag rvm_gemdir_flag rvm_reload_flag rvm_auto_reload_flag 
rvm_disable_binary_flag rvm_ignore_gemsets_flag rvm_skip_gemsets_flag 
rvm_install_on_use_flag rvm_remote_flag rvm_verify_downloads_flag 
rvm_skip_openssl_flag rvm_gems_cache_path rvm_gems_path rvm_man_path 
rvm_ruby_gem_path rvm_ruby_log_path rvm_gems_cache_path rvm_archives_path 
rvm_docs_path rvm_environments_path rvm_examples_path rvm_gems_path 
rvm_gemsets_path rvm_help_path rvm_hooks_path rvm_lib_path rvm_log_path 
rvm_patches_path rvm_repos_path rvm_rubies_path rvm_scripts_path rvm_src_path 
rvm_tmp_path rvm_user_path rvm_usr_path rvm_wrappers_path rvm_externals_path 
rvm_stored_errexit rvm_ruby_strings rvm_ruby_binary rvm_ruby_gem_home 
rvm_ruby_home rvm_ruby_interpreter rvm_ruby_irbrc rvm_ruby_major_version 
rvm_ruby_minor_version rvm_ruby_package_name rvm_ruby_patch_level 
rvm_ruby_release_version rvm_ruby_repo_url rvm_ruby_repo_branch 
rvm_ruby_revision rvm_ruby_tag rvm_ruby_sha rvm_ruby_version 
rvm_ruby_package_file rvm_ruby_name rvm_ruby_name rvm_ruby_args 
rvm_ruby_user_tag rvm_ruby_patch detected_rvm_ruby_name __rvm_env_loaded 
next_token rvm_error_message rvm_gemset_name rvm_parse_break rvm_token 
rvm_action rvm_export_args rvm_gemset_separator rvm_expanding_alias

Build failed in Jenkins: build-4.2 #1

2013-11-26 Thread jenkins
See 

--
[...truncated 23439 lines...]
1487/1616 KB   
1491/1616 KB   
1495/1616 KB   
1499/1616 KB   
1503/1616 KB   
1507/1616 KB   
1511/1616 KB   
1515/1616 KB   
1519/1616 KB   
1523/1616 KB   
1527/1616 KB   
1531/1616 KB   
1535/1616 KB   
1539/1616 KB   
1543/1616 KB   
1547/1616 KB   
1551/1616 KB   
1555/1616 KB   
1559/1616 KB   
1563/1616 KB   
1567/1616 KB   
1571/1616 KB   
1575/1616 KB   
1579/1616 KB   
1583/1616 KB   
1587/1616 KB   
1588/1616 KB   
1592/1616 KB   
1596/1616 KB   
1600/1616 KB   
1604/1616 KB   
1608/1616 KB   
1612/1616 KB   
1616/1616 KB   
   
Downloaded: 
http://repo.maven.apache.org/maven2/org/openqa/selenium/core/selenium-core/1.0-20080914.225453/selenium-core-1.0-20080914.225453.jar
 (1616 KB at 5588.6 KB/sec)
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ cloud-testclient ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-testclient ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
cloud-testclient ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ 
cloud-testclient ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
cloud-testclient ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
cloud-testclient ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ cloud-testclient ---
[INFO] Surefire report directory: 


---
 T E S T S
---

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Console Proxy Service 4.2.1-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ 
cloudstack-service-console-proxy ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloudstack-service-console-proxy ---
[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Console Proxy 4.2.1-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ cloud-console-proxy 
---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-console-proxy ---
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ 
cloud-console-proxy ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 5 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ 
cloud-console-proxy ---
[INFO] Compiling 55 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ 
cloud-console-proxy ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
cloud-console-proxy ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12:test (default-test) @ cloud-console-proxy 
---
[INFO] Surefire report directory: 


---
 T E S T S
---

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Client UI 4.2.1-SNAPSHOT
[INFO] 

Re: Resource Management/Locking [was: Re: What would be your ideal solution?]

2013-11-26 Thread Pierre-Yves Ritschard
Hi Everyone,

First off, I'm really excited that there is an undergoing discussion on
these issues.
I agree with john that CAP provides a good "framework" for looking at the
individual properties of the distributed system that cloudstack is, as a
whole. The separation between an orchestration layer and automation layer
is also a valid abstraction of the main roles of the management server.

As far as CAP properties are concerned, I don't think there is much
question that the aim is for:

* a CP orchestration layer (it will continue to rely on a CP system: an
RDBMS)
* an AP automation layer (it is tied to an AP system, a cluster of
hypervisors)

As far as operations are concerned I think the plugin approach in CS is
great, it allows to distribute a very simple system to start with, where a
single management server will most likely run. In largely distributed
systems it is certainly not a crazy requirement to rely on zookeeper, in
many shops using CS, ZK is already used anyhow, operation-wise, it is not
more complex than, say, maintaining a highly available MySQL cluster.

Before I go on, I'll just acknowledge here that I'm not addressing the
issue of compatibility, all approaches discussed so far, except Darren's do
not concern themselves with compatibility and upgrades which will be a
major pain if the persistence layer / data store evolves in any significant
way. I know this is a big concern for CS users and citrix, and will need to
be taken into account, I don't have a clear picture of how this could be
done.

As far as persistence is concerned, there are different things that CS
stores which have different requirements:

* Organizational data needs strong consistency: users, accounts, domains,
projects, configuration (for networks, templates, ...)
* Transient resource data (vm running status) can only have eventual
consistency
* Usage data only requires eventual consistency (and does not need to
clutter the main data store)

I think one of the reasons for the head-scratching around resources right
now is that the persistence layer is right now used both for storing the
expected state of resources and their actual state, maybe their should be a
transient persistence layer used for storing known states.

So to sum up, as far as storage is concerned it might be easier to reason
about CS in terms of three different persistence layer:

* A main layer for organizational data, expected state and last known state
* A layer for storing state as reported by resource owners (hypervisors)
* A mechanism for distributing usage data

With such a system, the mailbox approach is possible. I do think that the
amount of work in CS would be huge and that we would risk ending up with a
franken-erlang type system which java doesn't lend itself well too (surely
scala could but this would imply a total rewrite).

An intermediate step could be to look at resources the same way Apache
Kafka does (or in a way Apache Cassandra). Managers could be seen as a
homogeneous clusters responsible for an nth of the cluster (for a cluster
of n managers). A good mechanism is needed for agreeing on cluster
membership, but there are several proven and valid approaches for this (and
its a problem that lends itself well to the plugin approach in CS).

A typical incoming API request would thus hit any management node, which
could either issue a redirect to the correct node, proxy it to the correct
node or create a jobid and let the client query the jobid for its status.

The upside of this approach is that it still makes it possible for CS to
become the jenkins of cloud controllers (it would need an HSQLDB option for
persistence though !) and rely on proven and well understood projects for
larger deployments (like ZK, or when it stabilizes, an implementation of
raft).

A first step towards this would be to have some sort of agreement on the
different layers of persistence needed throughout CS and try to move
forward. I can get my hands dirty and try to evolve the Dao stuff that is
everywhere in CS, but I'd like to know I'm not going towards a dead-end.








On Mon, Nov 25, 2013 at 10:18 PM, Darren Shepherd <
darren.s.sheph...@gmail.com> wrote:

> Okay, I'll have to stew over this for a bit.  My one general comment is
> that it seems complicated.  Such a system seems like it would take a good
> amount of effort to construct properly and as such it's a risky endeavour.
>
> Darren
>
>
> On Mon, Nov 25, 2013 at 12:10 PM, John Burwell  wrote:
>
> > Darren,
> >
> > In a peer-to-peer model such as I describe, active-active is and is not a
> > concept.  The supervision tree is responsible for identifying failure,
> and
> > initiating process re-allocation for failed resources.  For example, if a
> > pod’s management process crashed, it would also crash all of the
> processes
> > managing the hosts in that pod.  The zone would then attempt to restart
> the
> > pod’s management process (either local to the zone supervisor or on a
> > remote instance whi

Re: JIRA 3061

2013-11-26 Thread Daan Hoogland
H Mandar,

You can contact the reporter directly but that would only be to ask to
verify in the newer version. This can be a hassle for small plants. So
you could put to resolved with the right fix-version.

regards,


On Mon, Nov 25, 2013 at 9:00 AM, Mandar Barve  wrote:
> Hi all,
>
> Problem: JIRA says list hosts API response didn't return CPU used parameter
> value. This bug is reported against version 4.0.2.
>
> I could not reproduce this problem with CS version 4.2.
>
> I used CloudMonkey CLI to fire API commands to the management server. With
> a basic zone created that has 1 pod, cluster and couple of system vms
> connected to the management server using CloudMonkey CLI sent the list
> hosts API command and the JSON response output could be captured in the log
> file. JSON response and the CLI output shows "cpuused". The value seen here
> could be matched against the portal reported host statistics value for CPU
> used.
>
> CLI output:
>
>> list hosts
> count = 1
> host:
> id = df4fe805-a320-4417-b8be-22dd0b86561e
> name = devcloud
> capabilities = xen-3.0-x86_32p , hvm
> clusterid = b3b80638-1fc5-4d13-aafc-28ff5155c681
> clustername = test000
> clustertype = CloudManaged
> cpuallocated = 0%
> cpunumber = 2
> cpuspeed = 2486
> *cpuused = 0.22%*
> cpuwithoverprovisioning = 4972.0
> created = 2013-10-07T18:57:58+0530
> disconnected = 2013-10-15T11:24:19+0530
> events = PingTimeout; AgentConnected; HostDown; ShutdownRequested;
> AgentDisconnected; ManagementServerDown; Remove; Ping; StartAgentRebalance
> hahost = False
> hypervisor = XenServer
> ipaddress = 192.168.56.10
> islocalstorageactive = False
> lastpinged = 1970-01-16T20:20:29+0530
>
>  JSON response log:
>
> 2013-10-15 11:48:32,724 - requester.py:45 - [DEBUG]  START Request
> 
> 2013-10-15 11:48:32,724 - requester.py:45 - [DEBUG] Requesting
> command=listHosts, args={}
> 2013-10-15 11:48:32,725 - requester.py:45 - [DEBUG] Request sent:
> http://localhost:8080/client/api?apiKey=c9uPXphFfiQS5589hVp245hWrqcg1yxcVNg9h1xJES34j8uAtvKj0EP6h8jlSC5_VlajL1a2TaXuYFGoON0DMg&command=listHosts&response=json&signature=hKQ5hI0XFpAzNPJYJ7ivR53%2FzJU%3D
> 2013-10-15 11:48:32,820 - requester.py:45 - [DEBUG] Response received: {
> "listhostsresponse" : { "count":1 ,"host" : [
>  
> {"id":"df4fe805-a320-4417-b8be-22dd0b86561e","name":"devcloud","state":"Up","disconnected":"2013-10-15T11:24:19+0530","type":"Routing","ipaddress":"192.168.56.10","zoneid":"7b015b74-f00f-4216-b523-efc2e32c6bc5","zonename":"DevCloud0","podid":"c58e91d0-ad57-4d09-a485-f0decab857b4","podname":"test00","version":"4.2.0","hypervisor":"XenServer","cpunumber":2,"cpuspeed":2486,"cpuallocated":"0%",
> *"cpuused":"0.22%"*,"cpuwithoverprovisioning":"4972.0","networkkbsread":57462,"networkkbswrite":38105,"memorytotal":251632,"memoryallocated":0,"memoryused":546428,"capabilities":"xen-3.0-x86_32p
> ,
> hvm","lastpinged":"1970-01-16T20:20:29+0530","managementserverid":8796750265493,"clusterid":"b3b80638-1fc5-4d13-aafc-28ff5155c681","clustername":"test000","clustertype":"CloudManaged","islocalstorageactive":false,"created":"2013-10-07T18:57:58+0530","events":"PingTimeout;
> AgentConnected; HostDown; ShutdownRequested; AgentDisconnected;
> ManagementServerDown; Remove; Ping;
> StartAgentRebalance","resourcestate":"Enabled","hahost":false} ] } }
> 2013-10-15 11:48:32,821 - requester.py:45 - [DEBUG]  END Request
> 
>
> Can this be closed? I have updated the JIRA with same comment.
>
> Thanks,
> Mandar


Re: JIRA 285

2013-11-26 Thread Daan Hoogland
Mandar,

As you have updated the ticket, the reporter should have been notified
of your findings. I think resolving it is the proper way to go, and if
the reporter doesn't close or reopen it withing a month or so, close
it.

regards

On Mon, Nov 25, 2013 at 9:10 AM, Mandar Barve  wrote:
> Hi all,
>  I could not reproduce this issue with vesion 4.0.2. I tried creating
> hourly snapshot schedule with a keep value of 4. I could see 4 snapshots
> retained. Then as mentioned in the bug I deleted the schedule and recreated
> with same parameters except changing the keep value to 3. After this I
> could see only 3 snapshots retained.
>
> Has this been resolved? Can it be closed? I have updated the JIRA with my
> comments.
>
> Thanks,
> Mandar


Jenkins build is back to normal : build-4.2 #2

2013-11-26 Thread jenkins
See 



Re: [DISCUSS] Reporting tool for feeding back zone, pod and cluster information

2013-11-26 Thread Daan Hoogland
I'd say the opt in can be a check in the start-up wizard. You want to
make sure enough people run it. Or even a intermediate page on the
admin logins that would have to be disabled explicitly.


I do not believe in data collected by optional inquiries. Would kvm
users have more incentive to participate then vmware users? Do
noredist users have the liberty to participate or is it so that oss
users have used their management credit for openness by the time they
get to the tool? Only full coverage data is really useful.


let's be extra careful in handling and interpreting the results,
Daan

On Mon, Nov 25, 2013 at 11:25 AM, Sebastien Goasguen  wrote:
>
> On Nov 23, 2013, at 5:01 AM, Wido den Hollander  wrote:
>
>> Hi,
>>
>> I discussed this during CCCEU13 with David, Chip and Hugo and I promised I 
>> put it on the ml.
>>
>> My idea is to come up with a reporting tool which users can run daily which 
>> feeds us back information about how they are using CloudStack:
>>
>> * Hypervisors
>> * Zone sizes
>> * Cluster sizes
>> * Primary Storage sizes and types
>> * Same for Secondary Storage
>> * Number of management servers
>> * Version
>>
>> This would ofcourse be anonimized where we would send one file with JSON 
>> data back to our servers where we can proccess it to do statistics.
>>
>> The tool will obviously be open source and participating in this will be 
>> opt-in only.
>>
>> We currently don't know what's running out there, so that would be great to 
>> know.
>>
>> Some questions remain:
>> * Who is going to maintain the data?
>> * Who has access to the data?
>> * How long do we keep it?
>> * Do we do logging of IPs sending the data to us?
>>
>> I certainly do not want to spy on our users, so that's why it's opt-in and 
>> the tool should be part of the main repo, but I think that for us as a 
>> project it's very useful to know what our users are doing with CloudStack.
>>
>> Comments?
>>
>
> +1
>
>> Wido
>


Re: Review Request 15505: Usage details are not getting populated when using dynamic offerings.

2013-11-26 Thread Koushik Das

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15505/#review29427
---

Ship it!


master -> ef40e156ed376968fa9fd15078034d54b97deecc

- Koushik Das


On Nov. 26, 2013, 8:42 a.m., bharat kumar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15505/
> ---
> 
> (Updated Nov. 26, 2013, 8:42 a.m.)
> 
> 
> Review request for cloudstack, Kishan Kavala and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-5162
> https://issues.apache.org/jira/browse/CLOUDSTACK-5162
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Usage details are not getting populated when using dynamic offerings.
> CLOUDSTACK-5162
> 
> 
> Diffs
> -
> 
>   engine/schema/src/com/cloud/service/ServiceOfferingVO.java 67fea00 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 00d8063 
> 
> Diff: https://reviews.apache.org/r/15505/diff/
> 
> 
> Testing
> ---
> 
> tested on master.
> 
> 
> Thanks,
> 
> bharat kumar
> 
>



Jenkins build is back to normal : cloudstack-4.3-maven-build #1

2013-11-26 Thread jenkins
See 



Build failed in Jenkins: build-systemvm64-4.2 #98

2013-11-26 Thread jenkins
See 

--
[...truncated 328 lines...]
++ GREP_OPTIONS=
++ grep -v /home/jenkins/.rvm
++ builtin command -v ruby
++ GREP_OPTIONS=
++ grep '/home/jenkins/.rvm/bin/ruby$'
++ [[ -s /home/jenkins/.rvm/environments/default ]]
++ [[ '' != \s\w\i\t\c\h ]]
++ source /home/jenkins/.rvm/environments/default
+++ export PATH
+++ 
PATH=/home/jenkins/.rvm/gems/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385@global/bin:/home/jenkins/.rvm/rubies/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/bin:/home/jenkins/.rvm/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385@global/bin:/home/jenkins/.rvm/rubies/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games
+++ export rvm_env_string
+++ rvm_env_string=ruby-1.9.3-p385
+++ export rvm_path
+++ rvm_path=/home/jenkins/.rvm
+++ export rvm_ruby_string
+++ rvm_ruby_string=ruby-1.9.3-p385
+++ unset rvm_gemset_name
+++ export RUBY_VERSION
+++ RUBY_VERSION=ruby-1.9.3-p385
+++ export GEM_HOME
+++ GEM_HOME=/home/jenkins/.rvm/gems/ruby-1.9.3-p385
+++ export GEM_PATH
+++ 
GEM_PATH=/home/jenkins/.rvm/gems/ruby-1.9.3-p385:/home/jenkins/.rvm/gems/ruby-1.9.3-p385@global
+++ export MY_RUBY_HOME
+++ MY_RUBY_HOME=/home/jenkins/.rvm/rubies/ruby-1.9.3-p385
+++ export IRBRC
+++ IRBRC=/home/jenkins/.rvm/rubies/ruby-1.9.3-p385/.irbrc
+++ unset MAGLEV_HOME
+++ unset RBXOPT
++ __rvm_conditionally_add_bin_path
++ [[ 
:/home/jenkins/.rvm/gems/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385@global/bin:/home/jenkins/.rvm/rubies/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/bin:/home/jenkins/.rvm/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/gems/ruby-1.9.3-p385@global/bin:/home/jenkins/.rvm/rubies/ruby-1.9.3-p385/bin:/home/jenkins/.rvm/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:
 =~ :/home/jenkins/\.rvm/bin: ]]
++ ((  0 == 1  ))
++ rvm_loaded_flag=1
++ unset rvm_prefix_needs_trailing_slash rvm_gems_cache_path rvm_gems_path 
rvm_project_rvmrc_default rvm_gemset_separator rvm_reload_flag
++ [[ -t 0 ]]
++ __rvm_teardown
++ builtin command -v __rvm_cleanup_tmp
++ __rvm_cleanup_tmp
++ [[ -d /home/jenkins/.rvm/tmp/ ]]
++ case "${rvm_tmp_path%\/}" in
++ __rvm_rm_rf '/home/jenkins/.rvm/tmp/27103*'
++ __rvm_rm_rf_verbose '/home/jenkins/.rvm/tmp/27103*'
++ typeset result target
++ result=1
++ target='/home/jenkins/.rvm/tmp/27103*'
++ [[ -n '' ]]
++ [[ -n 4.2.24(1)-release ]]
++ shopt -s extglob
++ case "${target}" in
++ [[ -n /home/jenkins/.rvm/tmp/27103* ]]
++ [[ -d /home/jenkins/.rvm/tmp/27103* ]]
++ [[ -f /home/jenkins/.rvm/tmp/27103* ]]
++ [[ -L /home/jenkins/.rvm/tmp/27103* ]]
++ result=0
++ return 0
++ return 0
++ export __rvm_env_loaded
++ : __rvm_env_loaded:1:
++ : __rvm_env_loaded:1:
++ : __rvm_env_loaded:0:
++ [[ -z /home/jenkins/.rvm/tmp ]]
++ ((  __rvm_env_loaded > 0  ))
++ [[ -n 4.2.24(1)-release ]]
++ trap - 0 1 2 3 15
++ [[ -n '' ]]
++ [[ -n 0002 ]]
++ umask 0002
++ unset rvm_stored_umask
++ [[ '' == \1 ]]
++ __variables_definition unset
++ typeset -a __variables_list __array_list
++ typeset __method
++ __method=unset
++ __variables_list=(rvm_head_flag rvm_ruby_selected_flag rvm_user_install_flag 
rvm_path_flag rvm_cron_flag rvm_static_flag rvm_default_flag rvm_loaded_flag 
rvm_llvm_flag rvm_skip_autoreconf_flag rvm_18_flag rvm_19_flag 
rvm_force_autoconf_flag rvm_dump_environment_flag rvm_verbose_flag 
rvm_debug_flag rvm_trace_flag rvm_pretty_print_flag rvm_create_flag 
rvm_remove_flag rvm_gemdir_flag rvm_reload_flag rvm_auto_reload_flag 
rvm_disable_binary_flag rvm_ignore_gemsets_flag rvm_skip_gemsets_flag 
rvm_install_on_use_flag rvm_remote_flag rvm_verify_downloads_flag 
rvm_skip_openssl_flag rvm_gems_cache_path rvm_gems_path rvm_man_path 
rvm_ruby_gem_path rvm_ruby_log_path rvm_gems_cache_path rvm_archives_path 
rvm_docs_path rvm_environments_path rvm_examples_path rvm_gems_path 
rvm_gemsets_path rvm_help_path rvm_hooks_path rvm_lib_path rvm_log_path 
rvm_patches_path rvm_repos_path rvm_rubies_path rvm_scripts_path rvm_src_path 
rvm_tmp_path rvm_user_path rvm_usr_path rvm_wrappers_path rvm_externals_path 
rvm_stored_errexit rvm_ruby_strings rvm_ruby_binary rvm_ruby_gem_home 
rvm_ruby_home rvm_ruby_interpreter rvm_ruby_irbrc rvm_ruby_major_version 
rvm_ruby_minor_version rvm_ruby_package_name rvm_ruby_patch_level 
rvm_ruby_release_version rvm_ruby_repo_url rvm_ruby_repo_branch 
rvm_ruby_revision rvm_ruby_tag rvm_ruby_sha rvm_ruby_version 
rvm_ruby_package_file rvm_ruby_name rvm_ruby_name rvm_ruby_args 
rvm_ruby_user_tag rvm_ruby_patch detected_rvm_ruby_name __rvm_env_loaded 
next_token rvm_error_message rvm_gemset_name rvm_parse_break rvm_token 
rvm_action rvm_export_args rvm_gemset_separator rvm_expanding_aliases 
rvm_architectures rvm_tar_command rvm_tar_options rvm_patch_original_pwd 
rvm_project_rvmrc rvm_archive_extension rvm_autoinstall_b

Build failed in Jenkins: cloudstack-4.3-maven-build-noredist #24

2013-11-26 Thread jenkins
See 


Changes:

[kishan] Fix listRouter by clusterId and upgradeRouterTemplate by clusterId

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > Advanced Search > add 
cluster dropdown since API now supports it.

[girish] CLOUDSTACK-5194: portable ip - Improving cleanup code to

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > add new action "Upgrade 
Router to Newer Template" on top of listView.

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > add new action "Upgrade 
Router to Newer Template" in detailView.

[sudison] add mgt.server.vendor global configuration, in case different vendor 
wants to identify its identity

[muralimmreddy] Adding protocol parameter to loadbalancer response

[likitha.shetty] CLOUDSTACK-5069. Added global config 
'vmware.vcenter.session.timeout' to make the vCenter session timeout value 
configurable.

[rajesh.battala] Add support of attaching nic's to the specified network labels 
in HyperV

[jessicawang] CLOUDSTACK-5222: UI > Infrastructure > Sockets > count only hosts 
whose type is routing.

[sudison] Add logs in case ipassoccmd failed

[sudison] CS-18582: if EIP is used, extract volume and template returns wrong 
public ip address. If remote agent is ssvm agent, then looking up public ip 
address from ssvm table

[kelveny] CLOUDSTACK-669: Add host level side-by-side VM state report for 
graceful sync model migration

[kelveny] Newly added VR monitoring service has broken VMware basic network 
mode.

[kelveny] CLOUDSTACK-669: side-by-side VM sync management at manager level

[likitha.shetty] CLOUDSTACK-1868. GetVmStatsCommand throws NullPointerException 
with VMWare.

[girish] CLOUDSTACK-5215: Correcting and refactoring code related to

[girish] CLOUDSTACK-5204: test_routers - fixed ssh issue

[girish] CLOUDSTACK-5201: Correcting code related to schedule of

[likitha.shetty] CLOUDSTACK-5227. Cannot pass Japanese characters as parameter 
values to an API.

[rajesh.battala] Modified GetExternalVirtSwitch to take the switchname param 
and return the same or default one

[Alena Prokharchyk] Added missing @Inject to the ipAddressManager

[Alena Prokharchyk] Resource metadata - support for VPC

[bfederle] List view: Support passing custom ID to detail view context

[bfederle] System, main routers page: Split into subsections (WIP)

[Alena Prokharchyk] Removed unused agent lb timer

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > add "Select View" 
dropdown on top of listView.

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > Select View > group by 
zone > listView of Zone, Total of Virtual Routers, Virtual Routers require 
upgrade.

[Alena Prokharchyk] Added new paramerer "start" to createVPC command. When 
false is passed in, VPC won't be started (its VPC VR won't get implemented) 
till the point when the first netwotrk gets implemented in the VPC.

[min.chen] CLOUDSTACK-5246:Xenserver - Hourly Snapshots - Creating snapshot from

[sudison] Add a new method on datastoredriver: getCapabilities, which will be 
called by liststoragepoolcmd. UI can make decision based on the capabilities of 
the storage.

[sudison] StoragePoolResponse.getId() returns a String with an UUID

[sudison] Expose getPrimaryDataStore(String uuid) through the DatastoreManager 
interface so it can be used clients.

[girish] CLOUDSTACK-5121: There was one wrong initialization of 
cloudstackConnection.

[girish] Fixed a incorrect marvin request call.

[girish] CLOUDSTACK 2233: Automation test cases for Add Remove Networks to VM

[likitha.shetty] CLOUDSTACK-5122. [VMware] During upgrade from 4.1 system vms 
don't come up with 'ROOT-x-y VMDK file not found' exception.

[jayapal] CLOUDSTACK-5164 Unmonit for 30 minutes for a failed process

[rajesh.battala] Added contextMap data to all the command responses in HyperV

[darren.s.shepherd] CLOUDSTACK-5224: Add missing configuration for Netscaler, 
F5, SRX, and VNMC

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > Select View > group by 
zone > implement detailView of Zone, Total of Virtual Routers, Virtual Routers 
require upgrade.

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > Select View > group by 
zone > detailView > add action "upgrade all routers in this zone to use newer 
template".

[nitin.mehta] CLOUDSTACK-5221:

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > Select View > add "group 
by pod".

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > Select View > add "group 
by cluster".

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > Select View > group by 
cluster > detailView > add pod name, zone name.

[jessicawang] CLOUDSTACK-4793: UI > Virtual Routers > remove Advanced Search 
since we now have Select View (group by zone/pod/cluster).

[Alena Prokharchyk] ListPortFowardingRules: added networkId to the list of 
optional parameters to list by

[Alena Prokharchyk] Resource metadata - fixed the bug in removeResourceDetail 
API

Jenkins build is back to normal : cloudstack-4.3-maven-build-noredist #25

2013-11-26 Thread jenkins
See 



Jenkins build is back to normal : build-systemvm64-4.2 #99

2013-11-26 Thread jenkins
See 



S3 buckets yum.cloudstack.org and apt.cloudstack.org

2013-11-26 Thread Hugo Trippaers
Heya,

Would currently manages the S3 buckets yum.cloudstack.org and 
apt.cloudstack.org? I want to finish setting up the jenkins build to push the 
correct artifacts there. 

Cheers,

Hugo 

Re: Review Request 15834: CLOUDSTACK-4737: handling usage events for dynamic compute offering

2013-11-26 Thread Harikrishna Patnala

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15834/
---

(Updated Nov. 26, 2013, 11:28 a.m.)


Review request for cloudstack and Koushik Das.


Bugs: CLOUDSTACK-4737
https://issues.apache.org/jira/browse/CLOUDSTACK-4737


Repository: cloudstack-git


Description
---

CLOUDSTACK-4737: handling usage events for dynamic compute offering 


Diffs (updated)
-

  engine/schema/src/com/cloud/event/dao/UsageEventDetailsDaoImpl.java b2be1c9 
  engine/schema/src/com/cloud/usage/UsageVMInstanceVO.java 06a7bee 
  setup/db/db/schema-421to430.sql 8be0fb1 
  usage/src/com/cloud/usage/UsageManagerImpl.java 37131e0 

Diff: https://reviews.apache.org/r/15834/diff/


Testing
---


Thanks,

Harikrishna Patnala



Re: Review Request 15832: enable custom offering support for scalevm

2013-11-26 Thread bharat kumar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15832/
---

(Updated Nov. 26, 2013, 11:37 a.m.)


Review request for cloudstack and Koushik Das.


Bugs: CLOUDSTACK-5161
https://issues.apache.org/jira/browse/CLOUDSTACK-5161


Repository: cloudstack-git


Description
---

enable scaling of a vm using custom offering
CLOUDSTACK-5161


Diffs (updated)
-

  engine/schema/src/com/cloud/service/ServiceOfferingVO.java 67fea00 
  server/src/com/cloud/vm/UserVmManagerImpl.java 00d8063 

Diff: https://reviews.apache.org/r/15832/diff/


Testing
---

Tested on master.


Thanks,

bharat kumar



Re: Review Request 15832: enable custom offering support for scalevm

2013-11-26 Thread bharat kumar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15832/
---

(Updated Nov. 26, 2013, 11:38 a.m.)


Review request for cloudstack and Koushik Das.


Bugs: CLOUDSTACK-5161
https://issues.apache.org/jira/browse/CLOUDSTACK-5161


Repository: cloudstack-git


Description
---

enable scaling of a vm using custom offering
CLOUDSTACK-5161


Diffs (updated)
-

  api/src/org/apache/cloudstack/api/ApiConstants.java 6f919c1 
  
api/src/org/apache/cloudstack/api/command/admin/systemvm/ScaleSystemVMCmd.java 
a7c864d 
  
api/src/org/apache/cloudstack/api/command/admin/systemvm/UpgradeSystemVMCmd.java
 1357a7d 
  api/src/org/apache/cloudstack/api/command/user/vm/ScaleVMCmd.java 6cb49c1 
  api/src/org/apache/cloudstack/api/command/user/vm/UpgradeVMCmd.java 3dfcdf9 
  api/src/org/apache/cloudstack/api/response/ServiceOfferingResponse.java 
7ec739e 
  engine/api/src/com/cloud/vm/VirtualMachineManager.java c78942f 
  engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java 3a3de70 
  engine/schema/src/com/cloud/service/dao/ServiceOfferingDaoImpl.java f1f97fc 
  engine/schema/src/com/cloud/usage/UsageVMInstanceVO.java 06a7bee 
  server/src/com/cloud/api/query/dao/ServiceOfferingJoinDaoImpl.java 4f351eb 
  server/src/com/cloud/api/query/vo/ServiceOfferingJoinVO.java 2260e1e 
  server/src/com/cloud/configuration/ConfigurationManagerImpl.java 3770eb8 
  server/src/com/cloud/server/ManagementServerImpl.java d34da4f 
  server/src/com/cloud/vm/UserVmManager.java b7b4bd5 
  server/src/com/cloud/vm/UserVmManagerImpl.java 00d8063 
  server/test/com/cloud/vm/UserVmManagerTest.java 71bbebe 

Diff: https://reviews.apache.org/r/15832/diff/


Testing
---

Tested on master.


Thanks,

bharat kumar



Re: persistence layer

2013-11-26 Thread Lukas Eder
Dear CloudStack developers,

This thread has caught my attention and I thought I might chime in and give
you some background information about jOOQ, JDBC, RDBMS in general (I work
for Data Geekery, the company behind jOOQ). I've already had the pleasure
to talk to Darren on the jOOQ User Group and on the phone.

Here are some answers to open questions I've seen in this thread:

2013/11/26 Alex Huang 

> Has anyone actually tried dropping in a different jdbc driver and see if
> CS can use another DB?  I don't think the current CS DB layer prevents
> anyone from doing that.
>
> This is different from MariaDB which, as othes have pointed out, is
> drop-in replacement for MySQL.  I'm talking about stuff like derby or
> sqlserver or oracle or db2.
>

MariaDB and MySQL are diverging quickly, as Oracle invests quite some
development efforts into MySQL. While the drop-in replacement argument is
valid right now, it might not be two years from now.

In general, SQL dialects are very different when it comes to the subtleties
of syntax or feature sets. Since you're comparing MySQL with Derby, SQL
Server, Oracle, or DB2, let me give you some ideas:

- MySQL has a lot of vendor-specific clauses that no one else has (e.g. ON
DUPLICATE KEY UPDATE)
- MySQL bends the SQL syntax and accepts what is otherwise illegal syntax
(e.g. GROUP BY semantics [1])
- MySQL doesn't correctly implement the SQL standard NOT IN semantics [2]
- Derby and DB2 (prior to version 9.7) are extremely type-safe. For
instance, CAST(NULL AS INT) and CAST(NULL AS VARCHAR) are two entirely
different things. This can lead to tedious work when binding null as a bind
variable. Some background info [3]
- DB2 has a lot of peculiarities when it comes to memory management of
VARCHAR [4]
- Case-sensitivity of schema, table, and column names is an eternal hassle
between RDBMS
- JDBC drivers implement things very differently in some areas. Fetching an
inserted ID is really a pain.

[1]: http://blog.jooq.org/2012/08/05/mysql-bad-idea-384/
[2]:
http://blog.jooq.org/2012/01/27/sql-incompatibilities-not-in-and-null-values/
[3]: http://blog.jooq.org/2011/08/31/rdbms-bind-variable-casting-madness/
[4]: http://stackoverflow.com/q/9234021/521799

If you want cross-database support, these things show that you should
really consider moving away from using plain JDBC and use an abstraction
that will take care of these incompatibilities for you. You might be
choosing between Hibernate and jOOQ (or both) depending on the way you plan
to interact with your RDBMS. Our point of view is illustrated here:
http://www.hibernate-alternative.com

Some larger jOOQ customers currently use jOOQ with Oracle, Sybase, SQL
Server, MySQL, and H2 from the same application.

> Frank Zhang Fri, 22 Nov 2013 10:42:09 -0800
> I recommend QueryDSL. Having a quick look at JOOQ, it's very similar to
> QueryDSL.
> QueryDSL has been integrated into Spring for 2 years, and JOOQ haven't
had
> official doc for Spring.
> Besides Sql, QueryDSL also gets fair credit on manipulating NoSql which
is an
> additional plus.

jOOQ and Spring work together quite nicely, even if there is not an
"official" affiliation between the two stacks:

-
http://www.jooq.org/doc/3.2/manual/getting-started/tutorials/jooq-with-spring/
- http://blog.jooq.org/2012/09/19/a-nice-way-of-using-jooq-with-spring/
- http://blog.uws.ie/2013/04/using-jooq-with-spring-transactions/
- http://stackoverflow.com/q/4474365/521799

We're aware of QueryDSL offering SQL and NoSQL support through a single
API. In our opinion, such greater unification attempts will always come
with an impedance mismatch at some point. In other words, you'll be losing
on SQL functionality in favour of greater standardisation / abstraction.
>From our experience with jOOQ, SQL standardisation is already a very hard
problem. NoSQL databases all work fundamentally differently. The added
complexity by supporting NoSQL in the same API as SQL databases is
significant.

Of course, these things depend on whether replacing MySQL for any NoSQL
database in CloudStack is really a desired, near-term option.


I'll be following this thread for another while and I'm more than happy to
answer any questions you may have related to jOOQ, SQL, JDBC, etc.

Best Regards,
Lukas


Re: Review Request 15834: CLOUDSTACK-4737: handling usage events for dynamic compute offering

2013-11-26 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15834/#review29428
---


Commit b2f0a0bce26e342f18da42a51ae19d51c238a762 in branch refs/heads/master 
from Harikrishna Patnala
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=b2f0a0b ]

CLOUDSTACK-4737: handling usage events for dynamic compute offering

Signed-off-by: Koushik Das 


- ASF Subversion and Git Services


On Nov. 26, 2013, 11:28 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15834/
> ---
> 
> (Updated Nov. 26, 2013, 11:28 a.m.)
> 
> 
> Review request for cloudstack and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-4737
> https://issues.apache.org/jira/browse/CLOUDSTACK-4737
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> CLOUDSTACK-4737: handling usage events for dynamic compute offering 
> 
> 
> Diffs
> -
> 
>   engine/schema/src/com/cloud/event/dao/UsageEventDetailsDaoImpl.java b2be1c9 
>   engine/schema/src/com/cloud/usage/UsageVMInstanceVO.java 06a7bee 
>   setup/db/db/schema-421to430.sql 8be0fb1 
>   usage/src/com/cloud/usage/UsageManagerImpl.java 37131e0 
> 
> Diff: https://reviews.apache.org/r/15834/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request 15834: CLOUDSTACK-4737: handling usage events for dynamic compute offering

2013-11-26 Thread Koushik Das

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15834/#review29429
---

Ship it!


master -> b2f0a0bce26e342f18da42a51ae19d51c238a762

- Koushik Das


On Nov. 26, 2013, 11:28 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15834/
> ---
> 
> (Updated Nov. 26, 2013, 11:28 a.m.)
> 
> 
> Review request for cloudstack and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-4737
> https://issues.apache.org/jira/browse/CLOUDSTACK-4737
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> CLOUDSTACK-4737: handling usage events for dynamic compute offering 
> 
> 
> Diffs
> -
> 
>   engine/schema/src/com/cloud/event/dao/UsageEventDetailsDaoImpl.java b2be1c9 
>   engine/schema/src/com/cloud/usage/UsageVMInstanceVO.java 06a7bee 
>   setup/db/db/schema-421to430.sql 8be0fb1 
>   usage/src/com/cloud/usage/UsageManagerImpl.java 37131e0 
> 
> Diff: https://reviews.apache.org/r/15834/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request 15505: Usage details are not getting populated when using dynamic offerings.

2013-11-26 Thread Koushik Das


> On Nov. 26, 2013, 9:12 a.m., Koushik Das wrote:
> > master -> ef40e156ed376968fa9fd15078034d54b97deecc

4.3 -> 6af8021ef7188b8f2d92bc891b5108f0e3503284


- Koushik


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15505/#review29427
---


On Nov. 26, 2013, 8:42 a.m., bharat kumar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15505/
> ---
> 
> (Updated Nov. 26, 2013, 8:42 a.m.)
> 
> 
> Review request for cloudstack, Kishan Kavala and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-5162
> https://issues.apache.org/jira/browse/CLOUDSTACK-5162
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Usage details are not getting populated when using dynamic offerings.
> CLOUDSTACK-5162
> 
> 
> Diffs
> -
> 
>   engine/schema/src/com/cloud/service/ServiceOfferingVO.java 67fea00 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 00d8063 
> 
> Diff: https://reviews.apache.org/r/15505/diff/
> 
> 
> Testing
> ---
> 
> tested on master.
> 
> 
> Thanks,
> 
> bharat kumar
> 
>



Re: Review Request 15834: CLOUDSTACK-4737: handling usage events for dynamic compute offering

2013-11-26 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15834/#review29431
---


Commit 8970c9515441c50a0249b9624b120d4e5348b5af in branch refs/heads/4.3 from 
Harikrishna Patnala
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=8970c95 ]

CLOUDSTACK-4737: handling usage events for dynamic compute offering

Signed-off-by: Koushik Das 


- ASF Subversion and Git Services


On Nov. 26, 2013, 11:28 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15834/
> ---
> 
> (Updated Nov. 26, 2013, 11:28 a.m.)
> 
> 
> Review request for cloudstack and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-4737
> https://issues.apache.org/jira/browse/CLOUDSTACK-4737
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> CLOUDSTACK-4737: handling usage events for dynamic compute offering 
> 
> 
> Diffs
> -
> 
>   engine/schema/src/com/cloud/event/dao/UsageEventDetailsDaoImpl.java b2be1c9 
>   engine/schema/src/com/cloud/usage/UsageVMInstanceVO.java 06a7bee 
>   setup/db/db/schema-421to430.sql 8be0fb1 
>   usage/src/com/cloud/usage/UsageManagerImpl.java 37131e0 
> 
> Diff: https://reviews.apache.org/r/15834/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request 15834: CLOUDSTACK-4737: handling usage events for dynamic compute offering

2013-11-26 Thread Koushik Das


> On Nov. 26, 2013, 11:58 a.m., Koushik Das wrote:
> > master -> b2f0a0bce26e342f18da42a51ae19d51c238a762

4.3 -> 8970c9515441c50a0249b9624b120d4e5348b5af


- Koushik


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15834/#review29429
---


On Nov. 26, 2013, 11:28 a.m., Harikrishna Patnala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15834/
> ---
> 
> (Updated Nov. 26, 2013, 11:28 a.m.)
> 
> 
> Review request for cloudstack and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-4737
> https://issues.apache.org/jira/browse/CLOUDSTACK-4737
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> CLOUDSTACK-4737: handling usage events for dynamic compute offering 
> 
> 
> Diffs
> -
> 
>   engine/schema/src/com/cloud/event/dao/UsageEventDetailsDaoImpl.java b2be1c9 
>   engine/schema/src/com/cloud/usage/UsageVMInstanceVO.java 06a7bee 
>   setup/db/db/schema-421to430.sql 8be0fb1 
>   usage/src/com/cloud/usage/UsageManagerImpl.java 37131e0 
> 
> Diff: https://reviews.apache.org/r/15834/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Harikrishna Patnala
> 
>



Re: Review Request 15647: Fixing coverity issues related to resource leak on FileInputStream being created anonymously.

2013-11-26 Thread Wilder Rodrigues

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15647/
---

(Updated Nov. 26, 2013, 1:06 p.m.)


Review request for cloudstack and Hugo Trippaers.


Changes
---

Making use of the ec2PropFile variable, it got lost after the merge with Alex 
Huang changes.


Repository: cloudstack-git


Description
---

Fixing coverity issues related to resource leak on FileInputStream being 
created anonymously.

This patch fixed the following Coverity issues:

cv_1116497
cv_1116681
cv_1116694
cv_1116567
cv_1116495


Diffs (updated)
-

  awsapi/src/com/cloud/bridge/service/EC2RestServlet.java 5c56e9d 
  awsapi/src/com/cloud/bridge/service/controller/s3/ServiceProvider.java 
deb886f 
  awsapi/src/com/cloud/bridge/service/core/ec2/EC2Engine.java 59abca0 
  framework/cluster/src/com/cloud/cluster/ClusterManagerImpl.java 3e7138f 
  services/console-proxy/server/src/com/cloud/consoleproxy/ConsoleProxy.java 
0d28e09 

Diff: https://reviews.apache.org/r/15647/diff/


Testing
---

A build full build was executed on top of the branch created for these changes. 
After committed and patched, the a brand new branch was created from Master and 
patched with this patch. Everything worked fine.

No new feature was added.


Thanks,

Wilder Rodrigues



Build failed in Jenkins: cloudstack-4.3-maven-build #5

2013-11-26 Thread jenkins
See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on rpmbuilder in workspace 

Checkout:cloudstack-4.3-maven-build / 
 - 
hudson.remoting.Channel@7818ad:rpmbuilder
Using strategy: Default
Last Built Revision: Revision 8970c9515441c50a0249b9624b120d4e5348b5af 
(origin/4.3)
Fetching changes from 1 remote Git repository
Fetching upstream changes from origin
ERROR: Problem fetching from origin / origin - could be unavailable. Continuing 
anyway
hudson.plugins.git.GitException: Command "/usr/bin/git fetch -t origin 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Couldn't resolve host 'git-wip-us.apache.org' while accessing 
https://git-wip-us.apache.org/repos/asf/cloudstack.git/info/refs

fatal: HTTP request failed

at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:773)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:739)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.fetch(CliGitAPIImpl.java:160)
at hudson.plugins.git.GitAPI.fetch(GitAPI.java:230)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:793)
at hudson.plugins.git.GitSCM.access$000(GitSCM.java:57)
at hudson.plugins.git.GitSCM$2.invoke(GitSCM.java:976)
at hudson.plugins.git.GitSCM$2.invoke(GitSCM.java:942)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2425)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:326)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at hudson.remoting.Engine$1$1.run(Engine.java:63)
at java.lang.Thread.run(Thread.java:679)
ERROR: Could not fetch from any repository
FATAL: Could not fetch from any repository
hudson.plugins.git.GitException: Could not fetch from any repository
at hudson.plugins.git.GitSCM$2.invoke(GitSCM.java:981)
at hudson.plugins.git.GitSCM$2.invoke(GitSCM.java:942)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2425)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:326)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at hudson.remoting.Engine$1$1.run(Engine.java:63)
at java.lang.Thread.run(Thread.java:679)


Jenkins build is back to normal : cloudstack-4.3-maven-build #6

2013-11-26 Thread jenkins
See 



Re: S3 buckets yum.cloudstack.org and apt.cloudstack.org

2013-11-26 Thread David Nalley
Hey Hugo:

I can get you creds there.

See an off list email in just a few minutes.

--David

On Tue, Nov 26, 2013 at 2:42 AM, Hugo Trippaers  wrote:
> Heya,
>
> Would currently manages the S3 buckets yum.cloudstack.org and 
> apt.cloudstack.org? I want to finish setting up the jenkins build to push the 
> correct artifacts there.
>
> Cheers,
>
> Hugo


Re: [PROPOSAL] User VM HA using native XS HA capabilities

2013-11-26 Thread David Nalley
Hi Koushik:

Thanks for the reply - a few followup comments inline. I look forward
to seeing this work.

Other folks: please read the entire thread and the links from Koushik;
there's a planned deprecation here.

--David

On Mon, Nov 25, 2013 at 2:38 AM, Koushik Das  wrote:
> Thanks for the comments David. See inline.
>
> -Koushik
>
> On 22-Nov-2013, at 7:31 PM, David Nalley  wrote:
>
>> Hi Koushik:
>>
>> In general I like the idea. A couple of comments:
>>
>> The upgrade section has a manual step for enabling HA manually per
>> instance. Why a manual step? Why is CloudStack not checking the
>> desired state (e.g. if HA is enabled in the instance service group)
>> with the actual state (what is reflected on the hypervisor) and
>> changing it when appropriate.
>>
>> We are already going to need to reconcile the state (things like host
>> the instance is running on will change for instance) with reality
>> already - so it seems like making this an automatic step wouldn't be
>> much extra effort and would scale far easier.
>
> [Koushik] Are you suggesting that as part of the upgrade process, all 
> impacted VMs should be automatically updated? If so, yes it can be done. For 
> now I am keeping it manual, in future the process can be automated.
>

Why keeping it manual now? Actually let me rephrase - I can understand
why someone might not want things changed automagically (as an admin
I'd want nothing changed by default, but changed if I cared about it
in some automated fashion) Is there a reason we would not include some
functionality to let the operator automatically change this on some
subset or all of the machines in an automated fashion?

>>
>> Are there plans on deprecating the custom HA solution, or will it be
>> supported forever? If the plan is to deprecate, lets go ahead and
>> start planning that/announcing/etc and not let it fall into disrepair.
>
> [Koushik] That's the plan going forward. For the next release both options 
> will be there. Maybe post that the custom HA solution can be removed for XS 
> 6.2 and above.
>
>>

Please make sure that the deprecation is explicitly called out. E.g
will be present but deprecated in 4.4 and removed in 4.5; and let's
make sure a doc bug gets filed when this is ready for merge.

--David


HELP with CLOUDSTACK-5145 security issue

2013-11-26 Thread Marcus Sorensen
Is there anyone who can help with CLOUDSTACK-5145?  There's a security
issue with 4.2+ due to the new ACL design. Anyone listing ACLs sees
ALL ACLs in the system, and if a network has no ACLs then filtering by
network also lists ALL ACLs. As you can imagine, this causes a lot of
problems.  I could hack together some joins to link network_acl,
network_acl_item, and vpc tables to get the account owning the acls,
but I also see this ''_accountMgr.buildACLSearchBuilder" which seems
to be commented out of the list code. I'm wondering if there's a more
elegant way to do it.


Re: Review Request 15840: CLOUDSTACK-5206: Ability to control the external id of first class objects

2013-11-26 Thread ASF Subversion and Git Services

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15840/#review29443
---


Commit 6bea532efa2e754407d33ac2f56cf56d1385eda0 in branch refs/heads/master 
from Nitin Mehta
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=6bea532 ]

CLOUDSTACK-5206: Ability to control the external id of first
 class objects. Putting in the generic methods and trying it
 for objects like vm, volume. This is the first cut


- ASF Subversion and Git Services


On Nov. 25, 2013, 6:55 p.m., Nitin Mehta wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15840/
> ---
> 
> (Updated Nov. 25, 2013, 6:55 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Bugs: CLOUDSTACK-5206
> https://issues.apache.org/jira/browse/CLOUDSTACK-5206
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> CLOUDSTACK-5206: Ability to control the external id of first
>  class objects. Putting in the generic methods and trying it
>  for objects like vm, volume. This is the first cut
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/storage/VolumeApiService.java 47afa10 
>   api/src/com/cloud/vm/UserVmService.java 444c47a 
>   api/src/org/apache/cloudstack/api/ApiConstants.java 6f919c1 
>   api/src/org/apache/cloudstack/api/BaseAsyncCreateCustomIdCmd.java 
> PRE-CREATION 
>   api/src/org/apache/cloudstack/api/BaseAsyncCustomIdCmd.java PRE-CREATION 
>   api/src/org/apache/cloudstack/api/BaseCustomIdCmd.java PRE-CREATION 
>   api/src/org/apache/cloudstack/api/command/user/vm/DeployVMCmd.java 7180f4e 
>   api/src/org/apache/cloudstack/api/command/user/vm/UpdateVMCmd.java fbb785f 
>   api/src/org/apache/cloudstack/api/command/user/volume/CreateVolumeCmd.java 
> eb4ac88 
>   api/src/org/apache/cloudstack/api/command/user/volume/UpdateVolumeCmd.java 
> f12cef8 
>   engine/schema/src/com/cloud/vm/dao/UserVmDao.java 606d424 
>   engine/schema/src/com/cloud/vm/dao/UserVmDaoImpl.java 43bdef1 
>   
> server/resources/META-INF/cloudstack/core/spring-server-core-managers-context.xml
>  2a080f9 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4bbc872 
>   server/src/com/cloud/storage/VolumeApiServiceImpl.java c693527 
>   server/src/com/cloud/uuididentity/UUIDManager.java PRE-CREATION 
>   server/src/com/cloud/uuididentity/UUIDManagerImpl.java PRE-CREATION 
>   server/src/com/cloud/vm/UserVmManager.java b7b4bd5 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 00d8063 
> 
> Diff: https://reviews.apache.org/r/15840/diff/
> 
> 
> Testing
> ---
> 
> Tested locally.
> 
> 
> Thanks,
> 
> Nitin Mehta
> 
>



Re: Review Request 15840: CLOUDSTACK-5206: Ability to control the external id of first class objects

2013-11-26 Thread Nitin Mehta

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15840/#review29444
---

Ship it!


Ship It!

- Nitin Mehta


On Nov. 25, 2013, 6:55 p.m., Nitin Mehta wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15840/
> ---
> 
> (Updated Nov. 25, 2013, 6:55 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Bugs: CLOUDSTACK-5206
> https://issues.apache.org/jira/browse/CLOUDSTACK-5206
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> CLOUDSTACK-5206: Ability to control the external id of first
>  class objects. Putting in the generic methods and trying it
>  for objects like vm, volume. This is the first cut
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/storage/VolumeApiService.java 47afa10 
>   api/src/com/cloud/vm/UserVmService.java 444c47a 
>   api/src/org/apache/cloudstack/api/ApiConstants.java 6f919c1 
>   api/src/org/apache/cloudstack/api/BaseAsyncCreateCustomIdCmd.java 
> PRE-CREATION 
>   api/src/org/apache/cloudstack/api/BaseAsyncCustomIdCmd.java PRE-CREATION 
>   api/src/org/apache/cloudstack/api/BaseCustomIdCmd.java PRE-CREATION 
>   api/src/org/apache/cloudstack/api/command/user/vm/DeployVMCmd.java 7180f4e 
>   api/src/org/apache/cloudstack/api/command/user/vm/UpdateVMCmd.java fbb785f 
>   api/src/org/apache/cloudstack/api/command/user/volume/CreateVolumeCmd.java 
> eb4ac88 
>   api/src/org/apache/cloudstack/api/command/user/volume/UpdateVolumeCmd.java 
> f12cef8 
>   engine/schema/src/com/cloud/vm/dao/UserVmDao.java 606d424 
>   engine/schema/src/com/cloud/vm/dao/UserVmDaoImpl.java 43bdef1 
>   
> server/resources/META-INF/cloudstack/core/spring-server-core-managers-context.xml
>  2a080f9 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4bbc872 
>   server/src/com/cloud/storage/VolumeApiServiceImpl.java c693527 
>   server/src/com/cloud/uuididentity/UUIDManager.java PRE-CREATION 
>   server/src/com/cloud/uuididentity/UUIDManagerImpl.java PRE-CREATION 
>   server/src/com/cloud/vm/UserVmManager.java b7b4bd5 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 00d8063 
> 
> Diff: https://reviews.apache.org/r/15840/diff/
> 
> 
> Testing
> ---
> 
> Tested locally.
> 
> 
> Thanks,
> 
> Nitin Mehta
> 
>



Re: Review Request 15840: CLOUDSTACK-5206: Ability to control the external id of first class objects

2013-11-26 Thread Chris Suich

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15840/#review29448
---


It looks like you commented out a version check in 
VirtualNetworkApplianceManagerImpl.java. Was that intentional?

- Chris Suich


On Nov. 25, 2013, 6:55 p.m., Nitin Mehta wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15840/
> ---
> 
> (Updated Nov. 25, 2013, 6:55 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Bugs: CLOUDSTACK-5206
> https://issues.apache.org/jira/browse/CLOUDSTACK-5206
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> CLOUDSTACK-5206: Ability to control the external id of first
>  class objects. Putting in the generic methods and trying it
>  for objects like vm, volume. This is the first cut
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/storage/VolumeApiService.java 47afa10 
>   api/src/com/cloud/vm/UserVmService.java 444c47a 
>   api/src/org/apache/cloudstack/api/ApiConstants.java 6f919c1 
>   api/src/org/apache/cloudstack/api/BaseAsyncCreateCustomIdCmd.java 
> PRE-CREATION 
>   api/src/org/apache/cloudstack/api/BaseAsyncCustomIdCmd.java PRE-CREATION 
>   api/src/org/apache/cloudstack/api/BaseCustomIdCmd.java PRE-CREATION 
>   api/src/org/apache/cloudstack/api/command/user/vm/DeployVMCmd.java 7180f4e 
>   api/src/org/apache/cloudstack/api/command/user/vm/UpdateVMCmd.java fbb785f 
>   api/src/org/apache/cloudstack/api/command/user/volume/CreateVolumeCmd.java 
> eb4ac88 
>   api/src/org/apache/cloudstack/api/command/user/volume/UpdateVolumeCmd.java 
> f12cef8 
>   engine/schema/src/com/cloud/vm/dao/UserVmDao.java 606d424 
>   engine/schema/src/com/cloud/vm/dao/UserVmDaoImpl.java 43bdef1 
>   
> server/resources/META-INF/cloudstack/core/spring-server-core-managers-context.xml
>  2a080f9 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4bbc872 
>   server/src/com/cloud/storage/VolumeApiServiceImpl.java c693527 
>   server/src/com/cloud/uuididentity/UUIDManager.java PRE-CREATION 
>   server/src/com/cloud/uuididentity/UUIDManagerImpl.java PRE-CREATION 
>   server/src/com/cloud/vm/UserVmManager.java b7b4bd5 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 00d8063 
> 
> Diff: https://reviews.apache.org/r/15840/diff/
> 
> 
> Testing
> ---
> 
> Tested locally.
> 
> 
> Thanks,
> 
> Nitin Mehta
> 
>



Re: Review Request 15832: enable custom offering support for scalevm

2013-11-26 Thread Nitin Mehta

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15832/#review29445
---



api/src/org/apache/cloudstack/api/command/admin/systemvm/UpgradeSystemVMCmd.java


All this is boilerplate code. Have an abstract class and make all these 
classes extend this abstract class. There are some examples to get an idea for 
doing this.



api/src/org/apache/cloudstack/api/command/user/vm/UpgradeVMCmd.java


it should be name. Also better to give example how to specify them



server/src/com/cloud/configuration/ConfigurationManagerImpl.java


check for !(cpuNumber == null && cpuSpeed == null && memory == null)





server/src/com/cloud/vm/UserVmManagerImpl.java


I would suggest writing a util function for adding and removing these 
details. I think it can be used while deploying vm as well.



server/src/com/cloud/vm/UserVmManagerImpl.java


can you please break it down ? or write comments please 



server/src/com/cloud/vm/UserVmManagerImpl.java


boiler plate code.


- Nitin Mehta


On Nov. 26, 2013, 11:38 a.m., bharat kumar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15832/
> ---
> 
> (Updated Nov. 26, 2013, 11:38 a.m.)
> 
> 
> Review request for cloudstack and Koushik Das.
> 
> 
> Bugs: CLOUDSTACK-5161
> https://issues.apache.org/jira/browse/CLOUDSTACK-5161
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> enable scaling of a vm using custom offering
> CLOUDSTACK-5161
> 
> 
> Diffs
> -
> 
>   api/src/org/apache/cloudstack/api/ApiConstants.java 6f919c1 
>   
> api/src/org/apache/cloudstack/api/command/admin/systemvm/ScaleSystemVMCmd.java
>  a7c864d 
>   
> api/src/org/apache/cloudstack/api/command/admin/systemvm/UpgradeSystemVMCmd.java
>  1357a7d 
>   api/src/org/apache/cloudstack/api/command/user/vm/ScaleVMCmd.java 6cb49c1 
>   api/src/org/apache/cloudstack/api/command/user/vm/UpgradeVMCmd.java 3dfcdf9 
>   api/src/org/apache/cloudstack/api/response/ServiceOfferingResponse.java 
> 7ec739e 
>   engine/api/src/com/cloud/vm/VirtualMachineManager.java c78942f 
>   engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java 
> 3a3de70 
>   engine/schema/src/com/cloud/service/dao/ServiceOfferingDaoImpl.java f1f97fc 
>   engine/schema/src/com/cloud/usage/UsageVMInstanceVO.java 06a7bee 
>   server/src/com/cloud/api/query/dao/ServiceOfferingJoinDaoImpl.java 4f351eb 
>   server/src/com/cloud/api/query/vo/ServiceOfferingJoinVO.java 2260e1e 
>   server/src/com/cloud/configuration/ConfigurationManagerImpl.java 3770eb8 
>   server/src/com/cloud/server/ManagementServerImpl.java d34da4f 
>   server/src/com/cloud/vm/UserVmManager.java b7b4bd5 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 00d8063 
>   server/test/com/cloud/vm/UserVmManagerTest.java 71bbebe 
> 
> Diff: https://reviews.apache.org/r/15832/diff/
> 
> 
> Testing
> ---
> 
> Tested on master.
> 
> 
> Thanks,
> 
> bharat kumar
> 
>



Re: Review Request 15840: CLOUDSTACK-5206: Ability to control the external id of first class objects

2013-11-26 Thread Nitin Mehta


> On Nov. 26, 2013, 6:16 p.m., Chris Suich wrote:
> > It looks like you commented out a version check in 
> > VirtualNetworkApplianceManagerImpl.java. Was that intentional?

Thanks Chris for point this out. I realized it while committing it as well.
I omitted the changes to VirtualNetworkApplianceManagerImpl. See the commit 
6bea532e


- Nitin


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15840/#review29448
---


On Nov. 25, 2013, 6:55 p.m., Nitin Mehta wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15840/
> ---
> 
> (Updated Nov. 25, 2013, 6:55 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Bugs: CLOUDSTACK-5206
> https://issues.apache.org/jira/browse/CLOUDSTACK-5206
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> CLOUDSTACK-5206: Ability to control the external id of first
>  class objects. Putting in the generic methods and trying it
>  for objects like vm, volume. This is the first cut
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/storage/VolumeApiService.java 47afa10 
>   api/src/com/cloud/vm/UserVmService.java 444c47a 
>   api/src/org/apache/cloudstack/api/ApiConstants.java 6f919c1 
>   api/src/org/apache/cloudstack/api/BaseAsyncCreateCustomIdCmd.java 
> PRE-CREATION 
>   api/src/org/apache/cloudstack/api/BaseAsyncCustomIdCmd.java PRE-CREATION 
>   api/src/org/apache/cloudstack/api/BaseCustomIdCmd.java PRE-CREATION 
>   api/src/org/apache/cloudstack/api/command/user/vm/DeployVMCmd.java 7180f4e 
>   api/src/org/apache/cloudstack/api/command/user/vm/UpdateVMCmd.java fbb785f 
>   api/src/org/apache/cloudstack/api/command/user/volume/CreateVolumeCmd.java 
> eb4ac88 
>   api/src/org/apache/cloudstack/api/command/user/volume/UpdateVolumeCmd.java 
> f12cef8 
>   engine/schema/src/com/cloud/vm/dao/UserVmDao.java 606d424 
>   engine/schema/src/com/cloud/vm/dao/UserVmDaoImpl.java 43bdef1 
>   
> server/resources/META-INF/cloudstack/core/spring-server-core-managers-context.xml
>  2a080f9 
>   server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java 
> 4bbc872 
>   server/src/com/cloud/storage/VolumeApiServiceImpl.java c693527 
>   server/src/com/cloud/uuididentity/UUIDManager.java PRE-CREATION 
>   server/src/com/cloud/uuididentity/UUIDManagerImpl.java PRE-CREATION 
>   server/src/com/cloud/vm/UserVmManager.java b7b4bd5 
>   server/src/com/cloud/vm/UserVmManagerImpl.java 00d8063 
> 
> Diff: https://reviews.apache.org/r/15840/diff/
> 
> 
> Testing
> ---
> 
> Tested locally.
> 
> 
> Thanks,
> 
> Nitin Mehta
> 
>



Re: [PROPOSAL] User VM HA using native XS HA capabilities

2013-11-26 Thread Chiradeep Vittal
According to
http://support.citrix.com/proddocs/topic/xencenter-61/xs-xc-pools-ha-about.
html


XS HA is about dealing with host failures.
However CS HA also deals with individual VM failures ("fast restart"). I
hope you are not removing fast VM restart.

On 11/26/13 6:54 AM, "David Nalley"  wrote:

>Hi Koushik:
>
>Thanks for the reply - a few followup comments inline. I look forward
>to seeing this work.
>
>Other folks: please read the entire thread and the links from Koushik;
>there's a planned deprecation here.
>
>--David
>
>On Mon, Nov 25, 2013 at 2:38 AM, Koushik Das 
>wrote:
>> Thanks for the comments David. See inline.
>>
>> -Koushik
>>
>> On 22-Nov-2013, at 7:31 PM, David Nalley  wrote:
>>
>>> Hi Koushik:
>>>
>>> In general I like the idea. A couple of comments:
>>>
>>> The upgrade section has a manual step for enabling HA manually per
>>> instance. Why a manual step? Why is CloudStack not checking the
>>> desired state (e.g. if HA is enabled in the instance service group)
>>> with the actual state (what is reflected on the hypervisor) and
>>> changing it when appropriate.
>>>
>>> We are already going to need to reconcile the state (things like host
>>> the instance is running on will change for instance) with reality
>>> already - so it seems like making this an automatic step wouldn't be
>>> much extra effort and would scale far easier.
>>
>> [Koushik] Are you suggesting that as part of the upgrade process, all
>>impacted VMs should be automatically updated? If so, yes it can be done.
>>For now I am keeping it manual, in future the process can be automated.
>>
>
>Why keeping it manual now? Actually let me rephrase - I can understand
>why someone might not want things changed automagically (as an admin
>I'd want nothing changed by default, but changed if I cared about it
>in some automated fashion) Is there a reason we would not include some
>functionality to let the operator automatically change this on some
>subset or all of the machines in an automated fashion?
>
>>>
>>> Are there plans on deprecating the custom HA solution, or will it be
>>> supported forever? If the plan is to deprecate, lets go ahead and
>>> start planning that/announcing/etc and not let it fall into disrepair.
>>
>> [Koushik] That's the plan going forward. For the next release both
>>options will be there. Maybe post that the custom HA solution can be
>>removed for XS 6.2 and above.
>>
>>>
>
>Please make sure that the deprecation is explicitly called out. E.g
>will be present but deprecated in 4.4 and removed in 4.5; and let's
>make sure a doc bug gets filed when this is ready for merge.
>
>--David



Re: HELP with CLOUDSTACK-5145 security issue

2013-11-26 Thread Alena Prokharchyk
I believe this bug was raised in the community list before, and fixed by 
Kishan. Kishan, please comment.

-Alena.
From: Marcus Sorensen mailto:shadow...@gmail.com>>
Reply-To: "dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Date: Tuesday, November 26, 2013 8:28 AM
To: "dev@cloudstack.apache.org" 
mailto:dev@cloudstack.apache.org>>
Subject: HELP with CLOUDSTACK-5145 security issue

Is there anyone who can help with CLOUDSTACK-5145?  There's a security
issue with 4.2+ due to the new ACL design. Anyone listing ACLs sees
ALL ACLs in the system, and if a network has no ACLs then filtering by
network also lists ALL ACLs. As you can imagine, this causes a lot of
problems.  I could hack together some joins to link network_acl,
network_acl_item, and vpc tables to get the account owning the acls,
but I also see this ''_accountMgr.buildACLSearchBuilder" which seems
to be commented out of the list code. I'm wondering if there's a more
elegant way to do it.



Re: persistence layer

2013-11-26 Thread Chiradeep Vittal
Hi Lukas, thanks for chiming in.

I do agree that abstracting over NoSQL and SQL is not compelling.
Both have their specific strengths and developers would be foolhardy to
simply assume that swapping one for the other will magically work.

On 11/26/13 3:57 AM, "Lukas Eder"  wrote:

>Dear CloudStack developers,
>
>This thread has caught my attention and I thought I might chime in and
>give
>you some background information about jOOQ, JDBC, RDBMS in general (I work
>for Data Geekery, the company behind jOOQ). I've already had the pleasure
>to talk to Darren on the jOOQ User Group and on the phone.
>
>Here are some answers to open questions I've seen in this thread:
>
>2013/11/26 Alex Huang 
>
>> Has anyone actually tried dropping in a different jdbc driver and see if
>> CS can use another DB?  I don't think the current CS DB layer prevents
>> anyone from doing that.
>>
>> This is different from MariaDB which, as othes have pointed out, is
>> drop-in replacement for MySQL.  I'm talking about stuff like derby or
>> sqlserver or oracle or db2.
>>
>
>MariaDB and MySQL are diverging quickly, as Oracle invests quite some
>development efforts into MySQL. While the drop-in replacement argument is
>valid right now, it might not be two years from now.
>
>In general, SQL dialects are very different when it comes to the
>subtleties
>of syntax or feature sets. Since you're comparing MySQL with Derby, SQL
>Server, Oracle, or DB2, let me give you some ideas:
>
>- MySQL has a lot of vendor-specific clauses that no one else has (e.g. ON
>DUPLICATE KEY UPDATE)
>- MySQL bends the SQL syntax and accepts what is otherwise illegal syntax
>(e.g. GROUP BY semantics [1])
>- MySQL doesn't correctly implement the SQL standard NOT IN semantics [2]
>- Derby and DB2 (prior to version 9.7) are extremely type-safe. For
>instance, CAST(NULL AS INT) and CAST(NULL AS VARCHAR) are two entirely
>different things. This can lead to tedious work when binding null as a
>bind
>variable. Some background info [3]
>- DB2 has a lot of peculiarities when it comes to memory management of
>VARCHAR [4]
>- Case-sensitivity of schema, table, and column names is an eternal hassle
>between RDBMS
>- JDBC drivers implement things very differently in some areas. Fetching
>an
>inserted ID is really a pain.
>
>[1]: http://blog.jooq.org/2012/08/05/mysql-bad-idea-384/
>[2]:
>http://blog.jooq.org/2012/01/27/sql-incompatibilities-not-in-and-null-valu
>es/
>[3]: http://blog.jooq.org/2011/08/31/rdbms-bind-variable-casting-madness/
>[4]: http://stackoverflow.com/q/9234021/521799
>
>If you want cross-database support, these things show that you should
>really consider moving away from using plain JDBC and use an abstraction
>that will take care of these incompatibilities for you. You might be
>choosing between Hibernate and jOOQ (or both) depending on the way you
>plan
>to interact with your RDBMS. Our point of view is illustrated here:
>http://www.hibernate-alternative.com
>
>Some larger jOOQ customers currently use jOOQ with Oracle, Sybase, SQL
>Server, MySQL, and H2 from the same application.
>
>> Frank Zhang Fri, 22 Nov 2013 10:42:09 -0800
>> I recommend QueryDSL. Having a quick look at JOOQ, it's very similar to
>> QueryDSL.
>> QueryDSL has been integrated into Spring for 2 years, and JOOQ haven't
>had
>> official doc for Spring.
>> Besides Sql, QueryDSL also gets fair credit on manipulating NoSql which
>is an
>> additional plus.
>
>jOOQ and Spring work together quite nicely, even if there is not an
>"official" affiliation between the two stacks:
>
>-
>http://www.jooq.org/doc/3.2/manual/getting-started/tutorials/jooq-with-spr
>ing/
>- http://blog.jooq.org/2012/09/19/a-nice-way-of-using-jooq-with-spring/
>- http://blog.uws.ie/2013/04/using-jooq-with-spring-transactions/
>- http://stackoverflow.com/q/4474365/521799
>
>We're aware of QueryDSL offering SQL and NoSQL support through a single
>API. In our opinion, such greater unification attempts will always come
>with an impedance mismatch at some point. In other words, you'll be losing
>on SQL functionality in favour of greater standardisation / abstraction.
>From our experience with jOOQ, SQL standardisation is already a very hard
>problem. NoSQL databases all work fundamentally differently. The added
>complexity by supporting NoSQL in the same API as SQL databases is
>significant.
>
>Of course, these things depend on whether replacing MySQL for any NoSQL
>database in CloudStack is really a desired, near-term option.
>
>
>I'll be following this thread for another while and I'm more than happy to
>answer any questions you may have related to jOOQ, SQL, JDBC, etc.
>
>Best Regards,
>Lukas



Re: [DISCUSS] Reporting tool for feeding back zone, pod and cluster information

2013-11-26 Thread Chiradeep Vittal
+1. 
Of course we must ensure proper treatment of this data (anonymization,
retention, removal, copyrights)

On 11/23/13 11:01 AM, "Wido den Hollander"  wrote:

>Hi,
>
>I discussed this during CCCEU13 with David, Chip and Hugo and I promised
>I put it on the ml.
>
>My idea is to come up with a reporting tool which users can run daily
>which feeds us back information about how they are using CloudStack:
>
>* Hypervisors
>* Zone sizes
>* Cluster sizes
>* Primary Storage sizes and types
>* Same for Secondary Storage
>* Number of management servers
>* Version
>
>This would ofcourse be anonimized where we would send one file with JSON
>data back to our servers where we can proccess it to do statistics.
>
>The tool will obviously be open source and participating in this will be
>opt-in only.
>
>We currently don't know what's running out there, so that would be great
>to know.
>
>Some questions remain:
>* Who is going to maintain the data?
>* Who has access to the data?
>* How long do we keep it?
>* Do we do logging of IPs sending the data to us?
>
>I certainly do not want to spy on our users, so that's why it's opt-in
>and the tool should be part of the main repo, but I think that for us as
>a project it's very useful to know what our users are doing with
>CloudStack.
>
>Comments?
>
>Wido



Re: file shuffling

2013-11-26 Thread Chiradeep Vittal
Been frustrating, I agree. History should not be lost and merges should
not be squashed!

On 11/22/13 7:37 PM, "Marcus Sorensen"  wrote:

>I just need to blow off some steam about the shifting sands of our
>codebase.  I went to look at the resizeVolume method today and found
>that it has moved again, twice in about six months. It went from
>StorageManagerImpl.java in 4.1 to VolumeManagerImpl.java in 4.2, and
>now VolumeApiServiceImpl.java in 4.3. I assume sometime soon it will
>move again from com.cloud.storage to org.apache.storage or something.
>I'm hoping that change is progress, but between this and knowing of at
>least two occasions where features/patches simply disappeared because
>a file re-org branch was merged in that ignored any changes
>post-branch, I begin to wonder why in the heck things keep getting
>moved around and how much thought is being put into the consequences.



Re: [DISCUSS] Reporting tool for feeding back zone, pod and cluster information

2013-11-26 Thread Steve Wilson
I built something like this for products at Sun Microsystems.  We embedded
into nearly everything we built:

The Java Runtime Environment
Open Office
Solaris
MySQL
Even things like Server LOMs
(the list goes on)

By default, when each of these products installed/first run, it would try
to bring the user into the program.  It was always possible to opt out,
but we really worked to get people to not opt out.  We got shockingly HUGE
piles of data (literally from millions of installed product instances).
We didn't get any complaints (EVER) in the years we ran this program.  It
was hugely useful to the product teams.

BTW, we didn't even make this data anonymous.  You could obviously choose
to be anonymous, but if people want to give their names/companies then why
not let them?  You'd be surprised how many people wouldn't mind.

-Steve

On 11/26/13 12:49 PM, "Chiradeep Vittal" 
wrote:

>+1. 
>Of course we must ensure proper treatment of this data (anonymization,
>retention, removal, copyrights)
>
>On 11/23/13 11:01 AM, "Wido den Hollander"  wrote:
>
>>Hi,
>>
>>I discussed this during CCCEU13 with David, Chip and Hugo and I promised
>>I put it on the ml.
>>
>>My idea is to come up with a reporting tool which users can run daily
>>which feeds us back information about how they are using CloudStack:
>>
>>* Hypervisors
>>* Zone sizes
>>* Cluster sizes
>>* Primary Storage sizes and types
>>* Same for Secondary Storage
>>* Number of management servers
>>* Version
>>
>>This would ofcourse be anonimized where we would send one file with JSON
>>data back to our servers where we can proccess it to do statistics.
>>
>>The tool will obviously be open source and participating in this will be
>>opt-in only.
>>
>>We currently don't know what's running out there, so that would be great
>>to know.
>>
>>Some questions remain:
>>* Who is going to maintain the data?
>>* Who has access to the data?
>>* How long do we keep it?
>>* Do we do logging of IPs sending the data to us?
>>
>>I certainly do not want to spy on our users, so that's why it's opt-in
>>and the tool should be part of the main repo, but I think that for us as
>>a project it's very useful to know what our users are doing with
>>CloudStack.
>>
>>Comments?
>>
>>Wido
>



Some of the noredist plugin are not loading with 4.3 build

2013-11-26 Thread Rayees Namathponnan
Hi All,

I am trying to use netscaler with 4.3 branch code;  creating dev environment 
with below commands

mvn -P developer,systemvm -Dnoredist clean install
mvn -P developer -pl developer -Ddeploydb
mvn -pl :cloud-client-ui jetty:run


While trying to add NetScaler device,  its failing with error,

2013-11-26 12:47:56,705 DEBUG [c.c.a.ApiServlet] 
(770231460@qtp-492253495-10:ctx-14418618) ===START===  10.214.5.33 -- GET  
command=addNetworkServiceProvider&name=Netscaler&physicalnetw
orkid=fb2b49d9-e131-41f8-8a33-e0b5638e813d&response=json&sessionkey=iV0O%2BrVYGbE63CSpcOxbtoFy6z0%3D&_=1385499294051
2013-11-26 12:47:56,738 INFO  [c.c.a.ApiServer] 
(770231460@qtp-492253495-10:ctx-14418618 ctx-6363bd6f) Unable to find the 
Network Element implementing the Service Provider 'Netscaler'
2013-11-26 12:47:56,739 DEBUG [c.c.a.ApiServlet] 
(770231460@qtp-492253495-10:ctx-14418618 ctx-6363bd6f) ===END===  10.214.5.33 
-- GET  command=addNetworkServiceProvider&name=Netscaler&p
hysicalnetworkid=fb2b49d9-e131-41f8-8a33-e0b5638e813d&response=json&sessionkey=iV0O%2BrVYGbE63CSpcOxbtoFy6z0%3D&_=1385499294051



If I look at the module tree, I cannot see "Netscaler" loading,

2013-11-26 11:59:02,091 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   backend
2013-11-26 11:59:02,091 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy: compute
2013-11-26 11:59:02,092 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   baremetal-compute
2013-11-26 11:59:02,096 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   hyperv-compute
2013-11-26 11:59:02,096 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   kvm-compute
2013-11-26 11:59:02,096 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   ovm-compute
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   server-alert-adapter-compute
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   server-compute
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   server-fencer
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   server-investigator
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   xenserver-compute
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy: network
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   baremetal-network
2013-11-26 11:59:02,098 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   elb
2013-11-26 11:59:02,098 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   midonet
2013-11-26 11:59:02,101 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   nvp
2013-11-26 11:59:02,101 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   ovs
2013-11-26 11:59:02,101 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   paloalto
2013-11-26 11:59:02,101 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   server-network
2013-11-26 11:59:02,101 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   ssp
2013-11-26 11:59:02,102 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   vns
2013-11-26 11:59:02,102 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   vxlan
2013-11-26 11:59:02,102 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy: server-alert-adapter-backend


Regards,
Rayees



RE: edit access to cwiki

2013-11-26 Thread Chandan Purushothama
May I request for edit access to cwiki please,

Thank you,
Chandan.

-Original Message-
From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] 
Sent: Monday, November 25, 2013 10:53 PM
To: dev
Subject: Re: edit access to cwiki

On Mon, Nov 18, 2013 at 7:36 AM, Shweta Agarwal  
wrote:
> 'shweta.agar...@citrix.com


added,

sorry it took so long


Re: Some of the noredist plugin are not loading with 4.3 build

2013-11-26 Thread Syed Ahmed
I am working on master and Netscaler is loading fine on it. Haven't 
tested it on 4.3 branch though. This seems to be related to the spring 
changes that are going on right now.


-Syed

On Tue 26 Nov 2013 05:10:05 PM EST, Rayees Namathponnan wrote:

Hi All,

I am trying to use netscaler with 4.3 branch code;  creating dev environment 
with below commands

mvn -P developer,systemvm -Dnoredist clean install
mvn -P developer -pl developer -Ddeploydb
mvn -pl :cloud-client-ui jetty:run


While trying to add NetScaler device,  its failing with error,

2013-11-26 12:47:56,705 DEBUG [c.c.a.ApiServlet] 
(770231460@qtp-492253495-10:ctx-14418618) ===START===  10.214.5.33 -- GET  
command=addNetworkServiceProvider&name=Netscaler&physicalnetw
orkid=fb2b49d9-e131-41f8-8a33-e0b5638e813d&response=json&sessionkey=iV0O%2BrVYGbE63CSpcOxbtoFy6z0%3D&_=1385499294051
2013-11-26 12:47:56,738 INFO  [c.c.a.ApiServer] 
(770231460@qtp-492253495-10:ctx-14418618 ctx-6363bd6f) Unable to find the 
Network Element implementing the Service Provider 'Netscaler'
2013-11-26 12:47:56,739 DEBUG [c.c.a.ApiServlet] 
(770231460@qtp-492253495-10:ctx-14418618 ctx-6363bd6f) ===END===  10.214.5.33 -- GET  
command=addNetworkServiceProvider&name=Netscaler&p
hysicalnetworkid=fb2b49d9-e131-41f8-8a33-e0b5638e813d&response=json&sessionkey=iV0O%2BrVYGbE63CSpcOxbtoFy6z0%3D&_=1385499294051



If I look at the module tree, I cannot see "Netscaler" loading,

2013-11-26 11:59:02,091 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   backend
2013-11-26 11:59:02,091 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy: compute
2013-11-26 11:59:02,092 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   baremetal-compute
2013-11-26 11:59:02,096 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   hyperv-compute
2013-11-26 11:59:02,096 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   kvm-compute
2013-11-26 11:59:02,096 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   ovm-compute
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   server-alert-adapter-compute
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   server-compute
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   server-fencer
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   server-investigator
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   xenserver-compute
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy: network
2013-11-26 11:59:02,097 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   baremetal-network
2013-11-26 11:59:02,098 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   elb
2013-11-26 11:59:02,098 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   midonet
2013-11-26 11:59:02,101 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   nvp
2013-11-26 11:59:02,101 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   ovs
2013-11-26 11:59:02,101 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   paloalto
2013-11-26 11:59:02,101 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   server-network
2013-11-26 11:59:02,101 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   ssp
2013-11-26 11:59:02,102 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   vns
2013-11-26 11:59:02,102 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy:   vxlan
2013-11-26 11:59:02,102 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) Module Hierarchy: server-alert-adapter-backend


Regards,
Rayees







Re: HELP with CLOUDSTACK-5145 security issue

2013-11-26 Thread Marcus Sorensen
The bug was raised (CLOUDSTACK-5145), but not closed, so I assumed it
was still open.

On Tue, Nov 26, 2013 at 1:46 PM, Alena Prokharchyk
 wrote:
> I believe this bug was raised in the community list before, and fixed by 
> Kishan. Kishan, please comment.
>
> -Alena.
> From: Marcus Sorensen mailto:shadow...@gmail.com>>
> Reply-To: "dev@cloudstack.apache.org" 
> mailto:dev@cloudstack.apache.org>>
> Date: Tuesday, November 26, 2013 8:28 AM
> To: "dev@cloudstack.apache.org" 
> mailto:dev@cloudstack.apache.org>>
> Subject: HELP with CLOUDSTACK-5145 security issue
>
> Is there anyone who can help with CLOUDSTACK-5145?  There's a security
> issue with 4.2+ due to the new ACL design. Anyone listing ACLs sees
> ALL ACLs in the system, and if a network has no ACLs then filtering by
> network also lists ALL ACLs. As you can imagine, this causes a lot of
> problems.  I could hack together some joins to link network_acl,
> network_acl_item, and vpc tables to get the account owning the acls,
> but I also see this ''_accountMgr.buildACLSearchBuilder" which seems
> to be commented out of the list code. I'm wondering if there's a more
> elegant way to do it.
>


Getting error while adding Netscaler with the new 10.1 API

2013-11-26 Thread Syed Ahmed

Hi,

I am trying to move the Netscaler to the 10.1 Nitro API and while using 
the new API I am getting the following error when adding Netscaler device


PKIX
 path building failed:
sun.security.provider.certpath.SunCertPathBuilderException: unable to
find valid certification path to requested target


I have changed to use HTTP instead of HTTPS in nitro to temporarily work 
around this problem. Is HTTPS absolutely required for communication with 
external devices? or does my workaround is a valid fix?


Thanks,
-Syed


Re: Getting error while adding Netscaler with the new 10.1 API

2013-11-26 Thread Chiradeep Vittal
That happens when you use a self-signed certificate.
You can use EasySSLProtocolSocketFactory.java from utils

On 11/26/13 4:28 PM, "Syed Ahmed"  wrote:

>Hi,
>
>I am trying to move the Netscaler to the 10.1 Nitro API and while using
>the new API I am getting the following error when adding Netscaler device
>
>PKIX
>  path building failed:
>sun.security.provider.certpath.SunCertPathBuilderException: unable to
>find valid certification path to requested target
>
>
>I have changed to use HTTP instead of HTTPS in nitro to temporarily work
>around this problem. Is HTTPS absolutely required for communication with
>external devices? or does my workaround is a valid fix?
>
>Thanks,
>-Syed



Re: edit access to cwiki

2013-11-26 Thread Chiradeep Vittal
done

On 11/26/13 2:32 PM, "Chandan Purushothama"
 wrote:

>May I request for edit access to cwiki please,
>
>Thank you,
>Chandan.
>
>-Original Message-
>From: Daan Hoogland [mailto:daan.hoogl...@gmail.com]
>Sent: Monday, November 25, 2013 10:53 PM
>To: dev
>Subject: Re: edit access to cwiki
>
>On Mon, Nov 18, 2013 at 7:36 AM, Shweta Agarwal
> wrote:
>> 'shweta.agar...@citrix.com
>
>
>added,
>
>sorry it took so long



RE: ACS 4.2.1 - Multi-Zone vSphere Architecture

2013-11-26 Thread Sanjeev Neelarapu
Hi,

It is not mandatory to use single dedicated vlan in a multi zone environment. 
It is possible to have a dedicated VLAN at each site for vCenter, ESXi console 
ports and the system VM's, and then have the ACS server sitting in a separate 
VLAN that can route between both networks.

Thanks,
Sanjeev

From: Simon Murphy [mailto:simon.mur...@vifx.co.nz]
Sent: Monday, November 25, 2013 7:32 AM
To: us...@cloudstack.apache.org; dev@cloudstack.apache.org
Subject: ACS 4.2.1 - Multi-Zone vSphere Architecture

Hi all,

Im after some guidance on setting up ACS 4.2.1 with vSphere in a multi zone 
environment. The only way I have been able to successfully build a zone to this 
point is by having vSphere, ESXi console ports, ACS and the reserved system 
range on a single VLAN. This is OK for a small, single site deployment but how 
does this translate for multiple zones? The docs suggest that configuring a 
single /20 range for management is desired, does that imply that that range 
should be stretched across sites?

Should it be possible to have a dedicated VLAN at each site for vCenter, ESXi 
console ports and the system VM's, and then have the ACS server sitting in a 
separate VLAN that can route between both networks? I have been unsuccessful in 
getting his working to date so hopefully someone out there has some experience 
setting up a multi-site ACS/vSphere envoronment.

Any guidance would be greatly appreciated!


Simon Murphy
Solutions Architect

ViFX | Cloud Infrastructure
Level 7, 57 Fort Street, Auckland, New Zealand 1010
PO Box 106700, Auckland, New Zealand 1143
M +64 21 285 4519 | S simon_a_murphy
www.vifx.co.nz follow us on 
twitter
Auckland | Wellington | Christchurch

[cid:image003.jpg@01CDDF95.815BF160]

experience. expertise. execution.

This email and any files transmitted with it are confidential, without 
prejudice and may contain information that is subject to legal privilege. It is 
intended solely for the use of the individual/s to whom it is addressed in 
accordance with the provisions of the Privacy Act (1993). The content contained 
in this email does not, necessarily, reflect the official policy position of 
ViFX nor does ViFX have any responsibility for any alterations to the contents 
of this email that may occur following transmission. If you are not the 
addressee it may be unlawful for you to read, copy, distribute, disclose or 
otherwise use the information contained within this email. If you are not the 
intended recipient, please notify the sender prior to deleting this email 
message from your system. Please note ViFX reserves the right to monitor, from 
time to time, the communications sent to and from its email network.


[ACS4.3] Schedule reminder : 10 days to code freeze

2013-11-26 Thread Animesh Chaturvedi
Folks

We are now 10 days from ACS 4.3 code freeze and our bug fix activity is very 
slow. If you have any issues assigned to you please try to resolve them ASAP 
and help close the unassigned issues.

For detailed report visit the release dashboard [1]

[1] https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12321625

Thanks
Animesh


Re: JIRA 285

2013-11-26 Thread Mandar Barve
Thanks Daan for your inputs. It looks like I don't have permissions to
assign or change bug state. What should I do to get these?

Thanks,
Mandar


On Tue, Nov 26, 2013 at 2:29 PM, Daan Hoogland wrote:

> Mandar,
>
> As you have updated the ticket, the reporter should have been notified
> of your findings. I think resolving it is the proper way to go, and if
> the reporter doesn't close or reopen it withing a month or so, close
> it.
>
> regards
>
> On Mon, Nov 25, 2013 at 9:10 AM, Mandar Barve 
> wrote:
> > Hi all,
> >  I could not reproduce this issue with vesion 4.0.2. I tried creating
> > hourly snapshot schedule with a keep value of 4. I could see 4 snapshots
> > retained. Then as mentioned in the bug I deleted the schedule and
> recreated
> > with same parameters except changing the keep value to 3. After this I
> > could see only 3 snapshots retained.
> >
> > Has this been resolved? Can it be closed? I have updated the JIRA with my
> > comments.
> >
> > Thanks,
> > Mandar
>
>


Re: JIRA 3061

2013-11-26 Thread Mandar Barve
Thanks Daan for your inputs. It looks like I don't have permissions to
assign or change bug state. What should I do to get these?

Thanks,
Mandar


On Tue, Nov 26, 2013 at 2:25 PM, Daan Hoogland wrote:

> H Mandar,
>
> You can contact the reporter directly but that would only be to ask to
> verify in the newer version. This can be a hassle for small plants. So
> you could put to resolved with the right fix-version.
>
> regards,
>
>
> On Mon, Nov 25, 2013 at 9:00 AM, Mandar Barve 
> wrote:
> > Hi all,
> >
> > Problem: JIRA says list hosts API response didn't return CPU used
> parameter
> > value. This bug is reported against version 4.0.2.
> >
> > I could not reproduce this problem with CS version 4.2.
> >
> > I used CloudMonkey CLI to fire API commands to the management server.
> With
> > a basic zone created that has 1 pod, cluster and couple of system vms
> > connected to the management server using CloudMonkey CLI sent the list
> > hosts API command and the JSON response output could be captured in the
> log
> > file. JSON response and the CLI output shows "cpuused". The value seen
> here
> > could be matched against the portal reported host statistics value for
> CPU
> > used.
> >
> > CLI output:
> >
> >> list hosts
> > count = 1
> > host:
> > id = df4fe805-a320-4417-b8be-22dd0b86561e
> > name = devcloud
> > capabilities = xen-3.0-x86_32p , hvm
> > clusterid = b3b80638-1fc5-4d13-aafc-28ff5155c681
> > clustername = test000
> > clustertype = CloudManaged
> > cpuallocated = 0%
> > cpunumber = 2
> > cpuspeed = 2486
> > *cpuused = 0.22%*
> > cpuwithoverprovisioning = 4972.0
> > created = 2013-10-07T18:57:58+0530
> > disconnected = 2013-10-15T11:24:19+0530
> > events = PingTimeout; AgentConnected; HostDown; ShutdownRequested;
> > AgentDisconnected; ManagementServerDown; Remove; Ping;
> StartAgentRebalance
> > hahost = False
> > hypervisor = XenServer
> > ipaddress = 192.168.56.10
> > islocalstorageactive = False
> > lastpinged = 1970-01-16T20:20:29+0530
> >
> >  JSON response log:
> >
> > 2013-10-15 11:48:32,724 - requester.py:45 - [DEBUG]  START
> Request
> > 
> > 2013-10-15 11:48:32,724 - requester.py:45 - [DEBUG] Requesting
> > command=listHosts, args={}
> > 2013-10-15 11:48:32,725 - requester.py:45 - [DEBUG] Request sent:
> >
> http://localhost:8080/client/api?apiKey=c9uPXphFfiQS5589hVp245hWrqcg1yxcVNg9h1xJES34j8uAtvKj0EP6h8jlSC5_VlajL1a2TaXuYFGoON0DMg&command=listHosts&response=json&signature=hKQ5hI0XFpAzNPJYJ7ivR53%2FzJU%3D
> > 2013-10-15 11:48:32,820 - requester.py:45 - [DEBUG] Response received: {
> > "listhostsresponse" : { "count":1 ,"host" : [
> >
>  
> {"id":"df4fe805-a320-4417-b8be-22dd0b86561e","name":"devcloud","state":"Up","disconnected":"2013-10-15T11:24:19+0530","type":"Routing","ipaddress":"192.168.56.10","zoneid":"7b015b74-f00f-4216-b523-efc2e32c6bc5","zonename":"DevCloud0","podid":"c58e91d0-ad57-4d09-a485-f0decab857b4","podname":"test00","version":"4.2.0","hypervisor":"XenServer","cpunumber":2,"cpuspeed":2486,"cpuallocated":"0%",
> >
> *"cpuused":"0.22%"*,"cpuwithoverprovisioning":"4972.0","networkkbsread":57462,"networkkbswrite":38105,"memorytotal":251632,"memoryallocated":0,"memoryused":546428,"capabilities":"xen-3.0-x86_32p
> > ,
> >
> hvm","lastpinged":"1970-01-16T20:20:29+0530","managementserverid":8796750265493,"clusterid":"b3b80638-1fc5-4d13-aafc-28ff5155c681","clustername":"test000","clustertype":"CloudManaged","islocalstorageactive":false,"created":"2013-10-07T18:57:58+0530","events":"PingTimeout;
> > AgentConnected; HostDown; ShutdownRequested; AgentDisconnected;
> > ManagementServerDown; Remove; Ping;
> > StartAgentRebalance","resourcestate":"Enabled","hahost":false} ] } }
> > 2013-10-15 11:48:32,821 - requester.py:45 - [DEBUG]  END Request
> > 
> >
> > Can this be closed? I have updated the JIRA with same comment.
> >
> > Thanks,
> > Mandar
>
>


Re: Help In Launch instance Schedule policy

2013-11-26 Thread Yitao Jiang
Hi, Prachi,

I followed the directions of above link , and configure
vm.allocation.algorithm
to userconcentratedpod_random. But it seems does't work.
Through the codes about the deployment plan, i found that the algorithms of
UserDispersingPlanner
and UserConcentratedPodPlanner all extends FirstFitPlanner, but neither
implement the method of
plan, which actually works for deciding where to deploy a vm, so no matter
what algorithms i used,
it all use the algorithm of firstfit algorithm, cause it implement the plan
method.
Is this a bug or developer should implement this method, or did i miss
something in the global configuration ?



2013/11/23 Prachi Damle 

> Hi Yitao,
>
> CloudStack scheduling policies are implemented by the DeploymentPlanner
> and HostAllocator/StoragePoolAllocator components.
> If you want to take a look at the source code of these components, this
> will tell you where to look:
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/VM+Deployment+Planning+and+Resource+Allocation
>
> These components implement the Adapter  interface of CloudStack - so you
> can provide your own implementation and plug it in to be used for VM
> deployment. Let me know if you face any questions on this.
>
> Thanks,
> Prachi
> -Original Message-
> From: Yitao Jiang [mailto:willier...@gmail.com]
> Sent: Thursday, November 21, 2013 10:11 PM
> To: dev@cloudstack.apache.org
> Subject: Help In Launch instance Schedule policy
>
> Hi,
>
> I was looking for some help in launching instance using some schedule
> policies.
> I know that Openstack allow developers write their own policy .So I guess
> cloudstack support maybe that .Since i am just started developing it , i'll
> be really appreciate someone can tell me where i can write it  using some
> policy, such as according to the weight of each host, or RoundRobin.
> --
>
> Best regards,
>
> Yitao Jiang
>



-- 

Best regards,

Yitao Jiang


Re: [PROPOSAL] User VM HA using native XS HA capabilities

2013-11-26 Thread Koushik Das
I haven't tried in XS 6.1 but in 6.2 if a VM is marked as HA enabled (based on 
ha-restart-priority) in a HA enabled cluster then if the VM is not stopped 
using xapi then it is automatically re-started.

I tried the following on XS 6.2 and it worked as expected:
- Logged on to a guest VM marked as HA enabled
- Ran "shutdown -h now"
- After sometime the VM got restarted

-Koushik

 
On 27-Nov-2013, at 2:11 AM, Chiradeep Vittal  
wrote:

> According to
> http://support.citrix.com/proddocs/topic/xencenter-61/xs-xc-pools-ha-about.
> html
> 
> 
> XS HA is about dealing with host failures.
> However CS HA also deals with individual VM failures ("fast restart"). I
> hope you are not removing fast VM restart.
> 
> On 11/26/13 6:54 AM, "David Nalley"  wrote:
> 
>> Hi Koushik:
>> 
>> Thanks for the reply - a few followup comments inline. I look forward
>> to seeing this work.
>> 
>> Other folks: please read the entire thread and the links from Koushik;
>> there's a planned deprecation here.
>> 
>> --David
>> 
>> On Mon, Nov 25, 2013 at 2:38 AM, Koushik Das 
>> wrote:
>>> Thanks for the comments David. See inline.
>>> 
>>> -Koushik
>>> 
>>> On 22-Nov-2013, at 7:31 PM, David Nalley  wrote:
>>> 
 Hi Koushik:
 
 In general I like the idea. A couple of comments:
 
 The upgrade section has a manual step for enabling HA manually per
 instance. Why a manual step? Why is CloudStack not checking the
 desired state (e.g. if HA is enabled in the instance service group)
 with the actual state (what is reflected on the hypervisor) and
 changing it when appropriate.
 
 We are already going to need to reconcile the state (things like host
 the instance is running on will change for instance) with reality
 already - so it seems like making this an automatic step wouldn't be
 much extra effort and would scale far easier.
>>> 
>>> [Koushik] Are you suggesting that as part of the upgrade process, all
>>> impacted VMs should be automatically updated? If so, yes it can be done.
>>> For now I am keeping it manual, in future the process can be automated.
>>> 
>> 
>> Why keeping it manual now? Actually let me rephrase - I can understand
>> why someone might not want things changed automagically (as an admin
>> I'd want nothing changed by default, but changed if I cared about it
>> in some automated fashion) Is there a reason we would not include some
>> functionality to let the operator automatically change this on some
>> subset or all of the machines in an automated fashion?
>> 
 
 Are there plans on deprecating the custom HA solution, or will it be
 supported forever? If the plan is to deprecate, lets go ahead and
 start planning that/announcing/etc and not let it fall into disrepair.
>>> 
>>> [Koushik] That's the plan going forward. For the next release both
>>> options will be there. Maybe post that the custom HA solution can be
>>> removed for XS 6.2 and above.
>>> 
 
>> 
>> Please make sure that the deprecation is explicitly called out. E.g
>> will be present but deprecated in 4.4 and removed in 4.5; and let's
>> make sure a doc bug gets filed when this is ready for merge.
>> 
>> --David
> 



Re: Help In Launch instance Schedule policy

2013-11-26 Thread Prachi Damle
Hi Yitao,

Which version of CloudStack are you working with? That will determine the 
configuration needed.

The UserDispersing and UserConcentrated extend the FirstFit and just override 
the methods that decide the order of clusters to be considered for searching 
the resources, based on their respective heuristics.

Prachi

> On Nov 26, 2013, at 10:04 PM, "Yitao Jiang"  wrote:
> 
> Hi, Prachi,
> 
> I followed the directions of above link , and configure
> vm.allocation.algorithm
> to userconcentratedpod_random. But it seems does't work.
> Through the codes about the deployment plan, i found that the algorithms of
> UserDispersingPlanner
> and UserConcentratedPodPlanner all extends FirstFitPlanner, but neither
> implement the method of
> plan, which actually works for deciding where to deploy a vm, so no matter
> what algorithms i used,
> it all use the algorithm of firstfit algorithm, cause it implement the plan
> method.
> Is this a bug or developer should implement this method, or did i miss
> something in the global configuration ?
> 
> 
> 
> 2013/11/23 Prachi Damle 
> 
>> Hi Yitao,
>> 
>> CloudStack scheduling policies are implemented by the DeploymentPlanner
>> and HostAllocator/StoragePoolAllocator components.
>> If you want to take a look at the source code of these components, this
>> will tell you where to look:
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/VM+Deployment+Planning+and+Resource+Allocation
>> 
>> These components implement the Adapter  interface of CloudStack - so you
>> can provide your own implementation and plug it in to be used for VM
>> deployment. Let me know if you face any questions on this.
>> 
>> Thanks,
>> Prachi
>> -Original Message-
>> From: Yitao Jiang [mailto:willier...@gmail.com]
>> Sent: Thursday, November 21, 2013 10:11 PM
>> To: dev@cloudstack.apache.org
>> Subject: Help In Launch instance Schedule policy
>> 
>> Hi,
>> 
>> I was looking for some help in launching instance using some schedule
>> policies.
>> I know that Openstack allow developers write their own policy .So I guess
>> cloudstack support maybe that .Since i am just started developing it , i'll
>> be really appreciate someone can tell me where i can write it  using some
>> policy, such as according to the weight of each host, or RoundRobin.
>> --
>> 
>> Best regards,
>> 
>> Yitao Jiang
> 
> 
> 
> -- 
> 
> Best regards,
> 
> Yitao Jiang