Re: Libvirt-java 0.5.0 has been released

[Wido den Hollander]

I checked libvirt 0.5.1 btw and it's Java 6 now:

wido@wido-desktop:~/Desktop/org/libvirt/jna$ javap -verbose SecretPointer
public class org.libvirt.jna.SecretPointer extends com.sun.jna.PointerType
  minor version: 0
  major version: 50
  Constant pool:

Java 5 uses major version 49
Java 6 uses major version 50
Java 7 uses major version 51

Wido

On 09/25/2013 08:45 AM, Wido den Hollander wrote:



On 09/24/2013 11:39 PM, Yoshikazu Nojima wrote:

Hi,
libvirt-java 0.5.1 is released, and I tried to upgrade it to 0.5.1,

diff --git a/pom.xml b/pom.xml
index a8778f1..1c85bc4 100644
--- a/pom.xml
+++ b/pom.xml
@@ -81,7 +81,7 @@
  0.9.8
  0.10

build/replace.properties
-0.5.0
+0.5.1
  0.1.3
  target
  1.0.10
--
1.8.3.msysgit.0

but I faced another error.

24/09/2013 05:27:12 28923 jsvc.exec error: Cannot start daemon
24/09/2013 05:27:12 28922 jsvc.exec error: Service exit with a return
value of 5
log4j:WARN No appenders could be found for logger
(org.apache.commons.httpclient.params.DefaultHttpParams).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
for more info.
java.lang.reflect.InvocationTargetException
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

 at java.lang.reflect.Method.invoke(Method.java:616)
 at
org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:177)

Caused by: java.lang.NoSuchMethodError:
com.sun.jna.Pointer.nativeValue(Lcom/sun/jna/Pointer;)J
 at org.libvirt.Library.free(Unknown Source)
 at org.libvirt.Connect.getCapabilities(Unknown Source)
 at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4509)

 at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:747)

 at com.cloud.agent.Agent.(Agent.java:161)
 at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:421)
 at
com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:376)
 at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:357)
 at com.cloud.agent.AgentShell.start(AgentShell.java:454)
 ... 5 more



Could it be you have a older version of JNA on your system in the
classpath which is causing problems?


with libvirt 0.5.1, I received following error:

24/09/2013 05:26:13 28823 jsvc.exec error: Cannot start daemon
24/09/2013 05:26:13 28822 jsvc.exec error: Service exit with a return
value of 5
log4j:WARN No appenders could be found for logger
(org.apache.commons.httpclient.params.DefaultHttpParams).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
for more info.
java.lang.reflect.InvocationTargetException
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

 at java.lang.reflect.Method.invoke(Method.java:616)
 at
org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:177)

Caused by: java.lang.UnsupportedClassVersionError:
org/libvirt/LibvirtException : Unsupported major.minor version 51.0
 at java.lang.ClassLoader.defineClass1(Native Method)
 at java.lang.ClassLoader.defineClass(ClassLoader.java:634)
 at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
 at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
 at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
 at java.lang.Class.forName0(Native Method)
 at java.lang.Class.forName(Class.java:188)
 at
com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:370)
 at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:357)
 at com.cloud.agent.AgentShell.start(AgentShell.java:454)
 ... 5 more



2013/9/22 Wido den Hollander :



On 09/21/2013 09:38 AM, Hugo Trippaers wrote:


Ahh ok.

Any idea how long that is going to take? At the moment our automated
build
are basically non functional as they all fail to build and thus also
don't
kickoff the downstream builds like the noredist build. C

Re: Libvirt-java 0.5.0 has been released

[Wei ZHOU]

I tried both java 6 and java 7.
build and install successfully
agent can not restart.
I will try after jna.version change .

Re: Database upgrade

[Indra Pramana]

Hi Harikrishna,

Thank you for your email reply, greatly appreciated.

Thank you.


On Wed, Sep 25, 2013 at 1:05 PM, Harikrishna Patnala <
harikrishna.patn...@citrix.com> wrote:

> My comments inline
>
> -Harikrishna
>
> On 25-Sep-2013, at 10:18 AM, Indra Pramana  wrote:
>
> > Dear all,
> >
> > During my (failed) upgrade attempt from CloudStack 4.1.1 to 4.2.0 early
> > this week, I noted that CloudStack management server will automatically
> > detect the database version and upgrade the database automatically.
> >
> > ===
> > 2013-09-24 02:23:48,145 INFO  [utils.component.ComponentContext]
> > (Timer-1:null) Running SystemIntegrityChecker managementServerNode
> > 2013-09-24 02:23:48,145 INFO  [utils.component.ComponentContext]
> > (Timer-1:null) Running SystemIntegrityChecker databaseUpgradeChecker
> > 2013-09-24 02:23:48,145 INFO  [cloud.upgrade.DatabaseUpgradeChecker]
> > (Timer-1:null) Grabbing lock to check for database upgrade.
> > 2013-09-24 02:23:48,147 DEBUG [upgrade.dao.VersionDaoImpl] (Timer-1:null)
> > Checking to see if the database is at a version before it was the version
> > table is created
> > 2013-09-24 02:23:48,154 INFO  [cloud.upgrade.DatabaseUpgradeChecker]
> > (Timer-1:null) DB version = 4.1.1 Code Version = 4.2.0
> > 2013-09-24 02:23:48,154 INFO  [cloud.upgrade.DatabaseUpgradeChecker]
> > (Timer-1:null) Database upgrade must be performed from 4.1.1 to 4.2.0
> > 2013-09-24 02:23:48,154 DEBUG [cloud.upgrade.DatabaseUpgradeChecker]
> > (Timer-1:null) Running upgrade Upgrade410to420 to upgrade from
> 4.1.0-4.1.1
> > to 4.2.0
> > 2013-09-24 02:23:48,159 DEBUG [utils.script.Script] (Timer-1:null)
> Looking
> > for db/schema-410to420.sql in the classpath
> > 2013-09-24 02:23:48,160 DEBUG [utils.script.Script] (Timer-1:null) System
> > resource:
> file:/usr/share/cloudstack-management/setup/db/schema-410to420.sql
> > 2013-09-24 02:23:48,160 DEBUG [utils.script.Script] (Timer-1:null)
> Absolute
> > path =  /usr/share/cloudstack-management/setup/db/schema-410to420.sql
> > ===
> >
> > My questions:
> >
> > (1) Am I right to say that this database check and upgrade is done when
> the
> > cloudstack-management 4.2.0 service is started? It's not performed during
> > the installation/upgrade of the cloudstack-management app (in my case,
> > apt-get install cloudstack-management)?
> >>> Yes database upgrade happens during the start of MS. It compares the
> CS version in DB and MS version if upgrade path is defined DB upgrades to
> the MS version.
> Even during any fresh install, DB points to 4.0 and during start of MS, DB
> upgrade happens to the MS version.
> >
> > (2) I used a new set of disk for my upgrade attempt by cloning the
> existing
> > disk to a new one (using dd), and perform the upgrade on the new disk.
> When
> > I failed the upgrade attempt, I just reverted back to the old disk and
> > restore the database (which is hosted on a different server). The new set
> > of disk is still containing the new 4.2.0 of cloudstack-management app
> > inside.
> >
> > To perform another upgrade attempt, can I just boot-up using the new set
> of
> > disk (instead of re-cloning and re-doing the upgrade)? Will it again
> detect
> > that the existing database is still version 4.1.1, and will automatically
> > upgrade the database to version 4.2.0 when the service is started?
> >>> Yes, upgrade happens again since you have restored the DB to 4.1 and
> during MS start it gets the DB version from version table (here it is 4.1).
> >
> > Looking forward to your reply, thank you.
> >
> > Cheers.
>
>

Re: Libvirt-java 0.5.0 has been released

[Wei ZHOU]

fixed by commit 3dc4284


commit 3dc4284a34a1c79970b30288c245a26e8425e811
Author: Wei Zhou 
Date:   Wed Sep 25 11:08:57 2013 +0200
add missing jna-4.0.0.jar to cloudstack-agent library by changing scope
from provided to default runtime
diff --git a/plugins/hypervisors/kvm/pom.xml
b/plugins/hypervisors/kvm/pom.xml
index 4c0ec98..024cafe 100644
--- a/plugins/hypervisors/kvm/pom.xml
+++ b/plugins/hypervisors/kvm/pom.xml
@@ -51,7 +51,6 @@
 
   net.java.dev.jna
jna
-   provided
${cs.jna.version}
 
   


2013/9/25 Wei ZHOU 

> I tried both java 6 and java 7.
> build and install successfully
> agent can not restart.
> I will try after jna.version change .
>

Review Request 14333: CLOUDSTACK-4691: move egress rules host maintenance tests to maint folder

[SrikanteswaraRao Talluri]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14333/
---

Review request for cloudstack, venkata swamy babu  budumuru and Prasanna 
Santhanam.


Bugs: CLOUDSTACK-4691


Repository: cloudstack-git


Description
---

move host maintenance tests to maint folder and correct few typos


Diffs
-

  test/integration/component/maint/test_egress_rules_host_maintenance.py 
PRE-CREATION 
  test/integration/component/maint/test_host_high_availability.py 5fb047b 
  test/integration/component/test_egress_rules.py 10e0d03 
  tools/marvin/marvin/integration/lib/base.py df81406 
  tools/marvin/marvin/sandbox/demo/simulator/testcase/libs/base.py 0b5da5c 

Diff: https://reviews.apache.org/r/14333/diff/


Testing
---

tested


Thanks,

SrikanteswaraRao Talluri

RE: [ANNOUNCE] New committer: Rajesh Battala

[Kishan Kavala]

Congratulations Rajesh!

> -Original Message-
> From: Chip Childers [mailto:chip.child...@sungard.com]
> Sent: Tuesday, 24 September 2013 9:00 PM
> To: dev@cloudstack.apache.org
> Subject: [ANNOUNCE] New committer: Rajesh Battala
> 
> The Project Management Committee (PMC) for Apache CloudStack has asked
> Rajesh Battala to become a committer and we are pleased to announce that
> they have accepted.
> 
> Being a committer allows many contributors to contribute more autonomously.
> For developers, it makes it easier to submit changes and eliminates the need 
> to
> have contributions reviewed via the patch submission process. Whether
> contributions are development-related or otherwise, it is a recognition of a
> contributor's participation in the project and commitment to the project and
> the Apache Way.
> 
> Please join me in congratulating Rajesh!
> 
> -chip
> on behalf of the CloudStack PMC

Re: Review Request 13992: (CLOUDSTACK-4405) additional patch for bridge name and firewall rules issues after KVM upgrade to 4.2

[ASF Subversion and Git Services]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/13992/#review26372
---


Commit 164e3e33b414861d4c49457df66dbd7a73830303 in branch refs/heads/disk-cache 
from Wei Zhou
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=164e3e3 ]

CLOUDSTACK-4405: change rpm and debian packaging to support automatic update 
(KVM upgrade)

Including following steps:
b. Run "cloudstack-agent-upgrade". This script will upgrade all the existing 
bridge name to new bridge name, and update related firewall rules.
c. install a libvirt hook:
c1. mkdir /etc/libvirt/hooks
c2. cp /usr/share/cloudstack-agent/lib/libvirtqemuhook 
/etc/libvirt/hooks/qemu
c3. chmod +x /etc/libvirt/hooks/qemu
c4. service libvirtd restart
(cherry picked from commit a0988780ad88bb56becb0a13efedcd79c1bee142)

Signed-off-by: Wei Zhou 


- ASF Subversion and Git Services


On Sept. 9, 2013, 8:09 a.m., Wei Zhou wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/13992/
> ---
> 
> (Updated Sept. 9, 2013, 8:09 a.m.)
> 
> 
> Review request for cloudstack and edison su.
> 
> 
> Bugs: CLOUDSTACK-4405
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> There still exist two issues after Edison's commits.
> (1) Migration from new hosts to old hosts failed.
> The bridge name on old host is set to cloudVirBr* if 
> network.bridge.name.schema is set to 3.0 in 
> /etc/cloudstack/agent/agent.properties, but the actual bridge name is 
> breth*-* after running cloudstack-agent-upgrade.
> 
> (2) all ports of vms (Basic zone, or Advanced zone with security groups) on 
> old hosts are open, because the iptables rules are binding to device (bridge) 
> name which is changed by cloudstack-agent-upgrade.
> 
> 
> Diffs
> -
> 
>   agent/bindir/cloudstack-agent-upgrade.in 4972d39 
>   debian/cloudstack-agent.postinst 499ae6a 
>   debian/rules 5e3d58c 
>   packaging/centos63/cloud.spec 2b814f8 
>   
> plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/BridgeVifDriver.java
>  e3779a7 
>   scripts/vm/network/security_group.py 0ac8b74 
> 
> Diff: https://reviews.apache.org/r/13992/diff/
> 
> 
> Testing
> ---
> 
> tested ok on my environment.
> 
> After this, the KVM upgrade steps :
> a. Install 4.2 cloudstack agent on each kvm host 
> b. Run "cloudstack-agent-upgrade". This script will upgrade all the existing 
> bridge name to new bridge name, and update related firewall rules.
>c. install a libvirt hook:
> c1. mkdir /etc/libvirt/hooks
> c2. cp /usr/share/cloudstack-agent/lib/libvirtqemuhook 
> /etc/libvirt/hooks/qemu
> c3. chmod +x /etc/libvirt/hooks/qemu
> c4. service libvirtd restart
> c5. service cloudstack-agent restart
> 
> 
> Thanks,
> 
> Wei Zhou
> 
>

Review Request 14334: CLOUDSTACK 4705: Fixed domain memory limits test cases

[Gaurav Aradhye]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14334/
---

Review request for cloudstack, sailaja mada and Prasanna Santhanam.


Repository: cloudstack-git


Description
---

Fixed CLOUDSTACK 4705:
Removed attribute error and fixed indentation issues.

Added update_resource_count method to update the resource count after upgrading 
and downgrading the service offering so as to get latest count. Issue was found 
that it was showing old resource count without calling this API.


Diffs
-

  test/integration/component/memory_limits/test_domain_limits.py 479ec0b 

Diff: https://reviews.apache.org/r/14334/diff/


Testing
---


Thanks,

Gaurav Aradhye

Failed to deserialize json object

[Indra Pramana]

Dear all,

During my upgrade attempt from CloudStack 4.1.1 to 4.2.0 earlier this week,
I failed on the step when I need to run the cloudstack-sysvmadm script to
restart the system VMs.

nohup cloudstack-sysvmadm -d IP address -u cloud -p -a > sysvm.log 2>&1 &

When I scrutinize the management server's logs, I saw these error messages
related to the console proxy system VM:


2013-09-24 02:35:37,722 ERROR [agent.transport.Request]
(AgentManager-Handler-4:null) Caught problem with
[{"ConsoleProxyLoadReportCommand":{"_proxyVmId":1903,"_loadInfo":"{\n
\"connections\": []\n}","contextMap":{},"wait":0}}]
com.google.gson.JsonParseException: The JsonDeserializer
com.cloud.agent.transport.ArrayTypeAdaptor@1c74f356 failed to deserialize
json object
[{"ConsoleProxyLoadReportCommand":{"_proxyVmId":1903,"_loadInfo":"{\n
\"connections\": []\n}","contextMap":{},"wait":0}}] given the type class
[Lcom.cloud.agent.api.Command;


More detailed logs can be found on pastebin: http://pastebin.com/EmPF8EMp

Could it be the reason why the cloudstack-sysvmadm script is unable to
restart the system VM?

Looking forward to your reply, thank you.

Cheers.

Re: [PROPOSAL] move away from time-based releases and/or revamp release process

[Daan Hoogland]

So you are willing to spend a hackathon on that in november in Amsterdam?

@Prasanna: can we expect you with your invalued input on this subject there?

I would really feel a lot of people in the community and in Citrix
would sleep better if we have this rolling more smoothly.

On Tue, Sep 24, 2013 at 11:20 PM, Mike Tutkowski
 wrote:
> I think a distributed Jenkins setup would be great.
>
> If we had really awesome test coverage, I would be less frightened of
> last-minute checkins, as well. :)
>
>
> On Tue, Sep 24, 2013 at 3:17 PM, Daan Hoogland wrote:
>
>> Mike, rest assured you and Marcus are not the only ones. More guarantee on
>> a stable master is a general concern. Personally I don't feel we need more
>> control on what is in the next release, if we make unit tests and automated
>> integration tests a priority. That is kind of a claim I do have 'the'
>> solution, though not well cooked ;) It's going to take a while (a colleague
>> said four or five releases) before we have a good enough test set and a
>> smoothly running continuous integration test engine. I think we at least
>> need the distributed Jenkins setup where you can run your own integration
>> tests to make sure your invested logic remains intact. This of course being
>> only part of 'all the' answers.
>>
>> regards,
>>
>>
>> On Tue, Sep 24, 2013 at 9:09 PM, Mike Tutkowski <
>> mike.tutkow...@solidfire.com> wrote:
>>
>> > I was a bit hesitant to keep pushing this because there doesn't seem to
>> be
>> > a lot of support for it, but - as Marcus pointed out - I was quite
>> alarmed
>> > by the number and criticality of bugs checked in right before we cut our
>> > first RC for 4.2. We simply were not ready.
>> >
>> > To me, it felt like something one might do before one gets out a decent
>> > beta release.
>> >
>> > I certainly don't claim to have all the answers for this, but I do think
>> we
>> > need to develop some kind of a process whereby very few changes are made
>> > immediately prior (like a month) to the first cut of a RC. We might even
>> > need to discuss such changes as a community before they get checked in
>> > (after a certain point).
>> >
>> > As far as master not always being usable, this is a serious problem, as
>> > well.
>> >
>> > For example, I've been having trouble getting KVM to work and - in the
>> > meanwhile - my code has fallen out of date with master over the past week
>> > or so. However, I'm always afraid if I update from master while in the
>> > middle of solving one problem that I'll have more problems to deal with
>> > before I can get back to the initial problem (because something didn't
>> work
>> > in master).
>> >
>> > Again, I don't claim to have any solution for this problem, but I am
>> happy
>> > to help brainstorm.
>> >
>> >
>> > On Tue, Sep 24, 2013 at 10:00 AM, Marcus Sorensen > > >wrote:
>> >
>> > > On Mon, Sep 23, 2013 at 1:55 PM, Animesh Chaturvedi
>> > >  wrote:
>> > > >
>> > > >
>> > > >> -Original Message-
>> > > >> From: Marcus Sorensen [mailto:shadow...@gmail.com]
>> > > >> Sent: Monday, September 23, 2013 12:25 PM
>> > > >> To: dev@cloudstack.apache.org
>> > > >> Subject: RE: [PROPOSAL] move away from time-based releases and/or
>> > revamp
>> > > >> release process
>> > > >>
>> > > >> On Sep 23, 2013 1:03 PM, "Animesh Chaturvedi"
>> > > >> 
>> > > >> wrote:
>> > > >> >
>> > > >> >
>> > > >> >
>> > > >> > > -Original Message-
>> > > >> > > From: Marcus Sorensen [mailto:shadow...@gmail.com]
>> > > >> > > Sent: Monday, September 23, 2013 11:38 AM
>> > > >> > > To: dev@cloudstack.apache.org
>> > > >> > > Subject: [PROPOSAL] move away from time-based releases and/or
>> > revamp
>> > > >> > > release process
>> > > >> > >
>> > > >> > > Guys,  I think we are not currently in a state to handle
>> > time-based
>> > > >> > > releases.  Until we can cut master at any time and have it
>> > > >> > > releasable, or at least at a reasonable RC-level matching
>> minimum
>> > > >> > > tested requirements, it's just going to continue to be an
>> exercise
>> > > >> > > in frustration to cut RCs simply because we hit a deadline.
>> > > >> > [Animesh>] David is going to propose Release Criterion up for
>> > > >> > discussion
>> > > >> as per his thread [1]
>> > > >>
>> > > >> I see that thread more about defining what minimum bar we should
>> > always
>> > > >> have master at in order to meet time-based releases. Its where we
>> want
>> > > >> to go, but not what to do in the meantime.
>> > > > [Animesh>] His proposal is not just for master, but also for deciding
>> > > the release exit criterion and IMO is something we should follow for
>> > 4.3.0
>> > > and onwards
>> > >
>> > > Yes, I know. What I meant was that it will be a step toward
>> > > stabilizing master, until we do that I'm not convinced we can adhere
>> > > to any time-based expectation). It still doesn't fix our issue if
>> > > we're going to insist on time-based releases, it just (from my
>> > > undertanding) sets a bar for wh

Re: Review Request 14231: Don't check implementation verion of Object for DatabaseUpgradeChecker

[Daan Hoogland]

I am committing this if we don't get a reasonable explanation why we should
keep checking more then DatabaseUpgradeChecker itself.

rgards,


On Tue, Sep 24, 2013 at 6:26 PM, daan Hoogland wrote:

>This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14231/
>
> engine/schema/src/com/cloud/upgrade/DatabaseUpgradeChecker.java
>  (Diff
> revision 1)
>
> public void check() {
>
>   387
>
> currentVersion = 
> this.getClass().getSuperclass().getPackage().getImplementationVersion();
>
>Could we check for an interface, allowing an ancestor between this and 
> Object to supply the version? your argument makes sense, your solution seems 
> drastic given that womeone took the trouble to write this code.
>
>
> - daan Hoogland
>
> On September 19th, 2013, 5:03 p.m. UTC, Darren Shepherd wrote:
>   Review request for cloudstack, Alex Huang and daan Hoogland.
> By Darren Shepherd.
>
> *Updated Sept. 19, 2013, 5:03 p.m.*
>  *Repository: * cloudstack-git
> Description
>
> Currently DatabaseUpgradeChecker determines the code version by doing 
> this.getClass().getPackage().getImplementationVersion().  If it can't find 
> the version it will eventually just give up and not do the database check.  
> The problem currently is if it doesn't find the version, it will also check 
> its parent's class version.  The parent is java.lang.Object which will return 
> the java version (for example 1.6.0_43).  It doesn't seem like we would 
> really want to ever try the JDK version as our code version, so this patch it 
> to just effectively remove that check.
>
>
>   Diffs
>
>- engine/schema/src/com/cloud/upgrade/DatabaseUpgradeChecker.java
>(f001bf7)
>
> View Diff 
>

Upgrade failed because system VM was created using old template?

[Indra Pramana]

Dear all,

I scrutinized the CloudStack management logs during my failed upgrade
attempt from CloudStack 4.1.1 to 4.2.0 and found this on the log:

===
2013-09-24 02:53:56,029 DEBUG [cloud.storage.VolumeManagerImpl]
(secstorage-1:null) Checking if we need to prepare 1 volumes for
VM[SecondaryStorageVm|s-1979-VM]
2013-09-24 02:53:56,044 DEBUG [storage.image.TemplateDataFactoryImpl]
(secstorage-1:null) template 3 is already in store:27, type:Image
2013-09-24 02:53:56,069 DEBUG [storage.datastore.PrimaryDataStoreImpl]
(secstorage-1:null) Not found (templateId:3poolId:214) in
template_spool_ref, persisting it
2013-09-24 02:53:56,092 DEBUG [storage.image.TemplateDataFactoryImpl]
(secstorage-1:null) template 3 is already in store:214, type:Primary
2013-09-24 02:53:56,095 DEBUG [storage.volume.VolumeServiceImpl]
(secstorage-1:null) Found template routing-3 in storage pool 214 with
VMTemplateStoragePool id: 76
2013-09-24 02:53:56,105 DEBUG [storage.volume.VolumeServiceImpl]
(secstorage-1:null) Acquire lock on VMTemplateStoragePool 76 with timeout
3600 seconds
2013-09-24 02:53:56,113 INFO  [storage.volume.VolumeServiceImpl]
(secstorage-1:null) lock is acquired for VMTemplateStoragePool 76
2013-09-24 02:53:56,141 DEBUG [storage.motion.AncientDataMotionStrategy]
(secstorage-1:null) copyAsync inspecting src type TEMPLATE copyAsync
inspecting dest type TEMPLATE
2013-09-24 02:53:56,168 DEBUG [agent.transport.Request] (secstorage-1:null)
Seq 37-1888026692: Sending  { Cmd , MgmtId: 161342671900, via: 37, Ver: v1,
Flags: 100111, [
{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/3//425b9e5a-fbc7-4637-a33a-fe9d0ed4fa98.qcow2","origUrl":"
http://download.cloud.com/templates/acton/acton-systemvm-02062012.qcow2.bz2
","uuid":"396d8a45-ea18-11e2-8050-6e875929c251","id":3,"format"
:"QCOW2","accountId":1,"checksum":"2755de1f9ef2ce4d6f2bee2efbb4da92","hvm":false,"displayText":"SystemVM
Template
(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
10.237.11.31/mnt/vol1/sec-storage
","_role":"Image"}},"name":"routing-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
http://download.cloud.com/templates/acton/acton-systemvm-02062012.qcow2.bz2","uuid":"396d8a45-ea18-11e2-8050-6e875929c251","id":3,"format":"QCOW2","accountId":1,"checksum":"2755de1f9ef2ce4d6f2bee2efbb4da92","hvm":false,"displayText":"SystemVM
Template
(KVM)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d433809b-01ea-3947-ba0f-48077244e4d6","id":214,"poolType":"RBD","host":"xxx","path":"xxx","port":6789}},"name":"routing-3","hypervisorType":"KVM"}},"executeInSequence":true,"wait":10800}}]
}
===

It seems that after the upgrade, the CloudStack management server tries to
create the system VMs using the old template rather than the new 4.2
template.

I did use the wrong filename when registering the template
(systemvm-kvm-4.2.0 instead of systemvm-kvm-4.2) due to wrong information
given by Abhinav but I have since corrected it prior to the upgrade, by
renaming the template name (rather than deleting the template and
re-register it).

My questions:

1. Do I need to get the template name right when I register the
systemvm-kvm-4.2 template from the beginning, prior to the upgrade?

2. Do I need to delete the old system VM template from the template list,
prior to the upgrade? If yes, I think this should be inside the
documentation.

Looking forward to your reply, thank you.

Cheers.

[Responsiveness report] users 2013w38

[Daan Hoogland]

http://markmail.org/message/wnwwff3iezdr4pbx adding host error:
"ERROR:XENAPI_MISSING_PLUGIN: [ openvswitch-cfg-update ]" by Rafael
Weingartner
http://markmail.org/message/rofqcz6tkjcqkkti Resizing ROOT volumes? by
David Mattison
http://markmail.org/message/qj5cfnenuiuw3myx Xen hypervisor, XCP and
CS - recurring read only file systems on database VM. by Rafael
Weingartner
http://markmail.org/message/anlgqxpqwdhzfsj7 Public Networking
Clarification Request by Gene Cooper

Re: ROOT disk resize

[Antonio Petrocelli]

Hello,

i'm trying to do the call directly to vsphere...

i need help for this call: vSphere Documentation Center 
 
(ExtendVirtualDisk_Task)


I'm unable to pass a correct value for parameter *name.*

I'm trying the call from:

https://myaddress/mob/?moid=virtualDiskManager&method=queryVirtualDiskFragmentation

When i try to insert an URL formatted as manual specs:

   /scheme/:///authority//folder//path/?dcPath=/dcPath/&dsName=/dsName/

result is: INVALID ARGUMENT for NAME

If i give a simple test string like: *test*

*the call is ok with response: *task-4426

but in vsphere i receive this error:

/Extend virtual disk The request refers to an unexpected or unknown type./

Someone know the right way to invoke this request?

Thanks a lot.


Il 19/09/2013 16:07, Marcus Sorensen ha scritto:

Something like this for 4.2... for 4.1 it would be pretty much the
same, just that in 4.1 the code was in StorageManagerImpl.java

iff --git a/server/src/com/cloud/storage/VolumeManagerImpl.java
b/server/src/com/cloud/storage/VolumeManagerImpl.java
index 1d6b44f..4ef57ed 100644
--- a/server/src/com/cloud/storage/VolumeManagerImpl.java
+++ b/server/src/com/cloud/storage/VolumeManagerImpl.java
@@ -1110,17 +1110,12 @@ public class VolumeManagerImpl extends
ManagerBase implements VolumeManager {
  "Volume should be in ready state before
attempting a resize");
  }

-if (!volume.getVolumeType().equals(Volume.Type.DATADISK)) {
-throw new InvalidParameterValueException(
-"Can only resize DATA volumes");
-}
-
  /*
   * figure out whether or not a new disk offering or size parameter is
   * required, get the correct size value
   */
  if (newDiskOffering == null) {
-if (diskOffering.isCustomized()) {
+if (diskOffering.isCustomized() ||
volume.getVolumeType().equals(Volume.Type.ROOT)) {
  newSize = cmd.getSize();

  if (newSize == null) {
@@ -1135,6 +1130,10 @@ public class VolumeManagerImpl extends
ManagerBase implements VolumeManager {
  + " cannot be resized, need to specify a disk
offering");
  }
  } else {
+if (!volume.getVolumeType().equals(Volume.Type.DATADISK)) {
+throw new InvalidParameterValueException(
+"Can only resize DATA volumes via new disk offering");
+}

  if (newDiskOffering.getRemoved() != null
  || !DiskOfferingVO.Type.Disk.equals(newDiskOffering

On Tue, Sep 17, 2013 at 11:02 AM, Marcus Sorensen  wrote:

Yes

On Sep 17, 2013 11:01 AM, "Mike Tutkowski" 
wrote:

Just checking on something.

If you spin up a VM based on an ISO, the ROOT disk size is based on the
selected disk offering, right?


On Tue, Sep 17, 2013 at 6:33 AM, Antonio Petrocelli <
a.petroce...@netsons.com> wrote:


Thanks a lot for reply.

Do you know how change the code?

Il 17/09/2013 14:22, Marcus Sorensen ha scritto:

  You'd need to make minor code changes to remove the check in the code
and

recompile. It should otherwise work, its just that traditionally root
disk
size is based on template size, while data disks are based on disk
offerings. Not everyone wants root resize, e.g. if they are billing
based
on disk offering rather than checking actual vol size.

You could request an enhancement where root resize can be enabled via
config parameter.
On Sep 17, 2013 4:28 AM, "Antonio Petrocelli"

wrote:

Hello,

is there a way to resize the ROOT disk of a vm?

API reply is: *Can only resize DATA volumes*

Does anyone know a method to bypass that control?

Thanks a lot.

Regards.




--
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*


smime.p7s
Description: Firma crittografica S/MIME

RE: Upgrade failed because system VM was created using old template?

[Abhinav Roy]

Hi Indra,

The Json deserialization error is an expected one, after you upgrade. It ll 
keep coming until the new systemvms come up using the new systemvvm template.
All the steps you have executed are correct and you don't need to change those.

As soon as you upgrade and start management server, you will see Json 
deserialization error, that is expected.
After that when you run the cloudstack-sysvmadm command the new systemvms using 
the new templates will come up and you won't see that error anymore.
Are they not coming up even after running cloudstack-sysvmadm command?? Can you 
copy the full management server log somewhere so that I can have a look?

Thanks and regards,
Abhinav

-Original Message-
From: Indra Pramana [mailto:in...@sg.or.id] 
Sent: Wednesday, September 25, 2013 5:11 PM
To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
Subject: Upgrade failed because system VM was created using old template?

Dear all,

I scrutinized the CloudStack management logs during my failed upgrade attempt 
from CloudStack 4.1.1 to 4.2.0 and found this on the log:

===
2013-09-24 02:53:56,029 DEBUG [cloud.storage.VolumeManagerImpl]
(secstorage-1:null) Checking if we need to prepare 1 volumes for 
VM[SecondaryStorageVm|s-1979-VM]
2013-09-24 02:53:56,044 DEBUG [storage.image.TemplateDataFactoryImpl]
(secstorage-1:null) template 3 is already in store:27, type:Image
2013-09-24 02:53:56,069 DEBUG [storage.datastore.PrimaryDataStoreImpl]
(secstorage-1:null) Not found (templateId:3poolId:214) in template_spool_ref, 
persisting it
2013-09-24 02:53:56,092 DEBUG [storage.image.TemplateDataFactoryImpl]
(secstorage-1:null) template 3 is already in store:214, type:Primary
2013-09-24 02:53:56,095 DEBUG [storage.volume.VolumeServiceImpl]
(secstorage-1:null) Found template routing-3 in storage pool 214 with 
VMTemplateStoragePool id: 76
2013-09-24 02:53:56,105 DEBUG [storage.volume.VolumeServiceImpl]
(secstorage-1:null) Acquire lock on VMTemplateStoragePool 76 with timeout
3600 seconds
2013-09-24 02:53:56,113 INFO  [storage.volume.VolumeServiceImpl]
(secstorage-1:null) lock is acquired for VMTemplateStoragePool 76
2013-09-24 02:53:56,141 DEBUG [storage.motion.AncientDataMotionStrategy]
(secstorage-1:null) copyAsync inspecting src type TEMPLATE copyAsync inspecting 
dest type TEMPLATE
2013-09-24 02:53:56,168 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 
37-1888026692: Sending  { Cmd , MgmtId: 161342671900, via: 37, Ver: v1,
Flags: 100111, [
{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/3//425b9e5a-fbc7-4637-a33a-fe9d0ed4fa98.qcow2","origUrl":"
http://download.cloud.com/templates/acton/acton-systemvm-02062012.qcow2.bz2
","uuid":"396d8a45-ea18-11e2-8050-6e875929c251","id":3,"format"
:"QCOW2","accountId":1,"checksum":"2755de1f9ef2ce4d6f2bee2efbb4da92","hvm":false,"displayText":"SystemVM
Template
(KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
10.237.11.31/mnt/vol1/sec-storage
","_role":"Image"}},"name":"routing-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
http://download.cloud.com/templates/acton/acton-systemvm-02062012.qcow2.bz2","uuid":"396d8a45-ea18-11e2-8050-6e875929c251","id":3,"format":"QCOW2","accountId":1,"checksum":"2755de1f9ef2ce4d6f2bee2efbb4da92","hvm":false,"displayText":"SystemVM
Template
(KVM)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d433809b-01ea-3947-ba0f-48077244e4d6","id":214,"poolType":"RBD","host":"xxx","path":"xxx","port":6789}},"name":"routing-3","hypervisorType":"KVM"}},"executeInSequence":true,"wait":10800}}]
}
===

It seems that after the upgrade, the CloudStack management server tries to 
create the system VMs using the old template rather than the new 4.2 template.

I did use the wrong filename when registering the template
(systemvm-kvm-4.2.0 instead of systemvm-kvm-4.2) due to wrong information given 
by Abhinav but I have since corrected it prior to the upgrade, by renaming the 
template name (rather than deleting the template and re-register it).

My questions:

1. Do I need to get the template name right when I register the
systemvm-kvm-4.2 template from the beginning, prior to the upgrade?

2. Do I need to delete the old system VM template from the template list, prior 
to the upgrade? If yes, I think this should be inside the documentation.

Looking forward to your reply, thank you.

Cheers.

Re: Review Request 14231: Don't check implementation verion of Object for DatabaseUpgradeChecker

[daan Hoogland]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14231/#review26373
---

Ship it!


Ship It!

- daan Hoogland


On Sept. 19, 2013, 5:03 p.m., Darren Shepherd wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14231/
> ---
> 
> (Updated Sept. 19, 2013, 5:03 p.m.)
> 
> 
> Review request for cloudstack, Alex Huang and daan Hoogland.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Currently DatabaseUpgradeChecker determines the code version by doing 
> this.getClass().getPackage().getImplementationVersion().  If it can't find 
> the version it will eventually just give up and not do the database check.  
> The problem currently is if it doesn't find the version, it will also check 
> its parent's class version.  The parent is java.lang.Object which will return 
> the java version (for example 1.6.0_43).  It doesn't seem like we would 
> really want to ever try the JDK version as our code version, so this patch it 
> to just effectively remove that check.
>  
> 
> 
> Diffs
> -
> 
>   engine/schema/src/com/cloud/upgrade/DatabaseUpgradeChecker.java f001bf7 
> 
> Diff: https://reviews.apache.org/r/14231/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Darren Shepherd
> 
>

Re: Review Request 14231: Don't check implementation verion of Object for DatabaseUpgradeChecker

[daan Hoogland]

> On Sept. 25, 2013, 12:34 p.m., daan Hoogland wrote:
> > Ship It!

Darren, this one is simple but next time submit a format created with 'git 
format-patch' please!?! I copied the lack of code, because it didn't 'git am' 
to the source.

9fb0a1a61992f93e2105d9a99d507d48a108b0c7 applied


- daan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14231/#review26373
---


On Sept. 19, 2013, 5:03 p.m., Darren Shepherd wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14231/
> ---
> 
> (Updated Sept. 19, 2013, 5:03 p.m.)
> 
> 
> Review request for cloudstack, Alex Huang and daan Hoogland.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Currently DatabaseUpgradeChecker determines the code version by doing 
> this.getClass().getPackage().getImplementationVersion().  If it can't find 
> the version it will eventually just give up and not do the database check.  
> The problem currently is if it doesn't find the version, it will also check 
> its parent's class version.  The parent is java.lang.Object which will return 
> the java version (for example 1.6.0_43).  It doesn't seem like we would 
> really want to ever try the JDK version as our code version, so this patch it 
> to just effectively remove that check.
>  
> 
> 
> Diffs
> -
> 
>   engine/schema/src/com/cloud/upgrade/DatabaseUpgradeChecker.java f001bf7 
> 
> Diff: https://reviews.apache.org/r/14231/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Darren Shepherd
> 
>

Review Request 14335: CLOUDSTACK-4262: Fix TestVPCNetworkGc.test_01_wait_network_gc

[Girish Shilamkar]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14335/
---

Review request for cloudstack, Harikrishna Patnala and venkata swamy babu  
budumuru.


Bugs: CLOUDSTACK-4262


Repository: cloudstack-git


Description
---

As per the test plan, after waiting for network gc
LB rules should be cleared. Added that check instead of router
being in stopped state.


Diffs
-

  test/integration/component/test_vpc_network.py 970a625 

Diff: https://reviews.apache.org/r/14335/diff/


Testing
---


Thanks,

Girish Shilamkar

lb. maxconnections and haproxy.cfg

[Daan Hoogland]

H,

I am trying to hack at the haproxy.cfg and encountered the following obstacle:

if (!serviceProviderMap.containsKey(Service.Lb) &&
lbServiceCapabilityMap != null && !lbServiceCapabilityMap.isEmpty()) {
maxconn = cmd.getMaxconnections();
if (maxconn == null) {

maxconn=Integer.parseInt(_configDao.getValue(Config.NetworkLBHaproxyMaxConn.key()));
}
}

this means that max-concurrent-connections can only be set if no load
balancer functionality is used. this makes no sense to me as the value
is used in haproxy.cfg

Anyone has some background on this for me?

thanks,

Fwd: [PROPOSAL] move away from time-based releases and/or revamp release process

[Mike Tutkowski]

Accidentally just sent this to Daan.

-- Forwarded message --
From: Mike Tutkowski 
Date: Wed, Sep 25, 2013 at 8:34 AM
Subject: Re: [PROPOSAL] move away from time-based releases and/or revamp
release process
To: Daan Hoogland 


I think that would be a really good use of a Hackathon Day at CCC.


On Wed, Sep 25, 2013 at 5:27 AM, Daan Hoogland wrote:

> So you are willing to spend a hackathon on that in november in Amsterdam?
>
> @Prasanna: can we expect you with your invalued input on this subject
> there?
>
> I would really feel a lot of people in the community and in Citrix
> would sleep better if we have this rolling more smoothly.
>
> On Tue, Sep 24, 2013 at 11:20 PM, Mike Tutkowski
>  wrote:
> > I think a distributed Jenkins setup would be great.
> >
> > If we had really awesome test coverage, I would be less frightened of
> > last-minute checkins, as well. :)
> >
> >
> > On Tue, Sep 24, 2013 at 3:17 PM, Daan Hoogland  >wrote:
> >
> >> Mike, rest assured you and Marcus are not the only ones. More guarantee
> on
> >> a stable master is a general concern. Personally I don't feel we need
> more
> >> control on what is in the next release, if we make unit tests and
> automated
> >> integration tests a priority. That is kind of a claim I do have 'the'
> >> solution, though not well cooked ;) It's going to take a while (a
> colleague
> >> said four or five releases) before we have a good enough test set and a
> >> smoothly running continuous integration test engine. I think we at least
> >> need the distributed Jenkins setup where you can run your own
> integration
> >> tests to make sure your invested logic remains intact. This of course
> being
> >> only part of 'all the' answers.
> >>
> >> regards,
> >>
> >>
> >> On Tue, Sep 24, 2013 at 9:09 PM, Mike Tutkowski <
> >> mike.tutkow...@solidfire.com> wrote:
> >>
> >> > I was a bit hesitant to keep pushing this because there doesn't seem
> to
> >> be
> >> > a lot of support for it, but - as Marcus pointed out - I was quite
> >> alarmed
> >> > by the number and criticality of bugs checked in right before we cut
> our
> >> > first RC for 4.2. We simply were not ready.
> >> >
> >> > To me, it felt like something one might do before one gets out a
> decent
> >> > beta release.
> >> >
> >> > I certainly don't claim to have all the answers for this, but I do
> think
> >> we
> >> > need to develop some kind of a process whereby very few changes are
> made
> >> > immediately prior (like a month) to the first cut of a RC. We might
> even
> >> > need to discuss such changes as a community before they get checked in
> >> > (after a certain point).
> >> >
> >> > As far as master not always being usable, this is a serious problem,
> as
> >> > well.
> >> >
> >> > For example, I've been having trouble getting KVM to work and - in the
> >> > meanwhile - my code has fallen out of date with master over the past
> week
> >> > or so. However, I'm always afraid if I update from master while in the
> >> > middle of solving one problem that I'll have more problems to deal
> with
> >> > before I can get back to the initial problem (because something didn't
> >> work
> >> > in master).
> >> >
> >> > Again, I don't claim to have any solution for this problem, but I am
> >> happy
> >> > to help brainstorm.
> >> >
> >> >
> >> > On Tue, Sep 24, 2013 at 10:00 AM, Marcus Sorensen <
> shadow...@gmail.com
> >> > >wrote:
> >> >
> >> > > On Mon, Sep 23, 2013 at 1:55 PM, Animesh Chaturvedi
> >> > >  wrote:
> >> > > >
> >> > > >
> >> > > >> -Original Message-
> >> > > >> From: Marcus Sorensen [mailto:shadow...@gmail.com]
> >> > > >> Sent: Monday, September 23, 2013 12:25 PM
> >> > > >> To: dev@cloudstack.apache.org
> >> > > >> Subject: RE: [PROPOSAL] move away from time-based releases and/or
> >> > revamp
> >> > > >> release process
> >> > > >>
> >> > > >> On Sep 23, 2013 1:03 PM, "Animesh Chaturvedi"
> >> > > >> 
> >> > > >> wrote:
> >> > > >> >
> >> > > >> >
> >> > > >> >
> >> > > >> > > -Original Message-
> >> > > >> > > From: Marcus Sorensen [mailto:shadow...@gmail.com]
> >> > > >> > > Sent: Monday, September 23, 2013 11:38 AM
> >> > > >> > > To: dev@cloudstack.apache.org
> >> > > >> > > Subject: [PROPOSAL] move away from time-based releases and/or
> >> > revamp
> >> > > >> > > release process
> >> > > >> > >
> >> > > >> > > Guys,  I think we are not currently in a state to handle
> >> > time-based
> >> > > >> > > releases.  Until we can cut master at any time and have it
> >> > > >> > > releasable, or at least at a reasonable RC-level matching
> >> minimum
> >> > > >> > > tested requirements, it's just going to continue to be an
> >> exercise
> >> > > >> > > in frustration to cut RCs simply because we hit a deadline.
> >> > > >> > [Animesh>] David is going to propose Release Criterion up for
> >> > > >> > discussion
> >> > > >> as per his thread [1]
> >> > > >>
> >> > > >> I see that thread more about defining what minimum bar we should
> >> > always
> >> > >

Re: [ANNOUNCE] New committer: Rajesh Battala

[Ahmad Emneina]

awesome stuff Rajesh! congrats.


On Wed, Sep 25, 2013 at 2:49 AM, Kishan Kavala wrote:

> Congratulations Rajesh!
>
> > -Original Message-
> > From: Chip Childers [mailto:chip.child...@sungard.com]
> > Sent: Tuesday, 24 September 2013 9:00 PM
> > To: dev@cloudstack.apache.org
> > Subject: [ANNOUNCE] New committer: Rajesh Battala
> >
> > The Project Management Committee (PMC) for Apache CloudStack has asked
> > Rajesh Battala to become a committer and we are pleased to announce that
> > they have accepted.
> >
> > Being a committer allows many contributors to contribute more
> autonomously.
> > For developers, it makes it easier to submit changes and eliminates the
> need to
> > have contributions reviewed via the patch submission process. Whether
> > contributions are development-related or otherwise, it is a recognition
> of a
> > contributor's participation in the project and commitment to the project
> and
> > the Apache Way.
> >
> > Please join me in congratulating Rajesh!
> >
> > -chip
> > on behalf of the CloudStack PMC
>

Re: [ANNOUNCE] New committer: Rajesh Battala

[Ian Duffy]

Congrats Rajesh!

On 25 September 2013 15:45, Ahmad Emneina  wrote:
> awesome stuff Rajesh! congrats.
>
>
> On Wed, Sep 25, 2013 at 2:49 AM, Kishan Kavala 
> wrote:
>
>> Congratulations Rajesh!
>>
>> > -Original Message-
>> > From: Chip Childers [mailto:chip.child...@sungard.com]
>> > Sent: Tuesday, 24 September 2013 9:00 PM
>> > To: dev@cloudstack.apache.org
>> > Subject: [ANNOUNCE] New committer: Rajesh Battala
>> >
>> > The Project Management Committee (PMC) for Apache CloudStack has asked
>> > Rajesh Battala to become a committer and we are pleased to announce that
>> > they have accepted.
>> >
>> > Being a committer allows many contributors to contribute more
>> autonomously.
>> > For developers, it makes it easier to submit changes and eliminates the
>> need to
>> > have contributions reviewed via the patch submission process. Whether
>> > contributions are development-related or otherwise, it is a recognition
>> of a
>> > contributor's participation in the project and commitment to the project
>> and
>> > the Apache Way.
>> >
>> > Please join me in congratulating Rajesh!
>> >
>> > -chip
>> > on behalf of the CloudStack PMC
>>

Get public key contents

[Ian Duffy]

Hi,

I've registered a SSH public key using registerSSHKeyPair.
I'm wanting to retrieve the contents of the public key using an API
call. As far as I can see I is only possible to get its finger print,
is this correct?
If this is true is there any way to derive the original public key
using the fingerprint?

Failing this, is there any place I can attach user specific
metadata/tags? Resource tags looked like a possible solution however
it doesn't appear to support Account or User as a type.
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Resource+Tags

Re: Failed to deserialize json object

[Wido den Hollander]

On 09/25/2013 01:12 PM, Indra Pramana wrote:

Dear all,

During my upgrade attempt from CloudStack 4.1.1 to 4.2.0 earlier this week,
I failed on the step when I need to run the cloudstack-sysvmadm script to
restart the system VMs.

nohup cloudstack-sysvmadm -d IP address -u cloud -p -a > sysvm.log 2>&1 &

When I scrutinize the management server's logs, I saw these error messages
related to the console proxy system VM:


2013-09-24 02:35:37,722 ERROR [agent.transport.Request]
(AgentManager-Handler-4:null) Caught problem with
[{"ConsoleProxyLoadReportCommand":{"_proxyVmId":1903,"_loadInfo":"{\n
\"connections\": []\n}","contextMap":{},"wait":0}}]
com.google.gson.JsonParseException: The JsonDeserializer
com.cloud.agent.transport.ArrayTypeAdaptor@1c74f356 failed to deserialize
json object
[{"ConsoleProxyLoadReportCommand":{"_proxyVmId":1903,"_loadInfo":"{\n
\"connections\": []\n}","contextMap":{},"wait":0}}] given the type class
[Lcom.cloud.agent.api.Command;


More detailed logs can be found on pastebin: http://pastebin.com/EmPF8EMp

Could it be the reason why the cloudstack-sysvmadm script is unable to
restart the system VM?



It is a old SystemVM talking to the management server which isn't 
working due to a protocol change between 4.1 and 4.2


Not sure if that is the reason of you problem, but it could be.

The root cause is however the API change.

Wido


Looking forward to your reply, thank you.

Cheers.

Re: lb. maxconnections and haproxy.cfg

[Abhinandan Prateek]

Yes that condition will mask maxconn ever getting set, fixed.

On 25/09/13 7:26 pm, "Daan Hoogland"  wrote:

>H,
>
>I am trying to hack at the haproxy.cfg and encountered the following
>obstacle:
>
>if (!serviceProviderMap.containsKey(Service.Lb) &&
>lbServiceCapabilityMap != null && !lbServiceCapabilityMap.isEmpty()) {
>maxconn = cmd.getMaxconnections();
>if (maxconn == null) {
>
>maxconn=Integer.parseInt(_configDao.getValue(Config.NetworkLBHaproxyMaxCon
>n.key()));
>}
>}
>
>this means that max-concurrent-connections can only be set if no load
>balancer functionality is used. this makes no sense to me as the value
>is used in haproxy.cfg
>
>Anyone has some background on this for me?
>
>thanks,

Re: Upgrade failed because system VM was created using old template?

[Indra Pramana]

Hi Abhinav,

Good day to you, and thank you for your e-mail.

Noted, thanks for confirming that the json deserialization error is
expected during the upgrade.

The issue that I had was that the cloudstack-sysvmadm command fails to run.
Here is the content of the sysvm.log file after I run the command:

nohup cloudstack-sysvmadm -d 10.237.1.3 -u cloud -p92dhWStn -a > sysvm.log
2>&1 &

===
nohup: ignoring input
/usr/bin/cloudstack-sysvmadm: line 21: /etc/rc.d/init.d/functions: No such
file or directory

Stopping and starting 1 secondary storage vm(s)...
Done stopping and starting secondary storage vm(s)

Stopping and starting 1 console proxy vm(s)...
ERROR: Failed to start console proxy vm with id 1903

Done stopping and starting console proxy vm(s) .

Stopping and starting 2 running routing vm(s)...
ERROR: Failed to restart domainRouter with id 1931

ERROR: Failed to restart domainRouter with id 1930

Done restarting router(s).
===

What could be the reason on why the script fails to restart the CPVM and
the two VRs? It seems to be successfully restarted the SSVM though. But
still, the SSVM was on "Starting" state and never started.

I will upload the management logs and will send the URL to you separately.

Thank you.





On Wed, Sep 25, 2013 at 8:37 PM, Abhinav Roy  wrote:

> Hi Indra,
>
> The Json deserialization error is an expected one, after you upgrade. It
> ll keep coming until the new systemvms come up using the new systemvvm
> template.
> All the steps you have executed are correct and you don't need to change
> those.
>
> As soon as you upgrade and start management server, you will see Json
> deserialization error, that is expected.
> After that when you run the cloudstack-sysvmadm command the new systemvms
> using the new templates will come up and you won't see that error anymore.
> Are they not coming up even after running cloudstack-sysvmadm command??
> Can you copy the full management server log somewhere so that I can have a
> look?
>
> Thanks and regards,
> Abhinav
>
> -Original Message-
> From: Indra Pramana [mailto:in...@sg.or.id]
> Sent: Wednesday, September 25, 2013 5:11 PM
> To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
> Subject: Upgrade failed because system VM was created using old template?
>
> Dear all,
>
> I scrutinized the CloudStack management logs during my failed upgrade
> attempt from CloudStack 4.1.1 to 4.2.0 and found this on the log:
>
> ===
> 2013-09-24 02:53:56,029 DEBUG [cloud.storage.VolumeManagerImpl]
> (secstorage-1:null) Checking if we need to prepare 1 volumes for
> VM[SecondaryStorageVm|s-1979-VM]
> 2013-09-24 02:53:56,044 DEBUG [storage.image.TemplateDataFactoryImpl]
> (secstorage-1:null) template 3 is already in store:27, type:Image
> 2013-09-24 02:53:56,069 DEBUG [storage.datastore.PrimaryDataStoreImpl]
> (secstorage-1:null) Not found (templateId:3poolId:214) in
> template_spool_ref, persisting it
> 2013-09-24 02:53:56,092 DEBUG [storage.image.TemplateDataFactoryImpl]
> (secstorage-1:null) template 3 is already in store:214, type:Primary
> 2013-09-24 02:53:56,095 DEBUG [storage.volume.VolumeServiceImpl]
> (secstorage-1:null) Found template routing-3 in storage pool 214 with
> VMTemplateStoragePool id: 76
> 2013-09-24 02:53:56,105 DEBUG [storage.volume.VolumeServiceImpl]
> (secstorage-1:null) Acquire lock on VMTemplateStoragePool 76 with timeout
> 3600 seconds
> 2013-09-24 02:53:56,113 INFO  [storage.volume.VolumeServiceImpl]
> (secstorage-1:null) lock is acquired for VMTemplateStoragePool 76
> 2013-09-24 02:53:56,141 DEBUG [storage.motion.AncientDataMotionStrategy]
> (secstorage-1:null) copyAsync inspecting src type TEMPLATE copyAsync
> inspecting dest type TEMPLATE
> 2013-09-24 02:53:56,168 DEBUG [agent.transport.Request]
> (secstorage-1:null) Seq 37-1888026692: Sending  { Cmd , MgmtId:
> 161342671900, via: 37, Ver: v1,
> Flags: 100111, [
>
> {"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/3//425b9e5a-fbc7-4637-a33a-fe9d0ed4fa98.qcow2","origUrl":"
> http://download.cloud.com/templates/acton/acton-systemvm-02062012.qcow2.bz2
> ","uuid":"396d8a45-ea18-11e2-8050-6e875929c251","id":3,"format"
>
> :"QCOW2","accountId":1,"checksum":"2755de1f9ef2ce4d6f2bee2efbb4da92","hvm":false,"displayText":"SystemVM
> Template
> (KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
> 10.237.11.31/mnt/vol1/sec-storage
>
> ","_role":"Image"}},"name":"routing-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
> http://download.cloud.com/templates/acton/acton-systemvm-02062012.qcow2.bz2
> ","uuid":"396d8a45-ea18-11e2-8050-6e875929c251","id":3,"format":"QCOW2","accountId":1,"checksum":"2755de1f9ef2ce4d6f2bee2efbb4da92","hvm":false,"displayText":"SystemVM
> Template
>
> (KVM)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d433809b-01ea-3947-ba0f-48077244e4d6","id":214,"

RE: Upgrade failed because system VM was created using old template?

[Abhinav Roy]

Hi Indra,

Which hypervisor are you using?

Thanks and regards,
Abhinav

-Original Message-
From: Indra Pramana [mailto:in...@sg.or.id] 
Sent: Wednesday, September 25, 2013 9:18 PM
To: dev@cloudstack.apache.org
Cc: us...@cloudstack.apache.org
Subject: Re: Upgrade failed because system VM was created using old template?

Hi Abhinav,

Good day to you, and thank you for your e-mail.

Noted, thanks for confirming that the json deserialization error is expected 
during the upgrade.

The issue that I had was that the cloudstack-sysvmadm command fails to run.
Here is the content of the sysvm.log file after I run the command:

nohup cloudstack-sysvmadm -d 10.237.1.3 -u cloud -p92dhWStn -a > sysvm.log
2>&1 &

===
nohup: ignoring input
/usr/bin/cloudstack-sysvmadm: line 21: /etc/rc.d/init.d/functions: No such file 
or directory

Stopping and starting 1 secondary storage vm(s)...
Done stopping and starting secondary storage vm(s)

Stopping and starting 1 console proxy vm(s)...
ERROR: Failed to start console proxy vm with id 1903

Done stopping and starting console proxy vm(s) .

Stopping and starting 2 running routing vm(s)...
ERROR: Failed to restart domainRouter with id 1931

ERROR: Failed to restart domainRouter with id 1930

Done restarting router(s).
===

What could be the reason on why the script fails to restart the CPVM and the 
two VRs? It seems to be successfully restarted the SSVM though. But still, the 
SSVM was on "Starting" state and never started.

I will upload the management logs and will send the URL to you separately.

Thank you.





On Wed, Sep 25, 2013 at 8:37 PM, Abhinav Roy  wrote:

> Hi Indra,
>
> The Json deserialization error is an expected one, after you upgrade. 
> It ll keep coming until the new systemvms come up using the new 
> systemvvm template.
> All the steps you have executed are correct and you don't need to 
> change those.
>
> As soon as you upgrade and start management server, you will see Json 
> deserialization error, that is expected.
> After that when you run the cloudstack-sysvmadm command the new 
> systemvms using the new templates will come up and you won't see that error 
> anymore.
> Are they not coming up even after running cloudstack-sysvmadm command??
> Can you copy the full management server log somewhere so that I can 
> have a look?
>
> Thanks and regards,
> Abhinav
>
> -Original Message-
> From: Indra Pramana [mailto:in...@sg.or.id]
> Sent: Wednesday, September 25, 2013 5:11 PM
> To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
> Subject: Upgrade failed because system VM was created using old template?
>
> Dear all,
>
> I scrutinized the CloudStack management logs during my failed upgrade 
> attempt from CloudStack 4.1.1 to 4.2.0 and found this on the log:
>
> ===
> 2013-09-24 02:53:56,029 DEBUG [cloud.storage.VolumeManagerImpl]
> (secstorage-1:null) Checking if we need to prepare 1 volumes for 
> VM[SecondaryStorageVm|s-1979-VM]
> 2013-09-24 02:53:56,044 DEBUG [storage.image.TemplateDataFactoryImpl]
> (secstorage-1:null) template 3 is already in store:27, type:Image
> 2013-09-24 02:53:56,069 DEBUG [storage.datastore.PrimaryDataStoreImpl]
> (secstorage-1:null) Not found (templateId:3poolId:214) in 
> template_spool_ref, persisting it
> 2013-09-24 02:53:56,092 DEBUG [storage.image.TemplateDataFactoryImpl]
> (secstorage-1:null) template 3 is already in store:214, type:Primary
> 2013-09-24 02:53:56,095 DEBUG [storage.volume.VolumeServiceImpl]
> (secstorage-1:null) Found template routing-3 in storage pool 214 with 
> VMTemplateStoragePool id: 76
> 2013-09-24 02:53:56,105 DEBUG [storage.volume.VolumeServiceImpl]
> (secstorage-1:null) Acquire lock on VMTemplateStoragePool 76 with 
> timeout
> 3600 seconds
> 2013-09-24 02:53:56,113 INFO  [storage.volume.VolumeServiceImpl]
> (secstorage-1:null) lock is acquired for VMTemplateStoragePool 76
> 2013-09-24 02:53:56,141 DEBUG 
> [storage.motion.AncientDataMotionStrategy]
> (secstorage-1:null) copyAsync inspecting src type TEMPLATE copyAsync 
> inspecting dest type TEMPLATE
> 2013-09-24 02:53:56,168 DEBUG [agent.transport.Request]
> (secstorage-1:null) Seq 37-1888026692: Sending  { Cmd , MgmtId:
> 161342671900, via: 37, Ver: v1,
> Flags: 100111, [
>
> {"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/3//425b9e5a-fbc7-4637-a33a-fe9d0ed4fa98.qcow2","origUrl":"
> http://download.cloud.com/templates/acton/acton-systemvm-02062012.qcow
> 2.bz2 ","uuid":"396d8a45-ea18-11e2-8050-6e875929c251","id":3,"format"
>
> :"QCOW2","accountId":1,"checksum":"2755de1f9ef2ce4d6f2bee2efbb4da92","
> hvm":false,"displayText":"SystemVM
> Template
> (KVM)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs:/
> /
> 10.237.11.31/mnt/vol1/sec-storage
>
> ","_role":"Image"}},"name":"routing-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
> http://download.cloud.com/templates/

Re: Review Request 14231: Don't check implementation verion of Object for DatabaseUpgradeChecker

[Darren Shepherd]

> On Sept. 25, 2013, 12:34 p.m., daan Hoogland wrote:
> > Ship It!
> 
> daan Hoogland wrote:
> Darren, this one is simple but next time submit a format created with 
> 'git format-patch' please!?! I copied the lack of code, because it didn't 
> 'git am' to the source.
> 
> 9fb0a1a61992f93e2105d9a99d507d48a108b0c7 applied

yeah, sorry.  A lot of patches I have pending aren't made with format-patch.  
Will do for future.  You just need to do "git apply --index " to apply a 
plain old patch.  And then commit


- Darren


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14231/#review26373
---


On Sept. 19, 2013, 5:03 p.m., Darren Shepherd wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14231/
> ---
> 
> (Updated Sept. 19, 2013, 5:03 p.m.)
> 
> 
> Review request for cloudstack, Alex Huang and daan Hoogland.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Currently DatabaseUpgradeChecker determines the code version by doing 
> this.getClass().getPackage().getImplementationVersion().  If it can't find 
> the version it will eventually just give up and not do the database check.  
> The problem currently is if it doesn't find the version, it will also check 
> its parent's class version.  The parent is java.lang.Object which will return 
> the java version (for example 1.6.0_43).  It doesn't seem like we would 
> really want to ever try the JDK version as our code version, so this patch it 
> to just effectively remove that check.
>  
> 
> 
> Diffs
> -
> 
>   engine/schema/src/com/cloud/upgrade/DatabaseUpgradeChecker.java f001bf7 
> 
> Diff: https://reviews.apache.org/r/14231/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Darren Shepherd
> 
>

Re: lb. maxconnections and haproxy.cfg

[Bharat Kumar]

Hi Daan you are correct. 

this check !serviceProviderMap should not be there. I think  i introduced this 
error while 
merging this fix. 

This is Fixed now.


Regards,
Bharat.




On Sep 25, 2013, at 7:26 PM, Daan Hoogland  wrote:

> H,
> 
> I am trying to hack at the haproxy.cfg and encountered the following obstacle:
> 
>if (!serviceProviderMap.containsKey(Service.Lb) &&
> lbServiceCapabilityMap != null && !lbServiceCapabilityMap.isEmpty()) {
>maxconn = cmd.getMaxconnections();
>if (maxconn == null) {
> 
> maxconn=Integer.parseInt(_configDao.getValue(Config.NetworkLBHaproxyMaxConn.key()));
>}
>}
> 
> this means that max-concurrent-connections can only be set if no load
> balancer functionality is used. this makes no sense to me as the value
> is used in haproxy.cfg
> 
> Anyone has some background on this for me?
> 
> thanks,

Re: Upgrade failed because system VM was created using old template?

[Indra Pramana]

Hi Abhinav,

We are using KVM.

Thank you.

RE: Upgrade failed because system VM was created using old template?

[Abhinav Roy]

Hi Indra,

Can you check in your KVM host whether the ssvm and cpvm are created or not?
try " virsh list " and see if the vms are there? Is it a Rhel host or Ubuntu 
host??
Also, check what is the entry in /etc/cloudstack/agent/agent.properties file 
for the "resource" parameter. 

Thanks and regards,
Abhinav

-Original Message-
From: Indra Pramana [mailto:in...@sg.or.id] 
Sent: Wednesday, September 25, 2013 9:32 PM
To: us...@cloudstack.apache.org
Cc: dev@cloudstack.apache.org
Subject: Re: Upgrade failed because system VM was created using old template?

Hi Abhinav,

We are using KVM.

Thank you.

[PROPOSAL] Service monitoring tool in virtual router

[Jayapal Reddy Uradi]

Hi,

Currently in virtual router there is no way to recover and notify if some 
service goes down unexpectedly.

This feature is about monitoring all the services rendered by the virtual 
router, ensure that the services are running through the life time of the VR.

On service failure:
1. Generate an alert and event indicating failure
2. Restart the service

Services to be monitored:
DHCP, DNS, haproxy, password server etc.

As part of monitoring there are two activities

1. One is monitoring the services in VR and log the events. Using monit for 
monitoring services
2. Second part is pushing alerts from router to  MS server. Thinking on POST 
the logs to web server in MS.

I will be updating more details and FS in this thread.

I created enhancement bug for this.
https://issues.apache.org/jira/browse/CLOUDSTACK-4736

Thanks,
Jayapal

4.2 rpm nonoss

[Larry Hernandez]

Does the http://cloudstack.apt-get.eu/rhel/4.2/ repo have nonoss built is
like 4.1?

-Larry

Re: Upgrade failed because system VM was created using old template?

[Indra Pramana]

Hi Abhinav,

Good day to you, and thank you for your e-mail reply.

If I remember correctly, at that time when I check the KVM hosts directly
by using "virsh list --all", the ssvm and cpvm are listed there and the
status is running. However, I can't SSH to the local link address.

It is a Ubuntu host.

Content of resource parameter under /etc/cloudstack/agent/agent.properties:

resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource

Thank you.


On Thu, Sep 26, 2013 at 12:19 AM, Abhinav Roy wrote:

> Hi Indra,
>
> Can you check in your KVM host whether the ssvm and cpvm are created or
> not?
> try " virsh list " and see if the vms are there? Is it a Rhel host or
> Ubuntu host??
> Also, check what is the entry in /etc/cloudstack/agent/agent.properties
> file for the "resource" parameter.
>
> Thanks and regards,
> Abhinav
>
> -Original Message-
> From: Indra Pramana [mailto:in...@sg.or.id]
> Sent: Wednesday, September 25, 2013 9:32 PM
> To: us...@cloudstack.apache.org
> Cc: dev@cloudstack.apache.org
> Subject: Re: Upgrade failed because system VM was created using old
> template?
>
> Hi Abhinav,
>
> We are using KVM.
>
> Thank you.
>

Re: 4.2 rpm nonoss

[Chip Childers]

On Wed, Sep 25, 2013 at 12:49 PM, Larry Hernandez wrote:

> Does the http://cloudstack.apt-get.eu/rhel/4.2/ repo have nonoss built is
> like 4.1?
>
> -Larry
>

David typically includes nonoss in the RPMs, and he's the one that loaded
them up there.  I would expect that they do.

Re: [PROPOSAL] Service monitoring tool in virtual router

[Chip Childers]

On Wed, Sep 25, 2013 at 04:30:33PM +, Jayapal Reddy Uradi wrote:
> Hi,
> 
> Currently in virtual router there is no way to recover and notify if some 
> service goes down unexpectedly.
> 
> This feature is about monitoring all the services rendered by the virtual 
> router, ensure that the services are running through the life time of the VR.
> 
> On service failure:
> 1. Generate an alert and event indicating failure
> 2. Restart the service
> 
> Services to be monitored:
> DHCP, DNS, haproxy, password server etc.
> 
> As part of monitoring there are two activities
> 
> 1. One is monitoring the services in VR and log the events. Using monit for 
> monitoring services
> 2. Second part is pushing alerts from router to  MS server. Thinking on POST 
> the logs to web server in MS.
> 
> I will be updating more details and FS in this thread.
> 
> I created enhancement bug for this.
> https://issues.apache.org/jira/browse/CLOUDSTACK-4736
> 
> Thanks,
> Jayapal

Generally sounds like a very good idea Jayapal!  Looking forward to
seeing the FS.

Re: Review Request 14325: Contrail network virtualization plugin.

[Chip Childers]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14325/#review26378
---


Please do not commit this yet, until we bring it through the IP clearance 
process.

- Chip Childers


On Sept. 24, 2013, 11:38 p.m., Pedro Marques wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14325/
> ---
> 
> (Updated Sept. 24, 2013, 11:38 p.m.)
> 
> 
> Review request for cloudstack.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Plugin for contrail virtual network controller.
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Contrail+network+plugin
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/network/Network.java 49f380b 
>   client/pom.xml 119c96e 
>   client/tomcatconf/applicationContext.xml.in 9b6636a 
>   client/tomcatconf/commands.properties.in 58c770d 
>   client/tomcatconf/componentContext.xml.in 315c95b 
>   
> plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
>  6b81c25 
>   plugins/network-elements/juniper-contrail/pom.xml PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/api/command/CreateServiceInstanceCmd.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/api/response/ServiceInstanceResponse.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ContrailElement.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ContrailElementImpl.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ContrailGuru.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ContrailManager.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ContrailManagerImpl.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/DBSyncGeneric.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/EventUtils.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ManagementNetworkGuru.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ModelDatabase.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServerDBSync.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServerDBSyncImpl.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServerEventHandler.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServerEventHandlerImpl.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServiceManager.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServiceManagerImpl.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServiceVirtualMachine.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/FloatingIpModel.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/FloatingIpPoolModel.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/InstanceIpModel.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/ModelController.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/ModelObject.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/ModelObjectBase.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/ServiceInstanceModel.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/VMInterfaceModel.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/VirtualMachineModel.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/VirtualNetworkModel.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/test/net/juniper/contrail/management/MockAccountManager.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/test/net/juniper/contrail/management/Net

Re: Review Request 14325: Contrail network virtualization plugin.

[Chip Childers]

Pedro,

Thanks for posting this!

Here's the process that we'll need to follow:

I'm going to call a vote to accept this donation to the project on
this list.

Concurrent with that, we need the appropriate legal representatives from
Juniper to complete the Software Grant contract for the donation [1].
I'll follow up on this directly with you, cc'ing the PMC private ML so
that any legal work is done on that thread.

Once we have the legal doc in hand, and the project voted to accept the
donation, I have a brief (3 day) notice period to the incubator project
that I'll have to handle.

As I've stated previously, I believe that we should take discussion of
the technical aspects of this contribution into a discussion of when /
if to merge into master *after* we have accepted the donation.

Expect to see the VOTE and legal discussion threads start in a few
minutes.

[1] http://www.apache.org/licenses/software-grant.txt

On Tue, Sep 24, 2013 at 11:38:07PM +, Pedro Marques wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14325/
> ---
> 
> Review request for cloudstack.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Plugin for contrail virtual network controller.
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Contrail+network+plugin
> 
> 
> Diffs
> -
> 
>   api/src/com/cloud/network/Network.java 49f380b 
>   client/pom.xml 119c96e 
>   client/tomcatconf/applicationContext.xml.in 9b6636a 
>   client/tomcatconf/commands.properties.in 58c770d 
>   client/tomcatconf/componentContext.xml.in 315c95b 
>   
> plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
>  6b81c25 
>   plugins/network-elements/juniper-contrail/pom.xml PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/api/command/CreateServiceInstanceCmd.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/api/response/ServiceInstanceResponse.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ContrailElement.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ContrailElementImpl.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ContrailGuru.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ContrailManager.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ContrailManagerImpl.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/DBSyncGeneric.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/EventUtils.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ManagementNetworkGuru.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ModelDatabase.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServerDBSync.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServerDBSyncImpl.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServerEventHandler.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServerEventHandlerImpl.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServiceManager.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServiceManagerImpl.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/management/ServiceVirtualMachine.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/FloatingIpModel.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/FloatingIpPoolModel.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/InstanceIpModel.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/ModelController.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/ModelObject.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/ModelObjectBase.java
>  PRE-CREATION 
>   
> plugins/network-elements/juniper-contrail/src/net/juniper/contrail/model/ServiceInstanceModel.java
>  PRE-CREATION 
>   
> plugins/netw

[VOTE] Accept the donation of a Contrail plugin into Apache CloudStack

[Chip Childers]

Hi all!

As stated in other threads, Juniper is proposing the donation of a
Contrail plugin to Apache CloudStack.  The code itself has been posted
to reviewboard [1].  The design has been documented by Pedro [2].

[1] https://reviews.apache.org/r/14325/
[2] 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Contrail+network+plugin

I'm calling a vote here, so that we have a formal consensus on accepting
the code into the project.  As I've suggested earlier, I'd like us to
accept the code into a branch, and then work through any technical
concerns / reviews / changes prior to a master branch merge.

So...  voting will end in ~72 hours.  As this is a technical decision,
committer and PMC votes are binding.

-chip


Votes please!

[ ] +1 - Accept the donation
[ ] +/-0 - No strong opinion
[ ] -1 - Do not accept the donation

Re: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth round)

[Chip Childers]

On Tue, Sep 24, 2013 at 07:12:15PM +, Animesh Chaturvedi wrote:
> > I can do this, but it may be tomorrow before it gets done.
> [Animesh>] I updated the RN yesterday. David what needs to be done to publish 
> to cloudstack.apache.org/docs

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Releasing+Docs

Animesh, are you able to take this?

RE: [PROPOSAL] move away from time-based releases and/or revamp release process

[Musayev, Ilya]

We can still use scheduled release as we do now and yet have some agility.

An idea was passed around before if we can modularize ACS in future releases VS 
being it monolithic.

We can still have a core as is, but additional components/plugins can be loaded 
adhoc pm the need base. As an example, there is no need to bake in vmware 
support into release if a customer has not need for it. You cant just upgrade 
vmware code unless you upgrade from version X.y.1 to X.y.2. 

Same applies to all other "plugins", that are not truly pluggable.

Splitting components as separate "plugins" (or whatever the proper term is) 
would ease the release cycle and give us flexibility in my opinion.




> -Original Message-
> From: Daan Hoogland [mailto:daan.hoogl...@gmail.com]
> Sent: Tuesday, September 24, 2013 12:22 PM
> To: dev
> Subject: Re: [PROPOSAL] move away from time-based releases and/or
> revamp release process
> 
> is this work a workshop to get at least a core group of us in line. We all 
> have
> ideas and a lot of good ones are buried under an ton weighing archive of
> mails.
> 
> Daan
> 
> On Tue, Sep 24, 2013 at 6:06 PM, Chip Childers 
> wrote:
> > On Tue, Sep 24, 2013 at 10:00:32AM -0600, Marcus Sorensen wrote:
> >> I guess I'm in the minority though, since we're the only ones
> >> discussing it.
> >
> > No you are not.  Personally, I'm thinking about this problem a bit
> > before adding my 2 cents.  Don't take that silence as thinking we are
> > "ok".
> >
> > Short version of my thoughts:
> >
> > 1 - a schedule is really important to a project like this
> > 2 - not releasing crap quality is really really important to a project
> > like this
> >
> > Note the "really" vs. "really really".
> >
> > -chip

instance metadata

[Sebastien Goasguen]

Hi,

In EC2 every instance has metadata that it can retrieve from:
http://169.254.169.254/latest/meta-data/

Do we have something like this ? maybe via the vrouter ?

-Sebastien

Re: instance metadata

[Marcus Sorensen]

Yes
On Sep 25, 2013 1:20 PM, "Sebastien Goasguen"  wrote:

> Hi,
>
> In EC2 every instance has metadata that it can retrieve from:
> http://169.254.169.254/latest/meta-data/
>
> Do we have something like this ? maybe via the vrouter ?
>
> -Sebastien
>

Re: instance metadata

[Chip Childers]

On Wed, Sep 25, 2013 at 03:19:51PM -0400, Sebastien Goasguen wrote:
> Hi,
> 
> In EC2 every instance has metadata that it can retrieve from:
> http://169.254.169.254/latest/meta-data/
> 
> Do we have something like this ? maybe via the vrouter ?
> 
> -Sebastien
>

IIRC, we only do the userdata

Re: instance metadata

[Chip Childers]

On Wed, Sep 25, 2013 at 3:22 PM, Marcus Sorensen wrote:

> Yes
>

then I'm wrong!  hey marcus - do you know if it's documented somewhere?

Re: instance metadata

[Chip Childers]

/me learns to use google.

http://lmgtfy.com/?q=cloudstack+instance+metadata

leads to

http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Admin_Guide/user-data-and-meta-data.html


On Wed, Sep 25, 2013 at 3:24 PM, Chip Childers wrote:

> On Wed, Sep 25, 2013 at 3:22 PM, Marcus Sorensen wrote:
>
>> Yes
>>
>
> then I'm wrong!  hey marcus - do you know if it's documented somewhere?
>
>

Re: instance metadata

[Sebastien Goasguen]

On Sep 25, 2013, at 3:25 PM, Chip Childers  wrote:

> /me learns to use google.
> 

me too :(

thanks.


> http://lmgtfy.com/?q=cloudstack+instance+metadata
> 
> leads to
> 
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Admin_Guide/user-data-and-meta-data.html
> 
> 
> On Wed, Sep 25, 2013 at 3:24 PM, Chip Childers 
> wrote:
> 
>> On Wed, Sep 25, 2013 at 3:22 PM, Marcus Sorensen wrote:
>> 
>>> Yes
>>> 
>> 
>> then I'm wrong!  hey marcus - do you know if it's documented somewhere?
>> 
>> 

LocalHostEndPoint seems to get called

[Darren Shepherd]

While I'm doing development and restarting things and what not, it
seems often storage commands get routed to LocalHostEndPoint.  This
seems bad.  I don't have sudo setup for my user on my laptop, so
things like "Unable to create local folder for:
/mnt/secStorage/64d6e26f-e656-3ba3-908f-ce6610ede011 in order to mount
nfs://192.168.3.134:/exports/secondary1" fail.  But the bigger problem
is, shouldn't that not happen at all.  It seems like in a normal setup
it should never try to use LocalHostEndpoint.  Do I have some setting
flipped that is enabling that?

Seems like with the current code you might accidentally mount
secondary to the management server if the conditions are right...

Darren

Re: instance metadata

[Marcus Sorensen]

Sorry, I was on my phone and simply wanted to confirm. I didn't have
the link handy.

On Wed, Sep 25, 2013 at 1:30 PM, Sebastien Goasguen  wrote:
>
> On Sep 25, 2013, at 3:25 PM, Chip Childers  wrote:
>
>> /me learns to use google.
>>
>
> me too :(
>
> thanks.
>
>
>> http://lmgtfy.com/?q=cloudstack+instance+metadata
>>
>> leads to
>>
>> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Admin_Guide/user-data-and-meta-data.html
>>
>>
>> On Wed, Sep 25, 2013 at 3:24 PM, Chip Childers 
>> wrote:
>>
>>> On Wed, Sep 25, 2013 at 3:22 PM, Marcus Sorensen wrote:
>>>
 Yes

>>>
>>> then I'm wrong!  hey marcus - do you know if it's documented somewhere?
>>>
>>>
>

bug? capacity not updated when adding memory to hypervisor

[Darren Shepherd]

I added more memory to a hypervisor, and the host tables was updated
properly, but the op_host_capacity is not updated.  I tracked down the
code to CapacityManagerImpl.updateCapacityForHost.  The below logic
seems completely wrong.  Unless I'm reading it wrong, it seems like it
will only update EITHER used or reserved (not both) and never update
total.  I removed log statements to make it more readable.

if (cpuCap.getUsedCapacity() == usedCpu &&
cpuCap.getReservedCapacity() == reservedCpu) {
} else if (cpuCap.getReservedCapacity() != reservedCpu) {
cpuCap.setReservedCapacity(reservedCpu);
} else if (cpuCap.getUsedCapacity() != usedCpu) {
cpuCap.setUsedCapacity(usedCpu);
}

if (memCap.getUsedCapacity() == usedMemory &&
memCap.getReservedCapacity() == reservedMemory) {
} else if (memCap.getReservedCapacity() != reservedMemory) {
memCap.setReservedCapacity(reservedMemory);
} else if (memCap.getUsedCapacity() != usedMemory) {
memCap.setUsedCapacity(usedMemory);
}

Re: [VOTE] Accept the donation of a Contrail plugin into Apache CloudStack

[Daan Hoogland]

I like, but let's add a lot of unit tests before merging in master. It has
some tests, but in comparison to the amount of code it does not suffice. I
guess that is a +1 binding if I understand the bylaws.


On Wed, Sep 25, 2013 at 7:13 PM, Chip Childers wrote:

> Hi all!
>
> As stated in other threads, Juniper is proposing the donation of a
> Contrail plugin to Apache CloudStack.  The code itself has been posted
> to reviewboard [1].  The design has been documented by Pedro [2].
>
> [1] https://reviews.apache.org/r/14325/
> [2]
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Contrail+network+plugin
>
> I'm calling a vote here, so that we have a formal consensus on accepting
> the code into the project.  As I've suggested earlier, I'd like us to
> accept the code into a branch, and then work through any technical
> concerns / reviews / changes prior to a master branch merge.
>
> So...  voting will end in ~72 hours.  As this is a technical decision,
> committer and PMC votes are binding.
>
> -chip
>
>
> Votes please!
>
> [ ] +1 - Accept the donation
> [ ] +/-0 - No strong opinion
> [ ] -1 - Do not accept the donation
>

Re: bug? capacity not updated when adding memory to hypervisor

[Daan Hoogland]

I agree Darren,

if (cpuCap.getUsedCapacity() == usedCpu &&
cpuCap.getReservedCapacity() == reservedCpu) {
} else {
   if (cpuCap.getReservedCapacity() != reservedCpu) {
cpuCap.setReservedCapacity(reservedCpu);
   }
   if (cpuCap.getUsedCapacity() != usedCpu) {
cpuCap.setUsedCapacity(usedCpu);
}
}

makes more sense. (same for mem)


On Wed, Sep 25, 2013 at 9:59 PM, Darren Shepherd <
darren.s.sheph...@gmail.com> wrote:

> I added more memory to a hypervisor, and the host tables was updated
> properly, but the op_host_capacity is not updated.  I tracked down the
> code to CapacityManagerImpl.updateCapacityForHost.  The below logic
> seems completely wrong.  Unless I'm reading it wrong, it seems like it
> will only update EITHER used or reserved (not both) and never update
> total.  I removed log statements to make it more readable.
>
> if (cpuCap.getUsedCapacity() == usedCpu &&
> cpuCap.getReservedCapacity() == reservedCpu) {
> } else if (cpuCap.getReservedCapacity() != reservedCpu) {
> cpuCap.setReservedCapacity(reservedCpu);
> } else if (cpuCap.getUsedCapacity() != usedCpu) {
> cpuCap.setUsedCapacity(usedCpu);
> }
>
> if (memCap.getUsedCapacity() == usedMemory &&
> memCap.getReservedCapacity() == reservedMemory) {
> } else if (memCap.getReservedCapacity() != reservedMemory) {
> memCap.setReservedCapacity(reservedMemory);
> } else if (memCap.getUsedCapacity() != usedMemory) {
> memCap.setUsedCapacity(usedMemory);
> }
>

RE: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth round)

[Animesh Chaturvedi]

> -Original Message-
> From: Chip Childers [mailto:chip.child...@sungard.com]
> Sent: Wednesday, September 25, 2013 10:22 AM
> To: dev@cloudstack.apache.org
> Cc: David Nalley
> Subject: Re: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth
> round)
> 
> On Tue, Sep 24, 2013 at 07:12:15PM +, Animesh Chaturvedi wrote:
> > > I can do this, but it may be tomorrow before it gets done.
> > [Animesh>] I updated the RN yesterday. David what needs to be done to
> publish to cloudstack.apache.org/docs
> 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Releasing+Docs
> 
> Animesh, are you able to take this?
[Animesh>] I don't have publican installed. Will give it a try and let you know 
if I run into issues. 

Re: bug? capacity not updated when adding memory to hypervisor

[Darren Shepherd]

The main bug being the lack of memCap.setTotalCapacity(host.getTotalMemory());

Darren

On Wed, Sep 25, 2013 at 1:13 PM, Daan Hoogland  wrote:
> I agree Darren,
>
> if (cpuCap.getUsedCapacity() == usedCpu &&
> cpuCap.getReservedCapacity() == reservedCpu) {
> } else {
>if (cpuCap.getReservedCapacity() != reservedCpu) {
> cpuCap.setReservedCapacity(reservedCpu);
>}
>if (cpuCap.getUsedCapacity() != usedCpu) {
> cpuCap.setUsedCapacity(usedCpu);
> }
> }
>
> makes more sense. (same for mem)
>
>
> On Wed, Sep 25, 2013 at 9:59 PM, Darren Shepherd <
> darren.s.sheph...@gmail.com> wrote:
>
>> I added more memory to a hypervisor, and the host tables was updated
>> properly, but the op_host_capacity is not updated.  I tracked down the
>> code to CapacityManagerImpl.updateCapacityForHost.  The below logic
>> seems completely wrong.  Unless I'm reading it wrong, it seems like it
>> will only update EITHER used or reserved (not both) and never update
>> total.  I removed log statements to make it more readable.
>>
>> if (cpuCap.getUsedCapacity() == usedCpu &&
>> cpuCap.getReservedCapacity() == reservedCpu) {
>> } else if (cpuCap.getReservedCapacity() != reservedCpu) {
>> cpuCap.setReservedCapacity(reservedCpu);
>> } else if (cpuCap.getUsedCapacity() != usedCpu) {
>> cpuCap.setUsedCapacity(usedCpu);
>> }
>>
>> if (memCap.getUsedCapacity() == usedMemory &&
>> memCap.getReservedCapacity() == reservedMemory) {
>> } else if (memCap.getReservedCapacity() != reservedMemory) {
>> memCap.setReservedCapacity(reservedMemory);
>> } else if (memCap.getUsedCapacity() != usedMemory) {
>> memCap.setUsedCapacity(usedMemory);
>> }
>>

Re: bug? capacity not updated when adding memory to hypervisor

[Daan Hoogland]

That would not seem in place in one of these blocks altogether, would it?


On Wed, Sep 25, 2013 at 10:45 PM, Darren Shepherd <
darren.s.sheph...@gmail.com> wrote:

> The main bug being the lack of
> memCap.setTotalCapacity(host.getTotalMemory());
>
> Darren
>
> On Wed, Sep 25, 2013 at 1:13 PM, Daan Hoogland 
> wrote:
> > I agree Darren,
> >
> > if (cpuCap.getUsedCapacity() == usedCpu &&
> > cpuCap.getReservedCapacity() == reservedCpu) {
> > } else {
> >if (cpuCap.getReservedCapacity() != reservedCpu) {
> > cpuCap.setReservedCapacity(reservedCpu);
> >}
> >if (cpuCap.getUsedCapacity() != usedCpu) {
> > cpuCap.setUsedCapacity(usedCpu);
> > }
> > }
> >
> > makes more sense. (same for mem)
> >
> >
> > On Wed, Sep 25, 2013 at 9:59 PM, Darren Shepherd <
> > darren.s.sheph...@gmail.com> wrote:
> >
> >> I added more memory to a hypervisor, and the host tables was updated
> >> properly, but the op_host_capacity is not updated.  I tracked down the
> >> code to CapacityManagerImpl.updateCapacityForHost.  The below logic
> >> seems completely wrong.  Unless I'm reading it wrong, it seems like it
> >> will only update EITHER used or reserved (not both) and never update
> >> total.  I removed log statements to make it more readable.
> >>
> >> if (cpuCap.getUsedCapacity() == usedCpu &&
> >> cpuCap.getReservedCapacity() == reservedCpu) {
> >> } else if (cpuCap.getReservedCapacity() != reservedCpu) {
> >> cpuCap.setReservedCapacity(reservedCpu);
> >> } else if (cpuCap.getUsedCapacity() != usedCpu) {
> >> cpuCap.setUsedCapacity(usedCpu);
> >> }
> >>
> >> if (memCap.getUsedCapacity() == usedMemory &&
> >> memCap.getReservedCapacity() == reservedMemory) {
> >> } else if (memCap.getReservedCapacity() != reservedMemory) {
> >> memCap.setReservedCapacity(reservedMemory);
> >> } else if (memCap.getUsedCapacity() != usedMemory) {
> >> memCap.setUsedCapacity(usedMemory);
> >> }
> >>
>

Re: Review Request 11981: Adding base support for NVP security groups to the NVP API

[Animesh Chaturvedi]

> On June 20, 2013, 6:40 a.m., Prasanna Santhanam wrote:
> > Minor nitpick : our code conventions recommend the method naming to not use 
> > underscore. so it's lowerCaseAndNoUnderscores()
> > 
> > http://cloudstack.apache.org/develop/coding-conventions.html

Hugo can you review this patch


- Animesh


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11981/#review22157
---


On June 19, 2013, 9:28 p.m., Adrian Steer wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11981/
> ---
> 
> (Updated June 19, 2013, 9:28 p.m.)
> 
> 
> Review request for cloudstack and Hugo Trippaers.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> This is initial version of API implementation of security groups within the 
> NVP API
> 
> 
> Diffs
> -
> 
>   
> plugins/network-elements/nicira-nvp/src/com/cloud/network/nicira/LogicalSwitchPort.java
>  c571458 
>   
> plugins/network-elements/nicira-nvp/src/com/cloud/network/nicira/NiciraAddressPairs.java
>  PRE-CREATION 
>   
> plugins/network-elements/nicira-nvp/src/com/cloud/network/nicira/NiciraLogicalPortRule.java
>  PRE-CREATION 
>   
> plugins/network-elements/nicira-nvp/src/com/cloud/network/nicira/NiciraNvpApi.java
>  12fa6c0 
>   
> plugins/network-elements/nicira-nvp/src/com/cloud/network/nicira/NiciraSecurityProfile.java
>  PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/11981/diff/
> 
> 
> Testing
> ---
> 
> Compile testing
> 
> 
> Thanks,
> 
> Adrian Steer
> 
>

RE: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth round)

[Animesh Chaturvedi]

> -Original Message-
> From: Animesh Chaturvedi [mailto:animesh.chaturv...@citrix.com]
> Sent: Wednesday, September 25, 2013 1:15 PM
> To: dev@cloudstack.apache.org
> Cc: David Nalley
> Subject: RE: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth
> round)
> 
> 
> 
> > -Original Message-
> > From: Chip Childers [mailto:chip.child...@sungard.com]
> > Sent: Wednesday, September 25, 2013 10:22 AM
> > To: dev@cloudstack.apache.org
> > Cc: David Nalley
> > Subject: Re: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth
> > round)
> >
> > On Tue, Sep 24, 2013 at 07:12:15PM +, Animesh Chaturvedi wrote:
> > > > I can do this, but it may be tomorrow before it gets done.
> > > [Animesh>] I updated the RN yesterday. David what needs to be done
> to
> > publish to cloudstack.apache.org/docs
> >
> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/Releasing+Docs
> >
> > Animesh, are you able to take this?
> [Animesh>] I don't have publican installed. Will give it a try and let
> you know if I run into issues.
[Animesh>] Chip couple of questions.

1. The referenced instructions call out to install Apache Cloudstack branding 
package? I see something in docs/publican-cloudstack directory. Is that the 
branding and needs to be installed by running "yum install 
publican-cloudstack"? Or just running publican build in doc directory will work
2. Which guides do we publish, the instructions mentions 4 which I think would 
be (ReleaseNotes, Install, Dev, Admin) . I see other .cfg files 
publican-all.cfg, publican-niciranvp.cfg and publican-midonet.cfg. Do we need 
to build them too. Atleast p-all.cfg should be built
3. In the "Install the documentation" step I am not clear what changes needed 
to be made to acsdocs.cfg.
 

Re: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth round)

[Chip Childers]

On Wed, Sep 25, 2013 at 08:59:49PM +, Animesh Chaturvedi wrote:
> > [Animesh>] I don't have publican installed. Will give it a try and let
> > you know if I run into issues.
> [Animesh>] Chip couple of questions.
> 
> 1. The referenced instructions call out to install Apache Cloudstack branding 
> package? I see something in docs/publican-cloudstack directory. Is that the 
> branding and needs to be installed by running "yum install 
> publican-cloudstack"? Or just running publican build in doc directory will 
> work
> 2. Which guides do we publish, the instructions mentions 4 which I think 
> would be (ReleaseNotes, Install, Dev, Admin) . I see other .cfg files 
> publican-all.cfg, publican-niciranvp.cfg and publican-midonet.cfg. Do we need 
> to build them too. Atleast p-all.cfg should be built
> 3. In the "Install the documentation" step I am not clear what changes needed 
> to be made to acsdocs.cfg.
>  
>

Actually, nope.  Joe and / or Dave have been the ones to push the docs
so far.  I'm in the same boat as you!

Re: [VOTE] Accept the donation of a Contrail plugin into Apache CloudStack

[Chip Childers]

On Wed, Sep 25, 2013 at 10:04:26PM +0200, Daan Hoogland wrote:
> I like, but let's add a lot of unit tests before merging in master. It has
> some tests, but in comparison to the amount of code it does not suffice. 

I actually agree, but my proposal is to sort out things like that after
the hurdle of accepting the code into a branch...

So thanks for the +1 Daan!

RE: [VOTE] Accept the donation of a Contrail plugin into Apache CloudStack

[Animesh Chaturvedi]

+1 for accepting the donation

> -Original Message-
> From: Chip Childers [mailto:chipchild...@apache.org]
> Sent: Wednesday, September 25, 2013 10:13 AM
> To: dev@cloudstack.apache.org
> Subject: [VOTE] Accept the donation of a Contrail plugin into Apache
> CloudStack
> 
> Hi all!
> 
> As stated in other threads, Juniper is proposing the donation of a
> Contrail plugin to Apache CloudStack.  The code itself has been posted
> to reviewboard [1].  The design has been documented by Pedro [2].
> 
> [1] https://reviews.apache.org/r/14325/
> [2]
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Contrail+network+
> plugin
> 
> I'm calling a vote here, so that we have a formal consensus on accepting
> the code into the project.  As I've suggested earlier, I'd like us to
> accept the code into a branch, and then work through any technical
> concerns / reviews / changes prior to a master branch merge.
> 
> So...  voting will end in ~72 hours.  As this is a technical decision,
> committer and PMC votes are binding.
> 
> -chip
> 
> 
> Votes please!
> 
> [ ] +1 - Accept the donation
> [ ] +/-0 - No strong opinion
> [ ] -1 - Do not accept the donation

RE: LocalHostEndPoint seems to get called

[Edison Su]

> -Original Message-
> From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com]
> Sent: Wednesday, September 25, 2013 12:38 PM
> To: dev@cloudstack.apache.org
> Subject: LocalHostEndPoint seems to get called
> 
> While I'm doing development and restarting things and what not, it seems
> often storage commands get routed to LocalHostEndPoint.  This seems bad.  I
> don't have sudo setup for my user on my laptop, so things like "Unable to
> create local folder for:
> /mnt/secStorage/64d6e26f-e656-3ba3-908f-ce6610ede011 in order to mount
> nfs://192.168.3.134:/exports/secondary1" fail.  But the bigger problem is,
> shouldn't that not happen at all.  It seems like in a normal setup it should
> never try to use LocalHostEndpoint.  Do I have some setting flipped that is
> enabling that?

The current code has bug if ssvm agent is not in the up state, then template 
downloading will likely choose localhostendpoint to download template.
Localhostendpoint should only be used to download system vm template.

> 
> Seems like with the current code you might accidentally mount secondary to
> the management server if the conditions are right...
> 
> Darren

Re: [VOTE] Accept the donation of a Contrail plugin into Apache CloudStack

[Chiradeep Vittal]

+1 (binding)

On 9/25/13 10:13 AM, "Chip Childers"  wrote:

>Hi all!
>
>As stated in other threads, Juniper is proposing the donation of a
>Contrail plugin to Apache CloudStack.  The code itself has been posted
>to reviewboard [1].  The design has been documented by Pedro [2].
>
>[1] https://reviews.apache.org/r/14325/
>[2] 
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Contrail+network+pl
>ugin
>
>I'm calling a vote here, so that we have a formal consensus on accepting
>the code into the project.  As I've suggested earlier, I'd like us to
>accept the code into a branch, and then work through any technical
>concerns / reviews / changes prior to a master branch merge.
>
>So...  voting will end in ~72 hours.  As this is a technical decision,
>committer and PMC votes are binding.
>
>-chip
>
>
>Votes please!
>
>[ ] +1 - Accept the donation
>[ ] +/-0 - No strong opinion
>[ ] -1 - Do not accept the donation

Re: [Merge] Minimal Hyper-V Plugin

[Chiradeep Vittal]

+1 to put this into a branch off of master. Can merge into master after
unit tests for the agent API.


On 9/24/13 12:37 PM, "Donal Lafferty"  wrote:

>On paternity leave, so I don't get to these emails right away...
>
>> -Original Message-
>> From: Chiradeep Vittal [mailto:chiradeep.vit...@citrix.com]
>> Sent: 20 September 2013 06:40
>> To: dev@cloudstack.apache.org
>> Subject: Re: [Merge] Minimal Hyper-V Plugin
>> 
>> Thanks for the preliminary testing.
>> Questions:
>> 1. More for the community: should the C# code be in a separate repo?
>> According to the merge request, mono and maven can be used to build the
>> agent.
>
>Silence == acceptance?
>
>> 2. Packaging: how is the C# agent installed?
>
>The agent is implemented to as a self-contained Windows Service, which is
>the Microsoft Windows equivalent of a Linux daemon.
>
>To make the agent distributable, package the agent and an app.config
>consistent with your data center in an MSI.  WiX is the preferred tool
>(http://en.wikipedia.org/wiki/WiX ).  When executed, the MSI will add the
>agent to set of Windows Services.
>
>To distribute and run this MSI, use Active Directory's GPO (global policy
>object) service.  In typical deployments machines running Hyper-V will be
>domain joined.  Where machines are not domain joined, look at something
>like puppet. 
>
>> 3. What does minimal mean? What works? What doesn't? Local storage?
>> Shared storage? Networking modes? Are the hypervisors supposed to be
>> clustered?
>
>Minimal = create / start / stop / destroy a local storage VM in a
>QuickCloud network offering and CIFS secondary storage.
>
>No clustering required.
>
>> 4. How does one extend the "minimal" plugin?
>
>Each CloudStack command has a corresponding an HTTP URI served by the
>agent.  These are written in ASP.NET MVC4.  Data received by the agent is
>kept in a JSON object graph.
>
>E.g.
>
>// POST api/HypervResource/ReadyCommand
>[HttpPost]
>[ActionName(CloudStackTypes.ReadyCommand)]
>public JContainer ReadyCommand([FromBody]dynamic cmd)
>{
>using (log4net.NDC.Push(Guid.NewGuid().ToString()))
>{
>logger.Info(CloudStackTypes.ReadyCommand +
>cmd.ToString());
>object ansContent = new
>{
>result = true,
>details = (string)null
>};
>return ReturnCloudStackTypedJArray(ansContent,
>CloudStackTypes.ReadyAnswer);
>}
>
>}
>
>Therefore, to extend the plugin, add new HTTP URIs corresponding to
>missing commands, or extend the capabilities of existing commands.
>
>I can follow up with an explanation in a blog entry.
>
>> 5. Can the unit tests (at least those that test the agent API) be run
>>in a non-
>> hyper-v environment?
>
>Unit tests start the agent in a local process.  Provided Mono is
>installed on your system, the unit tests will run.  However, they will
>complain of bad output.
>
>> 6. Is the RDP console you had earlier mentioned included in the merge?
>
>Yes, but it serves no purpose at the moment.
>
>If there is an IP clearance protocol to follow for this console, I would
>prefer to remove the console from the submission.
>
>> 7. Any known issues?
>> 
>
>There seems to be a bug with local paths that include spaces.  I've asked
>Rajesh to provide a bug report, but it's unclear where to put this.  Can
>we use JIRA for code not merged, or should the bug appear in the comments.
>
> 
>> On 9/11/13 8:00 AM, "Donal Lafferty"  wrote:
>> 
>> >Hi Rajesh,
>> >
>> >Thanks for spotting this problem with the Hyper-V Agent.  Sounds like
>> >it should first URL decode the field.
>> >
>> >Can you update the review with details of your testing?
>> >
>> >I would need to know the command and which incoming field is causing
>> >problems.  Also, can you add a serialised example of the instruction
>> >that fails?  There should be an example in the agent's log file.  By
>> >default, the log file is in the same folder as the agent executable.  I
>> >will use this to update the automated tests.
>> >
>> >If you want to go ahead and made the fixes from a git clone, send a
>> >Pull Request.  As long as there is an appropriate automated test, I'll
>> >update the feature branch with your changes.
>> >
>> >
>> >DL
>> >
>> >> -Original Message-
>> >> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
>> >> Sent: 11 September 2013 09:08
>> >> To: dev@cloudstack.apache.org
>> >> Subject: RE: [Merge] Minimal Hyper-V Plugin
>> >>
>> >> Hi Donal,
>> >> I had figured out the issue why "+" is coming in the path value.
>> >> The root cause is while encoding the URI, we use
>> >> URLEncoder.encode(path)
>> >>
>> >> The encode method is converting/replace "space" with "+".
>> >>
>> >> API doc:
>> >> When encoding a String, the following rules apply:
>> >>
>> >> The alphanumeric characters "a" through "z", "A" through "Z" and "0"
>> >> through "9" remain the same.
>> >> 

RE: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth round)

[Animesh Chaturvedi]

> -Original Message-
> From: Chip Childers [mailto:chip.child...@sungard.com]
> Sent: Wednesday, September 25, 2013 2:05 PM
> To: dev@cloudstack.apache.org
> Cc: David Nalley
> Subject: Re: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth
> round)
> 
> On Wed, Sep 25, 2013 at 08:59:49PM +, Animesh Chaturvedi wrote:
> > > [Animesh>] I don't have publican installed. Will give it a try and
> > > let you know if I run into issues.
> > [Animesh>] Chip couple of questions.
> >
> > 1. The referenced instructions call out to install Apache Cloudstack
> > branding package? I see something in docs/publican-cloudstack
> > directory. Is that the branding and needs to be installed by running
> "yum install publican-cloudstack"? Or just running publican build in doc
> directory will work 2. Which guides do we publish, the instructions
> mentions 4 which I think would be (ReleaseNotes, Install, Dev, Admin) .
> I see other .cfg files publican-all.cfg, publican-niciranvp.cfg and
> publican-midonet.cfg. Do we need to build them too. Atleast p-all.cfg
> should be built 3. In the "Install the documentation" step I am not
> clear what changes needed to be made to acsdocs.cfg.
> >
> >
> 
> Actually, nope.  Joe and / or Dave have been the ones to push the docs
> so far.  I'm in the same boat as you!
[Animesh>] I am happy to try and learn but looks like David we need your help 
to get this accomplished for now.

RE: bug? capacity not updated when adding memory to hypervisor

[Prachi Damle]

Yes, the main bug here is not updating the Total Capacity - this is avoiding 
the total getting updated on host reconnects.

Bug with the Used and Reserved Capacities gets masked since CapacityManager 
also listens to the VM state changes and updates these values.

Prachi
-Original Message-
From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com] 
Sent: Wednesday, September 25, 2013 1:45 PM
To: dev@cloudstack.apache.org
Subject: Re: bug? capacity not updated when adding memory to hypervisor

The main bug being the lack of memCap.setTotalCapacity(host.getTotalMemory());

Darren

On Wed, Sep 25, 2013 at 1:13 PM, Daan Hoogland  wrote:
> I agree Darren,
>
> if (cpuCap.getUsedCapacity() == usedCpu &&
> cpuCap.getReservedCapacity() == reservedCpu) { } else {
>if (cpuCap.getReservedCapacity() != reservedCpu) {
> cpuCap.setReservedCapacity(reservedCpu);
>}
>if (cpuCap.getUsedCapacity() != usedCpu) {
> cpuCap.setUsedCapacity(usedCpu);
> }
> }
>
> makes more sense. (same for mem)
>
>
> On Wed, Sep 25, 2013 at 9:59 PM, Darren Shepherd < 
> darren.s.sheph...@gmail.com> wrote:
>
>> I added more memory to a hypervisor, and the host tables was updated 
>> properly, but the op_host_capacity is not updated.  I tracked down 
>> the code to CapacityManagerImpl.updateCapacityForHost.  The below 
>> logic seems completely wrong.  Unless I'm reading it wrong, it seems 
>> like it will only update EITHER used or reserved (not both) and never 
>> update total.  I removed log statements to make it more readable.
>>
>> if (cpuCap.getUsedCapacity() == usedCpu &&
>> cpuCap.getReservedCapacity() == reservedCpu) {
>> } else if (cpuCap.getReservedCapacity() != reservedCpu) {
>> cpuCap.setReservedCapacity(reservedCpu);
>> } else if (cpuCap.getUsedCapacity() != usedCpu) {
>> cpuCap.setUsedCapacity(usedCpu);
>> }
>>
>> if (memCap.getUsedCapacity() == usedMemory &&
>> memCap.getReservedCapacity() == reservedMemory) {
>> } else if (memCap.getReservedCapacity() != reservedMemory) {
>> memCap.setReservedCapacity(reservedMemory);
>> } else if (memCap.getUsedCapacity() != usedMemory) {
>> memCap.setUsedCapacity(usedMemory);
>> }
>>

RE: [VOTE] Accept the donation of a Contrail plugin into Apache CloudStack

[Musayev, Ilya]

+1(binding)

> -Original Message-
> From: Chiradeep Vittal [mailto:chiradeep.vit...@citrix.com]
> Sent: Wednesday, September 25, 2013 5:23 PM
> To: dev@cloudstack.apache.org
> Subject: Re: [VOTE] Accept the donation of a Contrail plugin into Apache
> CloudStack
> 
> +1 (binding)
> 
> On 9/25/13 10:13 AM, "Chip Childers"  wrote:
> 
> >Hi all!
> >
> >As stated in other threads, Juniper is proposing the donation of a
> >Contrail plugin to Apache CloudStack.  The code itself has been posted
> >to reviewboard [1].  The design has been documented by Pedro [2].
> >
> >[1] https://reviews.apache.org/r/14325/
> >[2]
> >https://cwiki.apache.org/confluence/display/CLOUDSTACK/Contrail+netwo
> rk
> >+pl
> >ugin
> >
> >I'm calling a vote here, so that we have a formal consensus on
> >accepting the code into the project.  As I've suggested earlier, I'd
> >like us to accept the code into a branch, and then work through any
> >technical concerns / reviews / changes prior to a master branch merge.
> >
> >So...  voting will end in ~72 hours.  As this is a technical decision,
> >committer and PMC votes are binding.
> >
> >-chip
> >
> >
> >Votes please!
> >
> >[ ] +1 - Accept the donation
> >[ ] +/-0 - No strong opinion
> >[ ] -1 - Do not accept the donation
> 

[MAJOR][BUG] ACS powers off some VMs in vSphere - when MS service is restarted

[Musayev, Ilya]

Hi All,

I'd like to raise an awareness on the issue with ACS 4.1.1 (I assume other 
versions are affected - since I could not find any changes in the latest code 
that would state otherwise).

On MS server start/restart, it checks all the VMs for their state, if some 
reason state is either not found or comes as stopped - which is inaccurate, the 
vms will *power off*.

On todays occurrence, half of my plant  went down because ACS invoked 
StopCommand on the vms that either had no state or for some reason agentState 
== Stopped.

The details of this issue is in 
https://issues.apache.org/jira/browse/CLOUDSTACK-4740

The error in the logs is:

2013-09-25 14:35:49,928 DEBUG [vmware.resource.VmwareResource] 
(AgentTaskPool-1:null) Detecting a new state but couldn't find a old state so 
adding it to the changes: i-2-262-acs-docs-fc17
2013-09-25 14:35:51,213 DEBUG [agent.transport.Request] (AgentTaskPool-1:null) 
Seq -1--1: Startup request from directly connected host: { Cmd , MgmtId: -1, 
via: -1, Ver: v1, Flags: 11, 
[{"cpus":16,"speed":2199,"memory":68683468800,"dom0MinMemory":0,"poolSync":false,"vms":{"i-8-270-CLOUD411":{"state":"Running"},"r-15-CLOUD41-OLD":{"state":"Stopped"},"v-260-CLOUD411":{"state":"Running"},"i-2-283-vmbld01l-ops-08":{"state":"Running"},"i-2-104-ACS41VM":{"state":"Running"},"--s-1-CLOUD41-OLD":{"state":"Running"},"i-27-280-CLOUD411":{"state":"Running"},"i-2-285-ossec01l-ops-08":{"state":"Running"},"i-2-262-acs-docs-fc17":{"state":"Stopped"},"i-24-265-test3":{"state":"Running"},"cloud01l-ops-08.portal.webmd.com":{"state":"Running"},"i-2-278-demo01t-ops-08":{"state":"Running"},"s-63-CLOUD411":{"state":"Running"},"r-66-CLOUD411":{"state":"Running"},"i-2-281-acs-appliance":{"state":"Running"}},"caps":"hvm","hypervisorType":"VMware","hostDetails":{"com.cloud.network.Networks.RouterPrivateIpStrategy":"DcGlobal","NativeHA":"true"},"hypervisorVersion":"5.0","type":"Routing","dataCenter":"2","pod":"2","cluster":"3","guid":"HostSystem:host-19...@vc00q-ops-08.portal.webmd.com","name":"vmha62d-ops-08.portal.webmd.com","version":"4.1.1-SNAPSHOT","privateIpAddress":"172.25.243.31","privateMacAddress":"68:b5:99:73:0b:c2","privateNetmask":"255.255.255.0","storageIpAddress":"172.25.243.31","storageNetmask":"255.255.255.0","storageMacAddress":"68:b5:99:73:0b:c2","wait":0},{"totalSize":0,"poolInfo":{"uuid":"72c8aedb-58c4-4569-ac51-adc5af770bf6","host":"vmha62d-ops-08.portal.webmd.com","localPath":"","hostPath":"datastore-19718","poolType":"LVM","capacityBytes":141465485312,"availableBytes":140383354880},"resourceType":"STORAGE_POOL","hostDetails":{},"type":"Storage","dataCenter":"2","pod":"2","cluster":"3","guid":"72c8aedb-58c4-4569-ac51-adc5af770bf6","name":"72c8aedb-58c4-4569-ac51-adc5af770bf6","wait":0}]
 }
2013-09-25 14:35:53,614 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(AgentTaskPool-1:null) VM i-2-262-acs-docs-fc17: cs state = Running and 
realState = Stopped
2013-09-25 14:35:53,614 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(AgentTaskPool-1:null) VM i-2-262-acs-docs-fc17: cs state = Running and 
realState = Stopped
2013-09-25 14:35:53,614 INFO [cloud.ha.HighAvailabilityManagerImpl] 
(AgentTaskPool-1:null) Skip HA for VMware VM i-2-262-acs-docs-fc17
2013-09-25 14:35:53,694 DEBUG [agent.transport.Request] (AgentTaskPool-1:null) 
Seq 11-1418264581: Sending { Cmd , MgmtId: 345049078181, via: 11, Ver: v1, 
Flags: 100101, 
[{"StopCommand":{"isProxy":false,"vmName":"i-2-262-acs-docs-fc17","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-278-demo01t-ops-08","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-281-acs-appliance","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-283-vmbld01l-ops-08","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-285-ossec01l-ops-08","wait":0}}]
 }
2013-09-25 14:35:53,695 DEBUG [agent.transport.Request] (AgentTaskPool-1:null) 
Seq 11-1418264581: Executing: { Cmd , MgmtId: 345049078181, via: 11, Ver: v1, 
Flags: 100101, 
[{"StopCommand":{"isProxy":false,"vmName":"i-2-262-acs-docs-fc17","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-278-demo01t-ops-08","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-281-acs-appliance","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-283-vmbld01l-ops-08","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-285-ossec01l-ops-08","wait":0}}]
 }
2013-09-25 14:35:53,702 INFO [vmware.resource.VmwareResource] 
(DirectAgent-3:vmha62d-ops-08.portal.webmd.com) Executing resource StopCommand: 
{"isProxy":false,"vmName":"i-2-262-acs-docs-fc17","wait":0}
2013-09-25 14:35:53,703 DEBUG [vmware.mo.HostMO] 
(DirectAgent-3:vmha62d-ops-08.portal.webmd.com) find VM i-2-262-acs-docs-fc17 
on host
2013-09-25 14:35:54,753 INFO [vmware.resource.VmwareResource] 
(DirectAgent-3:vmha62d-ops-08.portal.webmd.com) VM i-2-262-acs-docs-fc17 is 
already in stopped state
2013-09-25 14:37:50,264 DEBUG [agent.transport.Request] (DirectAgent-3:null) 
Seq 11-1418264581: Processing: { Ans: , MgmtId: 345049078181, via:

Re: Managed storage with KVM

[Mike Tutkowski]

These results look good:

mtutkowski@ubuntu:~$ sudo cloudstack-setup-agent -m 192.168.233.1 -z 1 -p 1
-c 1 -g 6b4aa1c2-2ac9-3c60-aabe-704aed40c684 -a --pubNic=cloudbr0
--prvNic=cloudbr0 --guestNic=cloudbr0
Starting to configure your system:
Configure Apparmor ...[OK]
Configure Network ... [OK]
Configure Libvirt ... [OK]
Configure Firewall ...[OK]
Configure Nfs ... [OK]
Configure cloudAgent ...  [OK]
CloudStack Agent setup is done!

However, these results are the same:

mtutkowski@ubuntu:~$ ps -ef | grep jsvc
1000  4314  3725  0 16:10 pts/100:00:00 grep --color=auto jsvc


On Wed, Sep 25, 2013 at 3:48 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> This appears to be the offending method:
>
> public String parseCapabilitiesXML(String capXML) {
>
> if (!_initialized) {
>
> return null;
>
> }
>
> try {
>
> _sp.parse(new InputSource(new StringReader(capXML)), this);
>
> return _capXML.toString();
>
> } catch (SAXException se) {
>
> s_logger.warn(se.getMessage());
>
> } catch (IOException ie) {
>
> s_logger.error(ie.getMessage());
>
> }
>
> return null;
>
> }
>
>
> The logging I do from this method (not shown above), however, doesn't seem
> to end up in agent.log. Not sure why that is.
>
> We invoke this method and I log we're in this method as the first thing I
> do, but it doesn't show up in agent.log.
>
> The last message in agent.log is a line saying we are right before the
> call to this method.
>
>

RE: [MAJOR][BUG] ACS powers off some VMs in vSphere - when MS service is restarted

[Musayev, Ilya]

Sorry if the error log is abit hard to read, as an example, please track the 
vmname i-2-262-acs-docs-fc17.

2013-09-25 14:35:49,928 DEBUG [vmware.resource.VmwareResource] 
(AgentTaskPool-1:null) Detecting a new state but couldn't find a old state so 
adding it to the changes: i-2-262-acs-docs-fc17
2013-09-25 14:35:53,614 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(AgentTaskPool-1:null) VM i-2-262-acs-docs-fc17: cs state = Running and 
realState = Stopped
2013-09-25 14:35:53,614 DEBUG [cloud.vm.VirtualMachineManagerImpl] 
(AgentTaskPool-1:null) VM i-2-262-acs-docs-fc17: cs state = Running and 
realState = Stopped
2013-09-25 14:35:53,614 INFO  [cloud.ha.HighAvailabilityManagerImpl] 
(AgentTaskPool-1:null) Skip HA for VMware VM i-2-262-acs-docs-fc17
2013-09-25 14:35:53,694 DEBUG [agent.transport.Request] (AgentTaskPool-1:null) 
Seq 11-1418264581: Sending  { Cmd , MgmtId: 345049078181, via: 11, Ver: v1, 
Flags: 100101, 
[{"StopCommand":{"isProxy":false,"vmName":"i-2-262-acs-docs-fc17","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-278-demo01t-ops-08","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-281-acs-appliance","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-283-vmbld01l-ops-08","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-285-ossec01l-ops-08","wait":0}}]
 }
2013-09-25 14:35:53,695 DEBUG [agent.transport.Request] (AgentTaskPool-1:null) 
Seq 11-1418264581: Executing:  { Cmd , MgmtId: 345049078181, via: 11, Ver: v1, 
Flags: 100101, 
[{"StopCommand":{"isProxy":false,"vmName":"i-2-262-acs-docs-fc17","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-278-demo01t-ops-08","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-281-acs-appliance","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-283-vmbld01l-ops-08","wait":0}},{"StopCommand":{"isProxy":false,"vmName":"i-2-285-ossec01l-ops-08","wait":0}}]
 }
2013-09-25 14:35:53,702 INFO  [vmware.resource.VmwareResource] 
(DirectAgent-3:vmha62d-ops-08.portal.webmd.com) Executing resource StopCommand: 
{"isProxy":false,"vmName":"i-2-262-acs-docs-fc17","wait":0}
2013-09-25 14:35:53,703 DEBUG [vmware.mo.HostMO] 
(DirectAgent-3:vmha62d-ops-08.portal.webmd.com) find VM i-2-262-acs-docs-fc17 
on host
2013-09-25 14:35:54,753 INFO  [vmware.resource.VmwareResource] 
(DirectAgent-3:vmha62d-ops-08.portal.webmd.com) VM i-2-262-acs-docs-fc17 is 
already in stopped state

> -Original Message-
> From: Musayev, Ilya [mailto:imusa...@webmd.net]
> Sent: Wednesday, September 25, 2013 6:08 PM
> To: dev@cloudstack.apache.org
> Subject: [MAJOR][BUG] ACS powers off some VMs in vSphere - when MS
> service is restarted
> 
> Hi All,
> 
> I'd like to raise an awareness on the issue with ACS 4.1.1 (I assume other
> versions are affected - since I could not find any changes in the latest code
> that would state otherwise).
> 
> On MS server start/restart, it checks all the VMs for their state, if some
> reason state is either not found or comes as stopped - which is inaccurate,
> the vms will *power off*.
> 
> On todays occurrence, half of my plant  went down because ACS invoked
> StopCommand on the vms that either had no state or for some reason
> agentState == Stopped.
> 
> The details of this issue is in
> https://issues.apache.org/jira/browse/CLOUDSTACK-4740
> 
> The error in the logs is:
> 
> 2013-09-25 14:35:49,928 DEBUG [vmware.resource.VmwareResource]
> (AgentTaskPool-1:null) Detecting a new state but couldn't find a old state so
> adding it to the changes: i-2-262-acs-docs-fc17
> 2013-09-25 14:35:51,213 DEBUG [agent.transport.Request] (AgentTaskPool-
> 1:null) Seq -1--1: Startup request from directly connected host: { Cmd ,
> MgmtId: -1, via: -1, Ver: v1, Flags: 11,
> [{"cpus":16,"speed":2199,"memory":68683468800,"dom0MinMemory":0,"po
> olSync":false,"vms":{"i-8-270-CLOUD411":{"state":"Running"},"r-15-
> CLOUD41-OLD":{"state":"Stopped"},"v-260-
> CLOUD411":{"state":"Running"},"i-2-283-vmbld01l-ops-
> 08":{"state":"Running"},"i-2-104-ACS41VM":{"state":"Running"},"--s-1-
> CLOUD41-OLD":{"state":"Running"},"i-27-280-
> CLOUD411":{"state":"Running"},"i-2-285-ossec01l-ops-
> 08":{"state":"Running"},"i-2-262-acs-docs-fc17":{"state":"Stopped"},"i-24-
> 265-test3":{"state":"Running"},"cloud01l-ops-
> 08.portal.webmd.com":{"state":"Running"},"i-2-278-demo01t-ops-
> 08":{"state":"Running"},"s-63-CLOUD411":{"state":"Running"},"r-66-
> CLOUD411":{"state":"Running"},"i-2-281-acs-
> appliance":{"state":"Running"}},"caps":"hvm","hypervisorType":"VMware","
> hostDetails":{"com.cloud.network.Networks.RouterPrivateIpStrategy":"DcGl
> obal","NativeHA":"true"},"hypervisorVersion":"5.0","type":"Routing","dataC
> enter":"2","pod":"2","cluster":"3","guid":"HostSystem:host-19716@vc00q-
> ops-08.portal.webmd.com","name":"vmha62d-ops-
> 08.portal.webmd.com","version":"4.1.1-
> SNAPSHOT","privateIpAddress":"172.25.243.31","privateMacAddress":"68:b5
> :99:73:0b:c2","privateNetmask":"255.255.255.0","storageIpAddress":"172.25.
> 243.31","storageNetmas

Documentation on VPC?

[Darren Shepherd]

I've been trying to go through the GUI and do stuff with VPC and I'm
really quite lost. Are there any user docs on this stuff?  I thought I
would just go through the API, but cloudmonkey is not very useful for
VPC in that "list vpcs" spews like 50 lines for each VPC.  I can click
around a view a lot of stuff, but I can't manage to figure out how to
create much of anything.

Darren

Re: Managed storage with KVM

[Marcus Sorensen]

So you:

1. run that command
2. get a brand new agent.properties as a result
3. start the service

but you don't see it in the process table?

The agent's STDOUT doesn't go to the agent log, only log4j stuff. So
if there were an error not printed via logger you'd not see it.  I'm
not as familiar with the debian/ubuntu stuff off the top of my head,
but in /etc/init.d/cloudstack-agent on CentOS we do:

start() {
echo -n $"Starting $PROGNAME: "
if hostname --fqdn >/dev/null 2>&1 ; then
$JSVC -cp "$CLASSPATH" -pidfile "$PIDFILE" \
-errfile $LOGDIR/cloudstack-agent.err -outfile
$LOGDIR/cloudstack-agent.out $CLASS
RETVAL=$?
echo
else


Which sends STDOUT to cloudstack-agent.out and errors to
cloudstack-agent.err. You can look to see what Ubuntu does.

Out of curiosity, what do you get when you do 'lsmod | grep kvm' ? I
know you didn't end up using it, but the devcloud-kvm instructions for
vmware fusion tell you to ensure that your guest has hardware
virtualization passthrough enabled, I'm wondering if it isn't.

On Wed, Sep 25, 2013 at 4:11 PM, Mike Tutkowski
 wrote:
> These results look good:
>
> mtutkowski@ubuntu:~$ sudo cloudstack-setup-agent -m 192.168.233.1 -z 1 -p 1
> -c 1 -g 6b4aa1c2-2ac9-3c60-aabe-704aed40c684 -a --pubNic=cloudbr0
> --prvNic=cloudbr0 --guestNic=cloudbr0
> Starting to configure your system:
> Configure Apparmor ...[OK]
> Configure Network ... [OK]
> Configure Libvirt ... [OK]
> Configure Firewall ...[OK]
> Configure Nfs ... [OK]
> Configure cloudAgent ...  [OK]
> CloudStack Agent setup is done!
>
> However, these results are the same:
>
> mtutkowski@ubuntu:~$ ps -ef | grep jsvc
> 1000  4314  3725  0 16:10 pts/100:00:00 grep --color=auto jsvc
>
>
> On Wed, Sep 25, 2013 at 3:48 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> This appears to be the offending method:
>>
>> public String parseCapabilitiesXML(String capXML) {
>>
>> if (!_initialized) {
>>
>> return null;
>>
>> }
>>
>> try {
>>
>> _sp.parse(new InputSource(new StringReader(capXML)), this);
>>
>> return _capXML.toString();
>>
>> } catch (SAXException se) {
>>
>> s_logger.warn(se.getMessage());
>>
>> } catch (IOException ie) {
>>
>> s_logger.error(ie.getMessage());
>>
>> }
>>
>> return null;
>>
>> }
>>
>>
>> The logging I do from this method (not shown above), however, doesn't seem
>> to end up in agent.log. Not sure why that is.
>>
>> We invoke this method and I log we're in this method as the first thing I
>> do, but it doesn't show up in agent.log.
>>
>> The last message in agent.log is a line saying we are right before the
>> call to this method.
>>
>>

Re: Managed storage with KVM

[Mike Tutkowski]

This is my new agent.properties file (with comments removed...looks decent):

guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
workers=5
host=192.168.233.1
port=8250
cluster=1
pod=1
zone=1
local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
private.network.device=cloudbr0
public.network.device=cloudbr0
guest.network.device=cloudbr0

Yeah, I was always writing stuff out using the logger. I should look into
redirecting stdout and stderr.

Here were my steps to start and check the process status:

mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
cloudstack-agent start
 * Starting CloudStack Agent cloudstack-agent
   [ OK ]
mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ps -ef | grep jsvc
1000  4605  3725  0 16:47 pts/100:00:00 grep --color=auto jsvc

Also, this might be of interest:

mtutkowski@ubuntu:/etc/cloudstack/agent$ lsmod | grep kvm
kvm_intel 137721  0
kvm   415549  1 kvm_intel

mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c '(vmx|svm)' /proc/cpuinfo
1

mtutkowski@ubuntu:/etc/cloudstack/agent$ kvm-ok
INFO: /dev/kvm exists
KVM acceleration can be used

mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c ' lm ' /proc/cpuinfo
1

On Wed, Sep 25, 2013 at 4:39 PM, Marcus Sorensen wrote:

> So you:
>
> 1. run that command
> 2. get a brand new agent.properties as a result
> 3. start the service
>
> but you don't see it in the process table?
>
> The agent's STDOUT doesn't go to the agent log, only log4j stuff. So
> if there were an error not printed via logger you'd not see it.  I'm
> not as familiar with the debian/ubuntu stuff off the top of my head,
> but in /etc/init.d/cloudstack-agent on CentOS we do:
>
> start() {
> echo -n $"Starting $PROGNAME: "
> if hostname --fqdn >/dev/null 2>&1 ; then
> $JSVC -cp "$CLASSPATH" -pidfile "$PIDFILE" \
> -errfile $LOGDIR/cloudstack-agent.err -outfile
> $LOGDIR/cloudstack-agent.out $CLASS
> RETVAL=$?
> echo
> else
>
>
> Which sends STDOUT to cloudstack-agent.out and errors to
> cloudstack-agent.err. You can look to see what Ubuntu does.
>
> Out of curiosity, what do you get when you do 'lsmod | grep kvm' ? I
> know you didn't end up using it, but the devcloud-kvm instructions for
> vmware fusion tell you to ensure that your guest has hardware
> virtualization passthrough enabled, I'm wondering if it isn't.
>
> On Wed, Sep 25, 2013 at 4:11 PM, Mike Tutkowski
>  wrote:
> > These results look good:
> >
> > mtutkowski@ubuntu:~$ sudo cloudstack-setup-agent -m 192.168.233.1 -z 1
> -p 1
> > -c 1 -g 6b4aa1c2-2ac9-3c60-aabe-704aed40c684 -a --pubNic=cloudbr0
> > --prvNic=cloudbr0 --guestNic=cloudbr0
> > Starting to configure your system:
> > Configure Apparmor ...[OK]
> > Configure Network ... [OK]
> > Configure Libvirt ... [OK]
> > Configure Firewall ...[OK]
> > Configure Nfs ... [OK]
> > Configure cloudAgent ...  [OK]
> > CloudStack Agent setup is done!
> >
> > However, these results are the same:
> >
> > mtutkowski@ubuntu:~$ ps -ef | grep jsvc
> > 1000  4314  3725  0 16:10 pts/100:00:00 grep --color=auto jsvc
> >
> >
> > On Wed, Sep 25, 2013 at 3:48 PM, Mike Tutkowski <
> > mike.tutkow...@solidfire.com> wrote:
> >
> >> This appears to be the offending method:
> >>
> >> public String parseCapabilitiesXML(String capXML) {
> >>
> >> if (!_initialized) {
> >>
> >> return null;
> >>
> >> }
> >>
> >> try {
> >>
> >> _sp.parse(new InputSource(new StringReader(capXML)), this);
> >>
> >> return _capXML.toString();
> >>
> >> } catch (SAXException se) {
> >>
> >> s_logger.warn(se.getMessage());
> >>
> >> } catch (IOException ie) {
> >>
> >> s_logger.error(ie.getMessage());
> >>
> >> }
> >>
> >> return null;
> >>
> >> }
> >>
> >>
> >> The logging I do from this method (not shown above), however, doesn't
> seem
> >> to end up in agent.log. Not sure why that is.
> >>
> >> We invoke this method and I log we're in this method as the first thing
> I
> >> do, but it doesn't show up in agent.log.
> >>
> >> The last message in agent.log is a line saying we are right before the
> >> call to this method.
> >>
> >>
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud
*™*

Re: Managed storage with KVM

[Mike Tutkowski]

These also look good:

mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
x86_64
mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system list
 Id Name State
--

mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
/var/run/libvirt/libvirt-sock
srwxrwx--- 1 root libvirtd 0 Sep 25 16:05 /var/run/libvirt/libvirt-sock
mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm



On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> This is my new agent.properties file (with comments removed...looks
> decent):
>
> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
> workers=5
> host=192.168.233.1
> port=8250
> cluster=1
> pod=1
> zone=1
> local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
> private.network.device=cloudbr0
> public.network.device=cloudbr0
> guest.network.device=cloudbr0
>
> Yeah, I was always writing stuff out using the logger. I should look into
> redirecting stdout and stderr.
>
> Here were my steps to start and check the process status:
>
> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
> cloudstack-agent start
>  * Starting CloudStack Agent cloudstack-agent
>  [ OK ]
> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ps -ef | grep jsvc
> 1000  4605  3725  0 16:47 pts/100:00:00 grep --color=auto jsvc
>
> Also, this might be of interest:
>
> mtutkowski@ubuntu:/etc/cloudstack/agent$ lsmod | grep kvm
> kvm_intel 137721  0
> kvm   415549  1 kvm_intel
>
> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c '(vmx|svm)'
> /proc/cpuinfo
> 1
>
> mtutkowski@ubuntu:/etc/cloudstack/agent$ kvm-ok
> INFO: /dev/kvm exists
> KVM acceleration can be used
>
> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c ' lm ' /proc/cpuinfo
> 1
>
> On Wed, Sep 25, 2013 at 4:39 PM, Marcus Sorensen wrote:
>
>> So you:
>>
>> 1. run that command
>> 2. get a brand new agent.properties as a result
>> 3. start the service
>>
>> but you don't see it in the process table?
>>
>> The agent's STDOUT doesn't go to the agent log, only log4j stuff. So
>> if there were an error not printed via logger you'd not see it.  I'm
>> not as familiar with the debian/ubuntu stuff off the top of my head,
>> but in /etc/init.d/cloudstack-agent on CentOS we do:
>>
>> start() {
>> echo -n $"Starting $PROGNAME: "
>> if hostname --fqdn >/dev/null 2>&1 ; then
>> $JSVC -cp "$CLASSPATH" -pidfile "$PIDFILE" \
>> -errfile $LOGDIR/cloudstack-agent.err -outfile
>> $LOGDIR/cloudstack-agent.out $CLASS
>> RETVAL=$?
>> echo
>> else
>>
>>
>> Which sends STDOUT to cloudstack-agent.out and errors to
>> cloudstack-agent.err. You can look to see what Ubuntu does.
>>
>> Out of curiosity, what do you get when you do 'lsmod | grep kvm' ? I
>> know you didn't end up using it, but the devcloud-kvm instructions for
>> vmware fusion tell you to ensure that your guest has hardware
>> virtualization passthrough enabled, I'm wondering if it isn't.
>>
>> On Wed, Sep 25, 2013 at 4:11 PM, Mike Tutkowski
>>  wrote:
>> > These results look good:
>> >
>> > mtutkowski@ubuntu:~$ sudo cloudstack-setup-agent -m 192.168.233.1 -z 1
>> -p 1
>> > -c 1 -g 6b4aa1c2-2ac9-3c60-aabe-704aed40c684 -a --pubNic=cloudbr0
>> > --prvNic=cloudbr0 --guestNic=cloudbr0
>> > Starting to configure your system:
>> > Configure Apparmor ...[OK]
>> > Configure Network ... [OK]
>> > Configure Libvirt ... [OK]
>> > Configure Firewall ...[OK]
>> > Configure Nfs ... [OK]
>> > Configure cloudAgent ...  [OK]
>> > CloudStack Agent setup is done!
>> >
>> > However, these results are the same:
>> >
>> > mtutkowski@ubuntu:~$ ps -ef | grep jsvc
>> > 1000  4314  3725  0 16:10 pts/100:00:00 grep --color=auto jsvc
>> >
>> >
>> > On Wed, Sep 25, 2013 at 3:48 PM, Mike Tutkowski <
>> > mike.tutkow...@solidfire.com> wrote:
>> >
>> >> This appears to be the offending method:
>> >>
>> >> public String parseCapabilitiesXML(String capXML) {
>> >>
>> >> if (!_initialized) {
>> >>
>> >> return null;
>> >>
>> >> }
>> >>
>> >> try {
>> >>
>> >> _sp.parse(new InputSource(new StringReader(capXML)), this);
>> >>
>> >> return _capXML.toString();
>> >>
>> >> } catch (SAXException se) {
>> >>
>> >> s_logger.warn(se.getMessage());
>> >>
>> >> } catch (IOException ie) {
>> >>
>> >> s_logger.error(ie.getMessage());
>> >>
>> >> }
>> >>
>> >> return null;
>> >>
>> >> }
>> >>
>> >>
>> >> The logging I do from this method (not shown above), however, doesn't
>> seem
>> >> to end up in agent.log. Not sure why that is.
>> >>
>> >> We invoke this method and I log we're in this method as the first
>> thing I
>> >> do, but it doesn'

Re: Managed storage with KVM

[Marcus Sorensen]

Ok, so the next step is to track that stdout and see if you can see
what jsvc complains about when it fails to start up the service.

On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
 wrote:
> These also look good:
>
> mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
> x86_64
> mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system list
>  Id Name State
> --
>
> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
> /var/run/libvirt/libvirt-sock
> srwxrwx--- 1 root libvirtd 0 Sep 25 16:05 /var/run/libvirt/libvirt-sock
> mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
> crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
>
>
>
> On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> This is my new agent.properties file (with comments removed...looks
>> decent):
>>
>> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
>> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
>> workers=5
>> host=192.168.233.1
>> port=8250
>> cluster=1
>> pod=1
>> zone=1
>> local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
>> private.network.device=cloudbr0
>> public.network.device=cloudbr0
>> guest.network.device=cloudbr0
>>
>> Yeah, I was always writing stuff out using the logger. I should look into
>> redirecting stdout and stderr.
>>
>> Here were my steps to start and check the process status:
>>
>> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
>> cloudstack-agent start
>>  * Starting CloudStack Agent cloudstack-agent
>>  [ OK ]
>> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ps -ef | grep jsvc
>> 1000  4605  3725  0 16:47 pts/100:00:00 grep --color=auto jsvc
>>
>> Also, this might be of interest:
>>
>> mtutkowski@ubuntu:/etc/cloudstack/agent$ lsmod | grep kvm
>> kvm_intel 137721  0
>> kvm   415549  1 kvm_intel
>>
>> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c '(vmx|svm)'
>> /proc/cpuinfo
>> 1
>>
>> mtutkowski@ubuntu:/etc/cloudstack/agent$ kvm-ok
>> INFO: /dev/kvm exists
>> KVM acceleration can be used
>>
>> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c ' lm ' /proc/cpuinfo
>> 1
>>
>> On Wed, Sep 25, 2013 at 4:39 PM, Marcus Sorensen wrote:
>>
>>> So you:
>>>
>>> 1. run that command
>>> 2. get a brand new agent.properties as a result
>>> 3. start the service
>>>
>>> but you don't see it in the process table?
>>>
>>> The agent's STDOUT doesn't go to the agent log, only log4j stuff. So
>>> if there were an error not printed via logger you'd not see it.  I'm
>>> not as familiar with the debian/ubuntu stuff off the top of my head,
>>> but in /etc/init.d/cloudstack-agent on CentOS we do:
>>>
>>> start() {
>>> echo -n $"Starting $PROGNAME: "
>>> if hostname --fqdn >/dev/null 2>&1 ; then
>>> $JSVC -cp "$CLASSPATH" -pidfile "$PIDFILE" \
>>> -errfile $LOGDIR/cloudstack-agent.err -outfile
>>> $LOGDIR/cloudstack-agent.out $CLASS
>>> RETVAL=$?
>>> echo
>>> else
>>>
>>>
>>> Which sends STDOUT to cloudstack-agent.out and errors to
>>> cloudstack-agent.err. You can look to see what Ubuntu does.
>>>
>>> Out of curiosity, what do you get when you do 'lsmod | grep kvm' ? I
>>> know you didn't end up using it, but the devcloud-kvm instructions for
>>> vmware fusion tell you to ensure that your guest has hardware
>>> virtualization passthrough enabled, I'm wondering if it isn't.
>>>
>>> On Wed, Sep 25, 2013 at 4:11 PM, Mike Tutkowski
>>>  wrote:
>>> > These results look good:
>>> >
>>> > mtutkowski@ubuntu:~$ sudo cloudstack-setup-agent -m 192.168.233.1 -z 1
>>> -p 1
>>> > -c 1 -g 6b4aa1c2-2ac9-3c60-aabe-704aed40c684 -a --pubNic=cloudbr0
>>> > --prvNic=cloudbr0 --guestNic=cloudbr0
>>> > Starting to configure your system:
>>> > Configure Apparmor ...[OK]
>>> > Configure Network ... [OK]
>>> > Configure Libvirt ... [OK]
>>> > Configure Firewall ...[OK]
>>> > Configure Nfs ... [OK]
>>> > Configure cloudAgent ...  [OK]
>>> > CloudStack Agent setup is done!
>>> >
>>> > However, these results are the same:
>>> >
>>> > mtutkowski@ubuntu:~$ ps -ef | grep jsvc
>>> > 1000  4314  3725  0 16:10 pts/100:00:00 grep --color=auto jsvc
>>> >
>>> >
>>> > On Wed, Sep 25, 2013 at 3:48 PM, Mike Tutkowski <
>>> > mike.tutkow...@solidfire.com> wrote:
>>> >
>>> >> This appears to be the offending method:
>>> >>
>>> >> public String parseCapabilitiesXML(String capXML) {
>>> >>
>>> >> if (!_initialized) {
>>> >>
>>> >> return null;
>>> >>
>>> >> }
>>> >>
>>> >> try {
>>> >>
>>> >> _sp.parse(new InputSource(new StringReader(capXML)), this);
>>> >>
>>> >> return _capXML.toString();
>>> >>
>>> >> } catch (SAXException se) {
>>> >>
>>> >> s_logger.warn(se.getMessage());
>>> >>
>>> >> } catch (IOException ie) {
>>> >>
>>> >> s_logger.error(i

Re: Managed storage with KVM

[Marcus Sorensen]

In the past, prior to the addition to the CentOS init script that I
mentioned, I'd modify the init script to echo out the jsvc command it
was going to run, then I'd run that manually instead of the init. Then
I could see where it died.

On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen  wrote:
> Ok, so the next step is to track that stdout and see if you can see
> what jsvc complains about when it fails to start up the service.
>
> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
>  wrote:
>> These also look good:
>>
>> mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
>> x86_64
>> mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system list
>>  Id Name State
>> --
>>
>> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
>> /var/run/libvirt/libvirt-sock
>> srwxrwx--- 1 root libvirtd 0 Sep 25 16:05 /var/run/libvirt/libvirt-sock
>> mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
>> crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
>>
>>
>>
>> On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
>> mike.tutkow...@solidfire.com> wrote:
>>
>>> This is my new agent.properties file (with comments removed...looks
>>> decent):
>>>
>>> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
>>> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
>>> workers=5
>>> host=192.168.233.1
>>> port=8250
>>> cluster=1
>>> pod=1
>>> zone=1
>>> local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
>>> private.network.device=cloudbr0
>>> public.network.device=cloudbr0
>>> guest.network.device=cloudbr0
>>>
>>> Yeah, I was always writing stuff out using the logger. I should look into
>>> redirecting stdout and stderr.
>>>
>>> Here were my steps to start and check the process status:
>>>
>>> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
>>> cloudstack-agent start
>>>  * Starting CloudStack Agent cloudstack-agent
>>>  [ OK ]
>>> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ps -ef | grep jsvc
>>> 1000  4605  3725  0 16:47 pts/100:00:00 grep --color=auto jsvc
>>>
>>> Also, this might be of interest:
>>>
>>> mtutkowski@ubuntu:/etc/cloudstack/agent$ lsmod | grep kvm
>>> kvm_intel 137721  0
>>> kvm   415549  1 kvm_intel
>>>
>>> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c '(vmx|svm)'
>>> /proc/cpuinfo
>>> 1
>>>
>>> mtutkowski@ubuntu:/etc/cloudstack/agent$ kvm-ok
>>> INFO: /dev/kvm exists
>>> KVM acceleration can be used
>>>
>>> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c ' lm ' /proc/cpuinfo
>>> 1
>>>
>>> On Wed, Sep 25, 2013 at 4:39 PM, Marcus Sorensen wrote:
>>>
 So you:

 1. run that command
 2. get a brand new agent.properties as a result
 3. start the service

 but you don't see it in the process table?

 The agent's STDOUT doesn't go to the agent log, only log4j stuff. So
 if there were an error not printed via logger you'd not see it.  I'm
 not as familiar with the debian/ubuntu stuff off the top of my head,
 but in /etc/init.d/cloudstack-agent on CentOS we do:

 start() {
 echo -n $"Starting $PROGNAME: "
 if hostname --fqdn >/dev/null 2>&1 ; then
 $JSVC -cp "$CLASSPATH" -pidfile "$PIDFILE" \
 -errfile $LOGDIR/cloudstack-agent.err -outfile
 $LOGDIR/cloudstack-agent.out $CLASS
 RETVAL=$?
 echo
 else


 Which sends STDOUT to cloudstack-agent.out and errors to
 cloudstack-agent.err. You can look to see what Ubuntu does.

 Out of curiosity, what do you get when you do 'lsmod | grep kvm' ? I
 know you didn't end up using it, but the devcloud-kvm instructions for
 vmware fusion tell you to ensure that your guest has hardware
 virtualization passthrough enabled, I'm wondering if it isn't.

 On Wed, Sep 25, 2013 at 4:11 PM, Mike Tutkowski
  wrote:
 > These results look good:
 >
 > mtutkowski@ubuntu:~$ sudo cloudstack-setup-agent -m 192.168.233.1 -z 1
 -p 1
 > -c 1 -g 6b4aa1c2-2ac9-3c60-aabe-704aed40c684 -a --pubNic=cloudbr0
 > --prvNic=cloudbr0 --guestNic=cloudbr0
 > Starting to configure your system:
 > Configure Apparmor ...[OK]
 > Configure Network ... [OK]
 > Configure Libvirt ... [OK]
 > Configure Firewall ...[OK]
 > Configure Nfs ... [OK]
 > Configure cloudAgent ...  [OK]
 > CloudStack Agent setup is done!
 >
 > However, these results are the same:
 >
 > mtutkowski@ubuntu:~$ ps -ef | grep jsvc
 > 1000  4314  3725  0 16:10 pts/100:00:00 grep --color=auto jsvc
 >
 >
 > On Wed, Sep 25, 2013 at 3:48 PM, Mike Tutkowski <
 > mike.tutkow...@solidfire.com> wrote:
 >
 >> This appears to be the offending method:
 >>
 >> public String parseCapabilitiesXML(String capXML) {
 >>
 >> if (!_initialized)

Re: Managed storage with KVM

[Mike Tutkowski]

Sounds good.

Thanks, Marcus! :)


On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen wrote:

> Ok, so the next step is to track that stdout and see if you can see
> what jsvc complains about when it fails to start up the service.
>
> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
>  wrote:
> > These also look good:
> >
> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
> > x86_64
> > mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system list
> >  Id Name State
> > --
> >
> > mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
> > /var/run/libvirt/libvirt-sock
> > srwxrwx--- 1 root libvirtd 0 Sep 25 16:05 /var/run/libvirt/libvirt-sock
> > mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
> > crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
> >
> >
> >
> > On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
> > mike.tutkow...@solidfire.com> wrote:
> >
> >> This is my new agent.properties file (with comments removed...looks
> >> decent):
> >>
> >> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
> >> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
> >> workers=5
> >> host=192.168.233.1
> >> port=8250
> >> cluster=1
> >> pod=1
> >> zone=1
> >> local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
> >> private.network.device=cloudbr0
> >> public.network.device=cloudbr0
> >> guest.network.device=cloudbr0
> >>
> >> Yeah, I was always writing stuff out using the logger. I should look
> into
> >> redirecting stdout and stderr.
> >>
> >> Here were my steps to start and check the process status:
> >>
> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
> >> cloudstack-agent start
> >>  * Starting CloudStack Agent cloudstack-agent
> >>  [ OK ]
> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ps -ef | grep jsvc
> >> 1000  4605  3725  0 16:47 pts/100:00:00 grep --color=auto jsvc
> >>
> >> Also, this might be of interest:
> >>
> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ lsmod | grep kvm
> >> kvm_intel 137721  0
> >> kvm   415549  1 kvm_intel
> >>
> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c '(vmx|svm)'
> >> /proc/cpuinfo
> >> 1
> >>
> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ kvm-ok
> >> INFO: /dev/kvm exists
> >> KVM acceleration can be used
> >>
> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c ' lm ' /proc/cpuinfo
> >> 1
> >>
> >> On Wed, Sep 25, 2013 at 4:39 PM, Marcus Sorensen  >wrote:
> >>
> >>> So you:
> >>>
> >>> 1. run that command
> >>> 2. get a brand new agent.properties as a result
> >>> 3. start the service
> >>>
> >>> but you don't see it in the process table?
> >>>
> >>> The agent's STDOUT doesn't go to the agent log, only log4j stuff. So
> >>> if there were an error not printed via logger you'd not see it.  I'm
> >>> not as familiar with the debian/ubuntu stuff off the top of my head,
> >>> but in /etc/init.d/cloudstack-agent on CentOS we do:
> >>>
> >>> start() {
> >>> echo -n $"Starting $PROGNAME: "
> >>> if hostname --fqdn >/dev/null 2>&1 ; then
> >>> $JSVC -cp "$CLASSPATH" -pidfile "$PIDFILE" \
> >>> -errfile $LOGDIR/cloudstack-agent.err -outfile
> >>> $LOGDIR/cloudstack-agent.out $CLASS
> >>> RETVAL=$?
> >>> echo
> >>> else
> >>>
> >>>
> >>> Which sends STDOUT to cloudstack-agent.out and errors to
> >>> cloudstack-agent.err. You can look to see what Ubuntu does.
> >>>
> >>> Out of curiosity, what do you get when you do 'lsmod | grep kvm' ? I
> >>> know you didn't end up using it, but the devcloud-kvm instructions for
> >>> vmware fusion tell you to ensure that your guest has hardware
> >>> virtualization passthrough enabled, I'm wondering if it isn't.
> >>>
> >>> On Wed, Sep 25, 2013 at 4:11 PM, Mike Tutkowski
> >>>  wrote:
> >>> > These results look good:
> >>> >
> >>> > mtutkowski@ubuntu:~$ sudo cloudstack-setup-agent -m 192.168.233.1
> -z 1
> >>> -p 1
> >>> > -c 1 -g 6b4aa1c2-2ac9-3c60-aabe-704aed40c684 -a --pubNic=cloudbr0
> >>> > --prvNic=cloudbr0 --guestNic=cloudbr0
> >>> > Starting to configure your system:
> >>> > Configure Apparmor ...[OK]
> >>> > Configure Network ... [OK]
> >>> > Configure Libvirt ... [OK]
> >>> > Configure Firewall ...[OK]
> >>> > Configure Nfs ... [OK]
> >>> > Configure cloudAgent ...  [OK]
> >>> > CloudStack Agent setup is done!
> >>> >
> >>> > However, these results are the same:
> >>> >
> >>> > mtutkowski@ubuntu:~$ ps -ef | grep jsvc
> >>> > 1000  4314  3725  0 16:10 pts/100:00:00 grep --color=auto
> jsvc
> >>> >
> >>> >
> >>> > On Wed, Sep 25, 2013 at 3:48 PM, Mike Tutkowski <
> >>> > mike.tutkow...@solidfire.com> wrote:
> >>> >
> >>> >> This appears to be the offending method:
> >>> >>
> >>> >> public String parseCapabilitiesXML(String capXML) {
> >>> >>
> >>> >> if (!_initialized) {
> >>> >>
> >>> >> return null;
> >>> >>
> >>> >>  

RE: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth round)

[Animesh Chaturvedi]

> -Original Message-
> From: Chip Childers [mailto:chip.child...@sungard.com]
> Sent: Tuesday, September 24, 2013 9:22 AM
> To: dev@cloudstack.apache.org
> Cc: Animesh Chaturvedi
> Subject: Re: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth
> round)
> 
> On Tue, Sep 24, 2013 at 04:21:19AM +, Animesh Chaturvedi wrote:
> >
> >
> >  This vote has passed with no -1 votes.
> >
> >  +1 votes were from (with * binding):
> >  Chiradeep*, Hugo*, Chip*, Milamber,  Amogh
> >
> >  +0: Marcus*
> >
> >  Marcus agreed to change his VOTE to +1 with a Release Note change
> > that  he will make.
> >
> >  Wido can you build and publish  the .deb packages
> 
> Animesh,
> 
> Just to help get things clearly listed, here are the todo's that I see
> for 4.2:
> 
> 1 - Finish the docs (release notes especially) and publish them to
> cloudstack.apache.org/docs
> 
>   *We need someone to own this*
[Animesh>] David I fixed up the ReleaseNotes and tried to follow the 
instruction on building the docs but not clear on few steps. Can you finish it 
up.
> 
> 2 - Build the DEB packages
> 
>   Wido has this one
> 
> 3 - Build the RPM packages
> 
>   *We need someone to own this one*
> 
> 4 - Move the source artifacts from dist/dev to dist/release and stage
> the download page changes
> 
>   A PMC member needs to do this.  I'll take this one.
> 
> 5 - Finish the release announcement
> 
>   This was started by Mathias here:
> 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/4.2+Release+Annou
> ncement
> 
>   It should really be finished.
> 
>   *Someone needs to own finalizing this.*
[Animesh>] David, Chip Mathias has incorporated the comments received so far. 
What is pending here? The feature description is brief should we add more 
details?
> 
> 6 - Publish the website and announce the release (using the finished
> announcement) after 1 through 5 are done.
> 
>   This can be any committer, but Animesh you'd probably want the honors!
> 
> 
> There are also other marketing related things to get done, but that
> thread started on marketing@ and can happen after / in parallel to the
> work listed above.
> 
> -chip

ubuntu LTS for system vm? and 64bit?

[Darren Shepherd]

Is there any technical reason why we couldn't use ubuntu LTS (12.04
and soon to be 14.04) for the system VM.  Additionally is there any
technical reason we couldn't switch to 64bit.  I don't necesarily want
to get into "fight for you favorite distro" discussion, just curious.

Darren

Re: Managed storage with KVM

[Mike Tutkowski]

I basically just leveraged the code you provided to redirect the output on
Ubuntu.

Here is the standard err:

log4j:WARN No appenders could be found for logger
(org.apache.commons.httpclient.params.DefaultHttpParams).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
more info.
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
at org.libvirt.Library.free(Unknown Source)
at org.libvirt.Connect.getCapabilities(Unknown Source)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
at com.cloud.agent.Agent.(Agent.java:168)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
at com.cloud.agent.AgentShell.start(AgentShell.java:473)
... 5 more
Cannot start daemon
Service exit with a return value of 5


On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> Sounds good.
>
> Thanks, Marcus! :)
>
>
> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen wrote:
>
>> Ok, so the next step is to track that stdout and see if you can see
>> what jsvc complains about when it fails to start up the service.
>>
>> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
>>  wrote:
>> > These also look good:
>> >
>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
>> > x86_64
>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system list
>> >  Id Name State
>> > --
>> >
>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
>> > /var/run/libvirt/libvirt-sock
>> > srwxrwx--- 1 root libvirtd 0 Sep 25 16:05 /var/run/libvirt/libvirt-sock
>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
>> > crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
>> >
>> >
>> >
>> > On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
>> > mike.tutkow...@solidfire.com> wrote:
>> >
>> >> This is my new agent.properties file (with comments removed...looks
>> >> decent):
>> >>
>> >> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
>> >> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
>> >> workers=5
>> >> host=192.168.233.1
>> >> port=8250
>> >> cluster=1
>> >> pod=1
>> >> zone=1
>> >> local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
>> >> private.network.device=cloudbr0
>> >> public.network.device=cloudbr0
>> >> guest.network.device=cloudbr0
>> >>
>> >> Yeah, I was always writing stuff out using the logger. I should look
>> into
>> >> redirecting stdout and stderr.
>> >>
>> >> Here were my steps to start and check the process status:
>> >>
>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
>> >> cloudstack-agent start
>> >>  * Starting CloudStack Agent cloudstack-agent
>> >>  [ OK ]
>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ps -ef | grep jsvc
>> >> 1000  4605  3725  0 16:47 pts/100:00:00 grep --color=auto jsvc
>> >>
>> >> Also, this might be of interest:
>> >>
>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ lsmod | grep kvm
>> >> kvm_intel 137721  0
>> >> kvm   415549  1 kvm_intel
>> >>
>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c '(vmx|svm)'
>> >> /proc/cpuinfo
>> >> 1
>> >>
>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ kvm-ok
>> >> INFO: /dev/kvm exists
>> >> KVM acceleration can be used
>> >>
>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c ' lm ' /proc/cpuinfo
>> >> 1
>> >>
>> >> On Wed, Sep 25, 2013 at 4:39 PM, Marcus Sorensen > >wrote:
>> >>
>> >>> So you:
>> >>>
>> >>> 1. run that command
>> >>> 2. get a brand new agent.properties as a result
>> >>> 3. start the service
>> >>>
>> >>> but you don't see it in the process table?
>> >>>
>> >>> The agent's STDOUT doesn't go to the agent log, only log4j stuff. So
>> >>> if there were an error not printed via logger you'd not see it.  I'm
>> >>> not as familiar with the debian/ubuntu stuff off the top of my head,
>> >>> but in /etc/init.d/cloudstack-agent on CentOS we do:
>> >>>
>> >>> start() {
>> >>> echo -n $"Starting $PROGNAME: "
>> >>> if hostname --fqdn >/dev/null 2>&1 ; then
>> >>> $JSVC -cp "$CLASSPATH" -pidfile "$PIDFILE" \
>> >>> -errfile $LOGDIR/cloudstack-agent.err -outfile
>> >>> $LOGDIR/cloudstack-agent.out $CLAS

Re: Review Request 14075: Added new test for Load balancing rules in a VPC

[Sheng Yang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14075/#review26398
---


Already committed by Swamy: 

commit e49f14b7e3d6992ee77d40d3b6629f975ee6b9fb
Author: Ashutosh K 
Date:   Tue Sep 10 09:53:19 2013 +0530

Added missing test for VPC load balancing rule from old QA repo to 
cloudstack repo

def test_04_VPC_CreateLBRuleInMultipleNetworksVRStoppedState

Since VPC now only allows load balancing on a single tier the test case
has been updated to check that condition

Ref : 
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.2/html/Installation_Guide/configure-vpc.html

Signed-off-by: venkataswamybabu budumuru 

(cherry picked from commit 5b5a617544fb8160b9429a24f1aa943e04d4f98a)


- Sheng Yang


On Sept. 18, 2013, 2:28 p.m., Ashutosh Kelkar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14075/
> ---
> 
> (Updated Sept. 18, 2013, 2:28 p.m.)
> 
> 
> Review request for cloudstack, Girish Shilamkar, venkata swamy babu  
> budumuru, and Prasanna Santhanam.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added missing test for VPC load balancing rule from old QA repo to cloudstack 
> repo
> 
> def test_04_VPC_CreateLBRuleInMultipleNetworksVRStoppedState
> 
> Since VPC now only allows load balancing on a single tier the test case
> has been updated to check that condition
> 
> 
> Diffs
> -
> 
>   test/integration/component/test_vpc_network_lbrules.py de29ce1 
> 
> Diff: https://reviews.apache.org/r/14075/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Ashutosh Kelkar
> 
>

Re: Managed storage with KVM

[Marcus Sorensen]

are you missing the jna packages?

On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
 wrote:
> I basically just leveraged the code you provided to redirect the output on
> Ubuntu.
>
> Here is the standard err:
>
> log4j:WARN No appenders could be found for logger
> (org.apache.commons.httpclient.params.DefaultHttpParams).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
> Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
> at org.libvirt.Library.free(Unknown Source)
> at org.libvirt.Connect.getCapabilities(Unknown Source)
> at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
> at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
> at com.cloud.agent.Agent.(Agent.java:168)
> at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
> at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
> at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
> at com.cloud.agent.AgentShell.start(AgentShell.java:473)
> ... 5 more
> Cannot start daemon
> Service exit with a return value of 5
>
>
> On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> Sounds good.
>>
>> Thanks, Marcus! :)
>>
>>
>> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen wrote:
>>
>>> Ok, so the next step is to track that stdout and see if you can see
>>> what jsvc complains about when it fails to start up the service.
>>>
>>> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
>>>  wrote:
>>> > These also look good:
>>> >
>>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
>>> > x86_64
>>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system list
>>> >  Id Name State
>>> > --
>>> >
>>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
>>> > /var/run/libvirt/libvirt-sock
>>> > srwxrwx--- 1 root libvirtd 0 Sep 25 16:05 /var/run/libvirt/libvirt-sock
>>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
>>> > crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
>>> >
>>> >
>>> >
>>> > On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
>>> > mike.tutkow...@solidfire.com> wrote:
>>> >
>>> >> This is my new agent.properties file (with comments removed...looks
>>> >> decent):
>>> >>
>>> >> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
>>> >> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
>>> >> workers=5
>>> >> host=192.168.233.1
>>> >> port=8250
>>> >> cluster=1
>>> >> pod=1
>>> >> zone=1
>>> >> local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
>>> >> private.network.device=cloudbr0
>>> >> public.network.device=cloudbr0
>>> >> guest.network.device=cloudbr0
>>> >>
>>> >> Yeah, I was always writing stuff out using the logger. I should look
>>> into
>>> >> redirecting stdout and stderr.
>>> >>
>>> >> Here were my steps to start and check the process status:
>>> >>
>>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
>>> >> cloudstack-agent start
>>> >>  * Starting CloudStack Agent cloudstack-agent
>>> >>  [ OK ]
>>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ps -ef | grep jsvc
>>> >> 1000  4605  3725  0 16:47 pts/100:00:00 grep --color=auto jsvc
>>> >>
>>> >> Also, this might be of interest:
>>> >>
>>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ lsmod | grep kvm
>>> >> kvm_intel 137721  0
>>> >> kvm   415549  1 kvm_intel
>>> >>
>>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c '(vmx|svm)'
>>> >> /proc/cpuinfo
>>> >> 1
>>> >>
>>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ kvm-ok
>>> >> INFO: /dev/kvm exists
>>> >> KVM acceleration can be used
>>> >>
>>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c ' lm ' /proc/cpuinfo
>>> >> 1
>>> >>
>>> >> On Wed, Sep 25, 2013 at 4:39 PM, Marcus Sorensen >> >wrote:
>>> >>
>>> >>> So you:
>>> >>>
>>> >>> 1. run that command
>>> >>> 2. get a brand new agent.properties as a result
>>> >>> 3. start the service
>>> >>>
>>> >>> but you don't see it in the process table?
>>> >>>
>>> >>> The agent's STDOUT doesn't go to the agent log, only log4j stuff. So
>>> >>> if there were an error not printed via logger you'd not see it.  I'm
>>> >>> not as familiar with the debian/ubuntu stuff off the top of my head,
>>> >>> but in /etc/init.d/cloudstack-agent on CentOS we do:
>>> >>>
>>> >>> start() {
>>> >

Re: Managed storage with KVM

[Mike Tutkowski]

Was there a step in the docs I may have missed where I was to install them?
I don't recall installing them, but there are several steps and I might
have forgotten that I did install them, too.

I can check.


On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen wrote:

> are you missing the jna packages?
>
> On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
>  wrote:
> > I basically just leveraged the code you provided to redirect the output
> on
> > Ubuntu.
> >
> > Here is the standard err:
> >
> > log4j:WARN No appenders could be found for logger
> > (org.apache.commons.httpclient.params.DefaultHttpParams).
> > log4j:WARN Please initialize the log4j system properly.
> > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> > more info.
> > java.lang.reflect.InvocationTargetException
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
> > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
> > at org.libvirt.Library.free(Unknown Source)
> > at org.libvirt.Connect.getCapabilities(Unknown Source)
> > at
> >
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
> > at
> >
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
> > at com.cloud.agent.Agent.(Agent.java:168)
> > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
> > at
> com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
> > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
> > at com.cloud.agent.AgentShell.start(AgentShell.java:473)
> > ... 5 more
> > Cannot start daemon
> > Service exit with a return value of 5
> >
> >
> > On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
> > mike.tutkow...@solidfire.com> wrote:
> >
> >> Sounds good.
> >>
> >> Thanks, Marcus! :)
> >>
> >>
> >> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen  >wrote:
> >>
> >>> Ok, so the next step is to track that stdout and see if you can see
> >>> what jsvc complains about when it fails to start up the service.
> >>>
> >>> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
> >>>  wrote:
> >>> > These also look good:
> >>> >
> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
> >>> > x86_64
> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system
> list
> >>> >  Id Name State
> >>> > --
> >>> >
> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
> >>> > /var/run/libvirt/libvirt-sock
> >>> > srwxrwx--- 1 root libvirtd 0 Sep 25 16:05
> /var/run/libvirt/libvirt-sock
> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
> >>> > crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
> >>> >
> >>> >
> >>> >
> >>> > On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
> >>> > mike.tutkow...@solidfire.com> wrote:
> >>> >
> >>> >> This is my new agent.properties file (with comments removed...looks
> >>> >> decent):
> >>> >>
> >>> >> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
> >>> >> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
> >>> >> workers=5
> >>> >> host=192.168.233.1
> >>> >> port=8250
> >>> >> cluster=1
> >>> >> pod=1
> >>> >> zone=1
> >>> >> local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
> >>> >> private.network.device=cloudbr0
> >>> >> public.network.device=cloudbr0
> >>> >> guest.network.device=cloudbr0
> >>> >>
> >>> >> Yeah, I was always writing stuff out using the logger. I should look
> >>> into
> >>> >> redirecting stdout and stderr.
> >>> >>
> >>> >> Here were my steps to start and check the process status:
> >>> >>
> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
> >>> >> cloudstack-agent start
> >>> >>  * Starting CloudStack Agent cloudstack-agent
> >>> >>  [ OK ]
> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ps -ef | grep jsvc
> >>> >> 1000  4605  3725  0 16:47 pts/100:00:00 grep --color=auto
> jsvc
> >>> >>
> >>> >> Also, this might be of interest:
> >>> >>
> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ lsmod | grep kvm
> >>> >> kvm_intel 137721  0
> >>> >> kvm   415549  1 kvm_intel
> >>> >>
> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c '(vmx|svm)'
> >>> >> /proc/cpuinfo
> >>> >> 1
> >>> >>
> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ kvm-ok
> >>> >> INFO: /dev/kvm exists
> >>> >> KVM acceleration can be used
> >>> >>
> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c ' lm '
> /proc/cpuinfo
> >>> >> 1
> >>> >>
> >>> >> On Wed, Sep 25, 2013 at 4:39 PM, Marcus Sorensen <
> shadow...@

Re: Managed storage with KVM

[Mike Tutkowski]

mtutkowski@ubuntu:~$ sudo apt-get install libjna-java
Reading package lists... Done
Building dependency tree
Reading state information... Done
libjna-java is already the newest version.
libjna-java set to manually installed.
0 upgraded, 0 newly installed, 0 to remove and 468 not upgraded.


On Wed, Sep 25, 2013 at 5:46 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> Was there a step in the docs I may have missed where I was to install
> them? I don't recall installing them, but there are several steps and I
> might have forgotten that I did install them, too.
>
> I can check.
>
>
> On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen wrote:
>
>> are you missing the jna packages?
>>
>> On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
>>  wrote:
>> > I basically just leveraged the code you provided to redirect the output
>> on
>> > Ubuntu.
>> >
>> > Here is the standard err:
>> >
>> > log4j:WARN No appenders could be found for logger
>> > (org.apache.commons.httpclient.params.DefaultHttpParams).
>> > log4j:WARN Please initialize the log4j system properly.
>> > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfigfor
>> > more info.
>> > java.lang.reflect.InvocationTargetException
>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > at
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> > at
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > at java.lang.reflect.Method.invoke(Method.java:606)
>> > at
>> >
>> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
>> > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
>> > at org.libvirt.Library.free(Unknown Source)
>> > at org.libvirt.Connect.getCapabilities(Unknown Source)
>> > at
>> >
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
>> > at
>> >
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
>> > at com.cloud.agent.Agent.(Agent.java:168)
>> > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
>> > at
>> com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
>> > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
>> > at com.cloud.agent.AgentShell.start(AgentShell.java:473)
>> > ... 5 more
>> > Cannot start daemon
>> > Service exit with a return value of 5
>> >
>> >
>> > On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
>> > mike.tutkow...@solidfire.com> wrote:
>> >
>> >> Sounds good.
>> >>
>> >> Thanks, Marcus! :)
>> >>
>> >>
>> >> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen > >wrote:
>> >>
>> >>> Ok, so the next step is to track that stdout and see if you can see
>> >>> what jsvc complains about when it fails to start up the service.
>> >>>
>> >>> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
>> >>>  wrote:
>> >>> > These also look good:
>> >>> >
>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
>> >>> > x86_64
>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system
>> list
>> >>> >  Id Name State
>> >>> > --
>> >>> >
>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
>> >>> > /var/run/libvirt/libvirt-sock
>> >>> > srwxrwx--- 1 root libvirtd 0 Sep 25 16:05
>> /var/run/libvirt/libvirt-sock
>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
>> >>> > crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
>> >>> >
>> >>> >
>> >>> >
>> >>> > On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
>> >>> > mike.tutkow...@solidfire.com> wrote:
>> >>> >
>> >>> >> This is my new agent.properties file (with comments removed...looks
>> >>> >> decent):
>> >>> >>
>> >>> >> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
>> >>> >> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
>> >>> >> workers=5
>> >>> >> host=192.168.233.1
>> >>> >> port=8250
>> >>> >> cluster=1
>> >>> >> pod=1
>> >>> >> zone=1
>> >>> >> local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
>> >>> >> private.network.device=cloudbr0
>> >>> >> public.network.device=cloudbr0
>> >>> >> guest.network.device=cloudbr0
>> >>> >>
>> >>> >> Yeah, I was always writing stuff out using the logger. I should
>> look
>> >>> into
>> >>> >> redirecting stdout and stderr.
>> >>> >>
>> >>> >> Here were my steps to start and check the process status:
>> >>> >>
>> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
>> >>> >> cloudstack-agent start
>> >>> >>  * Starting CloudStack Agent cloudstack-agent
>> >>> >>  [ OK ]
>> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ps -ef | grep jsvc
>> >>> >> 1000  4605  3725  0 16:47 pts/100:00:00 grep --color=auto
>> jsvc
>> >>> >>
>> >>> >> Also, this might be of interest:
>> >>> >>
>> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ lsmod | grep kvm
>> >>> >> k

Re: Managed storage with KVM

[Marcus Sorensen]

Again, not so  familiar with Ubuntu. I'd imagine that jna would be set
up as a dependency to the .deb packages.

sudo apt-get install libjna-java

On Wed, Sep 25, 2013 at 5:46 PM, Mike Tutkowski
 wrote:
> Was there a step in the docs I may have missed where I was to install them?
> I don't recall installing them, but there are several steps and I might
> have forgotten that I did install them, too.
>
> I can check.
>
>
> On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen wrote:
>
>> are you missing the jna packages?
>>
>> On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
>>  wrote:
>> > I basically just leveraged the code you provided to redirect the output
>> on
>> > Ubuntu.
>> >
>> > Here is the standard err:
>> >
>> > log4j:WARN No appenders could be found for logger
>> > (org.apache.commons.httpclient.params.DefaultHttpParams).
>> > log4j:WARN Please initialize the log4j system properly.
>> > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
>> > more info.
>> > java.lang.reflect.InvocationTargetException
>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > at
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> > at
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > at java.lang.reflect.Method.invoke(Method.java:606)
>> > at
>> >
>> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
>> > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
>> > at org.libvirt.Library.free(Unknown Source)
>> > at org.libvirt.Connect.getCapabilities(Unknown Source)
>> > at
>> >
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
>> > at
>> >
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
>> > at com.cloud.agent.Agent.(Agent.java:168)
>> > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
>> > at
>> com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
>> > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
>> > at com.cloud.agent.AgentShell.start(AgentShell.java:473)
>> > ... 5 more
>> > Cannot start daemon
>> > Service exit with a return value of 5
>> >
>> >
>> > On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
>> > mike.tutkow...@solidfire.com> wrote:
>> >
>> >> Sounds good.
>> >>
>> >> Thanks, Marcus! :)
>> >>
>> >>
>> >> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen > >wrote:
>> >>
>> >>> Ok, so the next step is to track that stdout and see if you can see
>> >>> what jsvc complains about when it fails to start up the service.
>> >>>
>> >>> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
>> >>>  wrote:
>> >>> > These also look good:
>> >>> >
>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
>> >>> > x86_64
>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system
>> list
>> >>> >  Id Name State
>> >>> > --
>> >>> >
>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
>> >>> > /var/run/libvirt/libvirt-sock
>> >>> > srwxrwx--- 1 root libvirtd 0 Sep 25 16:05
>> /var/run/libvirt/libvirt-sock
>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
>> >>> > crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
>> >>> >
>> >>> >
>> >>> >
>> >>> > On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
>> >>> > mike.tutkow...@solidfire.com> wrote:
>> >>> >
>> >>> >> This is my new agent.properties file (with comments removed...looks
>> >>> >> decent):
>> >>> >>
>> >>> >> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
>> >>> >> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
>> >>> >> workers=5
>> >>> >> host=192.168.233.1
>> >>> >> port=8250
>> >>> >> cluster=1
>> >>> >> pod=1
>> >>> >> zone=1
>> >>> >> local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
>> >>> >> private.network.device=cloudbr0
>> >>> >> public.network.device=cloudbr0
>> >>> >> guest.network.device=cloudbr0
>> >>> >>
>> >>> >> Yeah, I was always writing stuff out using the logger. I should look
>> >>> into
>> >>> >> redirecting stdout and stderr.
>> >>> >>
>> >>> >> Here were my steps to start and check the process status:
>> >>> >>
>> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
>> >>> >> cloudstack-agent start
>> >>> >>  * Starting CloudStack Agent cloudstack-agent
>> >>> >>  [ OK ]
>> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ps -ef | grep jsvc
>> >>> >> 1000  4605  3725  0 16:47 pts/100:00:00 grep --color=auto
>> jsvc
>> >>> >>
>> >>> >> Also, this might be of interest:
>> >>> >>
>> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ lsmod | grep kvm
>> >>> >> kvm_intel 137721  0
>> >>> >> kvm   415549  1 kvm_intel
>> >>> >>
>> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ egrep -c '(vmx|svm)'
>> >>> >> /pro

Re: Managed storage with KVM

[Marcus Sorensen]

ok, just a guess. I'm assuming it's still this:

Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V

On Wed, Sep 25, 2013 at 5:48 PM, Mike Tutkowski
 wrote:
> mtutkowski@ubuntu:~$ sudo apt-get install libjna-java
> Reading package lists... Done
> Building dependency tree
> Reading state information... Done
> libjna-java is already the newest version.
> libjna-java set to manually installed.
> 0 upgraded, 0 newly installed, 0 to remove and 468 not upgraded.
>
>
> On Wed, Sep 25, 2013 at 5:46 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> Was there a step in the docs I may have missed where I was to install
>> them? I don't recall installing them, but there are several steps and I
>> might have forgotten that I did install them, too.
>>
>> I can check.
>>
>>
>> On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen wrote:
>>
>>> are you missing the jna packages?
>>>
>>> On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
>>>  wrote:
>>> > I basically just leveraged the code you provided to redirect the output
>>> on
>>> > Ubuntu.
>>> >
>>> > Here is the standard err:
>>> >
>>> > log4j:WARN No appenders could be found for logger
>>> > (org.apache.commons.httpclient.params.DefaultHttpParams).
>>> > log4j:WARN Please initialize the log4j system properly.
>>> > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfigfor
>>> > more info.
>>> > java.lang.reflect.InvocationTargetException
>>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> > at
>>> >
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>> > at
>>> >
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> > at java.lang.reflect.Method.invoke(Method.java:606)
>>> > at
>>> >
>>> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
>>> > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
>>> > at org.libvirt.Library.free(Unknown Source)
>>> > at org.libvirt.Connect.getCapabilities(Unknown Source)
>>> > at
>>> >
>>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
>>> > at
>>> >
>>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
>>> > at com.cloud.agent.Agent.(Agent.java:168)
>>> > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
>>> > at
>>> com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
>>> > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
>>> > at com.cloud.agent.AgentShell.start(AgentShell.java:473)
>>> > ... 5 more
>>> > Cannot start daemon
>>> > Service exit with a return value of 5
>>> >
>>> >
>>> > On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
>>> > mike.tutkow...@solidfire.com> wrote:
>>> >
>>> >> Sounds good.
>>> >>
>>> >> Thanks, Marcus! :)
>>> >>
>>> >>
>>> >> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen >> >wrote:
>>> >>
>>> >>> Ok, so the next step is to track that stdout and see if you can see
>>> >>> what jsvc complains about when it fails to start up the service.
>>> >>>
>>> >>> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
>>> >>>  wrote:
>>> >>> > These also look good:
>>> >>> >
>>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
>>> >>> > x86_64
>>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system
>>> list
>>> >>> >  Id Name State
>>> >>> > --
>>> >>> >
>>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
>>> >>> > /var/run/libvirt/libvirt-sock
>>> >>> > srwxrwx--- 1 root libvirtd 0 Sep 25 16:05
>>> /var/run/libvirt/libvirt-sock
>>> >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
>>> >>> > crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
>>> >>> >
>>> >>> >
>>> >>> >
>>> >>> > On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
>>> >>> > mike.tutkow...@solidfire.com> wrote:
>>> >>> >
>>> >>> >> This is my new agent.properties file (with comments removed...looks
>>> >>> >> decent):
>>> >>> >>
>>> >>> >> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
>>> >>> >> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
>>> >>> >> workers=5
>>> >>> >> host=192.168.233.1
>>> >>> >> port=8250
>>> >>> >> cluster=1
>>> >>> >> pod=1
>>> >>> >> zone=1
>>> >>> >> local.storage.uuid=aced86a2-2dd6-450a-93e5-1bc0ec3c73be
>>> >>> >> private.network.device=cloudbr0
>>> >>> >> public.network.device=cloudbr0
>>> >>> >> guest.network.device=cloudbr0
>>> >>> >>
>>> >>> >> Yeah, I was always writing stuff out using the logger. I should
>>> look
>>> >>> into
>>> >>> >> redirecting stdout and stderr.
>>> >>> >>
>>> >>> >> Here were my steps to start and check the process status:
>>> >>> >>
>>> >>> >> mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service
>>> >>> >> cloudstack-agent start
>>> >>> >>  * Starting CloudStack Agent cloudstack-agent
>>> >>> >>   

Re: Managed storage with KVM

[Marcus Sorensen]

It's harder still that you're trying to use master. I know 4.2 works
on ubuntu, but master is a minefield sometimes. Maybe that's not the
problem, but I do see emails going back and forth about libvirt/jna
versions, just need to read them in detail.

 It's a shame that you haven't gotten a working config up yet prior to
development work (say a 4.2 that we know works), because we don't have
any clues as to whether it's your setup or master.

On Wed, Sep 25, 2013 at 5:49 PM, Marcus Sorensen  wrote:
> ok, just a guess. I'm assuming it's still this:
>
> Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
>
> On Wed, Sep 25, 2013 at 5:48 PM, Mike Tutkowski
>  wrote:
>> mtutkowski@ubuntu:~$ sudo apt-get install libjna-java
>> Reading package lists... Done
>> Building dependency tree
>> Reading state information... Done
>> libjna-java is already the newest version.
>> libjna-java set to manually installed.
>> 0 upgraded, 0 newly installed, 0 to remove and 468 not upgraded.
>>
>>
>> On Wed, Sep 25, 2013 at 5:46 PM, Mike Tutkowski <
>> mike.tutkow...@solidfire.com> wrote:
>>
>>> Was there a step in the docs I may have missed where I was to install
>>> them? I don't recall installing them, but there are several steps and I
>>> might have forgotten that I did install them, too.
>>>
>>> I can check.
>>>
>>>
>>> On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen wrote:
>>>
 are you missing the jna packages?

 On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
  wrote:
 > I basically just leveraged the code you provided to redirect the output
 on
 > Ubuntu.
 >
 > Here is the standard err:
 >
 > log4j:WARN No appenders could be found for logger
 > (org.apache.commons.httpclient.params.DefaultHttpParams).
 > log4j:WARN Please initialize the log4j system properly.
 > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfigfor
 > more info.
 > java.lang.reflect.InvocationTargetException
 > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 > at
 >
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
 > at
 >
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 > at java.lang.reflect.Method.invoke(Method.java:606)
 > at
 >
 org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
 > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
 > at org.libvirt.Library.free(Unknown Source)
 > at org.libvirt.Connect.getCapabilities(Unknown Source)
 > at
 >
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
 > at
 >
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
 > at com.cloud.agent.Agent.(Agent.java:168)
 > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
 > at
 com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
 > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
 > at com.cloud.agent.AgentShell.start(AgentShell.java:473)
 > ... 5 more
 > Cannot start daemon
 > Service exit with a return value of 5
 >
 >
 > On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
 > mike.tutkow...@solidfire.com> wrote:
 >
 >> Sounds good.
 >>
 >> Thanks, Marcus! :)
 >>
 >>
 >> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen >>> >wrote:
 >>
 >>> Ok, so the next step is to track that stdout and see if you can see
 >>> what jsvc complains about when it fails to start up the service.
 >>>
 >>> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
 >>>  wrote:
 >>> > These also look good:
 >>> >
 >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
 >>> > x86_64
 >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c qemu:///system
 list
 >>> >  Id Name State
 >>> > --
 >>> >
 >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
 >>> > /var/run/libvirt/libvirt-sock
 >>> > srwxrwx--- 1 root libvirtd 0 Sep 25 16:05
 /var/run/libvirt/libvirt-sock
 >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
 >>> > crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
 >>> >
 >>> >
 >>> >
 >>> > On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
 >>> > mike.tutkow...@solidfire.com> wrote:
 >>> >
 >>> >> This is my new agent.properties file (with comments removed...looks
 >>> >> decent):
 >>> >>
 >>> >> guid=6b4aa1c2-2ac9-3c60-aabe-704aed40c684
 >>> >> resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource
 >>> >> workers=5
 >>> >> host=192.168.233.1
 >>> >> port=8250
 >>> >> cluster=1
 >>> >> pod=1
 >>> >> zone=1
 >>> >> local.storage.uui

Re: Managed storage with KVM

[Mike Tutkowski]

I can switch my branch over to master. I'm afraid master is not working
with Libvirt on Ubuntu, as well.


On Wed, Sep 25, 2013 at 5:55 PM, Marcus Sorensen wrote:

> It's harder still that you're trying to use master. I know 4.2 works
> on ubuntu, but master is a minefield sometimes. Maybe that's not the
> problem, but I do see emails going back and forth about libvirt/jna
> versions, just need to read them in detail.
>
>  It's a shame that you haven't gotten a working config up yet prior to
> development work (say a 4.2 that we know works), because we don't have
> any clues as to whether it's your setup or master.
>
> On Wed, Sep 25, 2013 at 5:49 PM, Marcus Sorensen 
> wrote:
> > ok, just a guess. I'm assuming it's still this:
> >
> > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
> >
> > On Wed, Sep 25, 2013 at 5:48 PM, Mike Tutkowski
> >  wrote:
> >> mtutkowski@ubuntu:~$ sudo apt-get install libjna-java
> >> Reading package lists... Done
> >> Building dependency tree
> >> Reading state information... Done
> >> libjna-java is already the newest version.
> >> libjna-java set to manually installed.
> >> 0 upgraded, 0 newly installed, 0 to remove and 468 not upgraded.
> >>
> >>
> >> On Wed, Sep 25, 2013 at 5:46 PM, Mike Tutkowski <
> >> mike.tutkow...@solidfire.com> wrote:
> >>
> >>> Was there a step in the docs I may have missed where I was to install
> >>> them? I don't recall installing them, but there are several steps and I
> >>> might have forgotten that I did install them, too.
> >>>
> >>> I can check.
> >>>
> >>>
> >>> On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen  >wrote:
> >>>
>  are you missing the jna packages?
> 
>  On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
>   wrote:
>  > I basically just leveraged the code you provided to redirect the
> output
>  on
>  > Ubuntu.
>  >
>  > Here is the standard err:
>  >
>  > log4j:WARN No appenders could be found for logger
>  > (org.apache.commons.httpclient.params.DefaultHttpParams).
>  > log4j:WARN Please initialize the log4j system properly.
>  > log4j:WARN See
> http://logging.apache.org/log4j/1.2/faq.html#noconfigfor
>  > more info.
>  > java.lang.reflect.InvocationTargetException
>  > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  > at
>  >
> 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>  > at
>  >
> 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  > at java.lang.reflect.Method.invoke(Method.java:606)
>  > at
>  >
> 
> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
>  > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
>  > at org.libvirt.Library.free(Unknown Source)
>  > at org.libvirt.Connect.getCapabilities(Unknown Source)
>  > at
>  >
> 
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
>  > at
>  >
> 
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
>  > at com.cloud.agent.Agent.(Agent.java:168)
>  > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
>  > at
> 
> com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
>  > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
>  > at com.cloud.agent.AgentShell.start(AgentShell.java:473)
>  > ... 5 more
>  > Cannot start daemon
>  > Service exit with a return value of 5
>  >
>  >
>  > On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
>  > mike.tutkow...@solidfire.com> wrote:
>  >
>  >> Sounds good.
>  >>
>  >> Thanks, Marcus! :)
>  >>
>  >>
>  >> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen <
> shadow...@gmail.com
>  >wrote:
>  >>
>  >>> Ok, so the next step is to track that stdout and see if you can
> see
>  >>> what jsvc complains about when it fails to start up the service.
>  >>>
>  >>> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
>  >>>  wrote:
>  >>> > These also look good:
>  >>> >
>  >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
>  >>> > x86_64
>  >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c
> qemu:///system
>  list
>  >>> >  Id Name State
>  >>> > --
>  >>> >
>  >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
>  >>> > /var/run/libvirt/libvirt-sock
>  >>> > srwxrwx--- 1 root libvirtd 0 Sep 25 16:05
>  /var/run/libvirt/libvirt-sock
>  >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm
>  >>> > crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm
>  >>> >
>  >>> >
>  >>> >
>  >>> > On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski <
>  >>> > mike.tu

Re: Managed storage with KVM

[Mike Tutkowski]

I mean switch over to 4.2 from master. :)


On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> I can switch my branch over to master. I'm afraid master is not working
> with Libvirt on Ubuntu, as well.
>
>
> On Wed, Sep 25, 2013 at 5:55 PM, Marcus Sorensen wrote:
>
>> It's harder still that you're trying to use master. I know 4.2 works
>> on ubuntu, but master is a minefield sometimes. Maybe that's not the
>> problem, but I do see emails going back and forth about libvirt/jna
>> versions, just need to read them in detail.
>>
>>  It's a shame that you haven't gotten a working config up yet prior to
>> development work (say a 4.2 that we know works), because we don't have
>> any clues as to whether it's your setup or master.
>>
>> On Wed, Sep 25, 2013 at 5:49 PM, Marcus Sorensen 
>> wrote:
>> > ok, just a guess. I'm assuming it's still this:
>> >
>> > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
>> >
>> > On Wed, Sep 25, 2013 at 5:48 PM, Mike Tutkowski
>> >  wrote:
>> >> mtutkowski@ubuntu:~$ sudo apt-get install libjna-java
>> >> Reading package lists... Done
>> >> Building dependency tree
>> >> Reading state information... Done
>> >> libjna-java is already the newest version.
>> >> libjna-java set to manually installed.
>> >> 0 upgraded, 0 newly installed, 0 to remove and 468 not upgraded.
>> >>
>> >>
>> >> On Wed, Sep 25, 2013 at 5:46 PM, Mike Tutkowski <
>> >> mike.tutkow...@solidfire.com> wrote:
>> >>
>> >>> Was there a step in the docs I may have missed where I was to install
>> >>> them? I don't recall installing them, but there are several steps and
>> I
>> >>> might have forgotten that I did install them, too.
>> >>>
>> >>> I can check.
>> >>>
>> >>>
>> >>> On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen > >wrote:
>> >>>
>>  are you missing the jna packages?
>> 
>>  On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
>>   wrote:
>>  > I basically just leveraged the code you provided to redirect the
>> output
>>  on
>>  > Ubuntu.
>>  >
>>  > Here is the standard err:
>>  >
>>  > log4j:WARN No appenders could be found for logger
>>  > (org.apache.commons.httpclient.params.DefaultHttpParams).
>>  > log4j:WARN Please initialize the log4j system properly.
>>  > log4j:WARN See
>> http://logging.apache.org/log4j/1.2/faq.html#noconfigfor
>>  > more info.
>>  > java.lang.reflect.InvocationTargetException
>>  > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>  > at
>>  >
>> 
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>  > at
>>  >
>> 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>  > at java.lang.reflect.Method.invoke(Method.java:606)
>>  > at
>>  >
>> 
>> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
>>  > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
>>  > at org.libvirt.Library.free(Unknown Source)
>>  > at org.libvirt.Connect.getCapabilities(Unknown Source)
>>  > at
>>  >
>> 
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
>>  > at
>>  >
>> 
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
>>  > at com.cloud.agent.Agent.(Agent.java:168)
>>  > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
>>  > at
>> 
>> com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
>>  > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
>>  > at com.cloud.agent.AgentShell.start(AgentShell.java:473)
>>  > ... 5 more
>>  > Cannot start daemon
>>  > Service exit with a return value of 5
>>  >
>>  >
>>  > On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
>>  > mike.tutkow...@solidfire.com> wrote:
>>  >
>>  >> Sounds good.
>>  >>
>>  >> Thanks, Marcus! :)
>>  >>
>>  >>
>>  >> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen <
>> shadow...@gmail.com
>>  >wrote:
>>  >>
>>  >>> Ok, so the next step is to track that stdout and see if you can
>> see
>>  >>> what jsvc complains about when it fails to start up the service.
>>  >>>
>>  >>> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
>>  >>>  wrote:
>>  >>> > These also look good:
>>  >>> >
>>  >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
>>  >>> > x86_64
>>  >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ virsh -c
>> qemu:///system
>>  list
>>  >>> >  Id Name State
>>  >>> > --
>>  >>> >
>>  >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo ls -la
>>  >>> > /var/run/libvirt/libvirt-sock
>>  >>> > srwxrwx--- 1 root libvirtd 0 Sep 25 16:05
>>  /var/run/libvirt/

Re: Libvirt-java 0.5.0 has been released

[Yoshikazu Nojima]

Hi Wei,

Thank you for fix it!

2013/9/25 Wei ZHOU :
> fixed by commit 3dc4284
>
>
> commit 3dc4284a34a1c79970b30288c245a26e8425e811
> Author: Wei Zhou 
> Date:   Wed Sep 25 11:08:57 2013 +0200
> add missing jna-4.0.0.jar to cloudstack-agent library by changing scope
> from provided to default runtime
> diff --git a/plugins/hypervisors/kvm/pom.xml
> b/plugins/hypervisors/kvm/pom.xml
> index 4c0ec98..024cafe 100644
> --- a/plugins/hypervisors/kvm/pom.xml
> +++ b/plugins/hypervisors/kvm/pom.xml
> @@ -51,7 +51,6 @@
>  
>net.java.dev.jna
> jna
> -   provided
> ${cs.jna.version}
>  
>
>
>
> 2013/9/25 Wei ZHOU 
>
>> I tried both java 6 and java 7.
>> build and install successfully
>> agent can not restart.
>> I will try after jna.version change .
>>

Re: Managed storage with KVM

[Mike Tutkowski]

It's been a bit rough getting this up and running, but at least I've been
learning about how CloudStack works on KVM, so that's really good.


On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> I mean switch over to 4.2 from master. :)
>
>
> On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> I can switch my branch over to master. I'm afraid master is not working
>> with Libvirt on Ubuntu, as well.
>>
>>
>> On Wed, Sep 25, 2013 at 5:55 PM, Marcus Sorensen wrote:
>>
>>> It's harder still that you're trying to use master. I know 4.2 works
>>> on ubuntu, but master is a minefield sometimes. Maybe that's not the
>>> problem, but I do see emails going back and forth about libvirt/jna
>>> versions, just need to read them in detail.
>>>
>>>  It's a shame that you haven't gotten a working config up yet prior to
>>> development work (say a 4.2 that we know works), because we don't have
>>> any clues as to whether it's your setup or master.
>>>
>>> On Wed, Sep 25, 2013 at 5:49 PM, Marcus Sorensen 
>>> wrote:
>>> > ok, just a guess. I'm assuming it's still this:
>>> >
>>> > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
>>> >
>>> > On Wed, Sep 25, 2013 at 5:48 PM, Mike Tutkowski
>>> >  wrote:
>>> >> mtutkowski@ubuntu:~$ sudo apt-get install libjna-java
>>> >> Reading package lists... Done
>>> >> Building dependency tree
>>> >> Reading state information... Done
>>> >> libjna-java is already the newest version.
>>> >> libjna-java set to manually installed.
>>> >> 0 upgraded, 0 newly installed, 0 to remove and 468 not upgraded.
>>> >>
>>> >>
>>> >> On Wed, Sep 25, 2013 at 5:46 PM, Mike Tutkowski <
>>> >> mike.tutkow...@solidfire.com> wrote:
>>> >>
>>> >>> Was there a step in the docs I may have missed where I was to install
>>> >>> them? I don't recall installing them, but there are several steps
>>> and I
>>> >>> might have forgotten that I did install them, too.
>>> >>>
>>> >>> I can check.
>>> >>>
>>> >>>
>>> >>> On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen <
>>> shadow...@gmail.com>wrote:
>>> >>>
>>>  are you missing the jna packages?
>>> 
>>>  On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
>>>   wrote:
>>>  > I basically just leveraged the code you provided to redirect the
>>> output
>>>  on
>>>  > Ubuntu.
>>>  >
>>>  > Here is the standard err:
>>>  >
>>>  > log4j:WARN No appenders could be found for logger
>>>  > (org.apache.commons.httpclient.params.DefaultHttpParams).
>>>  > log4j:WARN Please initialize the log4j system properly.
>>>  > log4j:WARN See
>>> http://logging.apache.org/log4j/1.2/faq.html#noconfigfor
>>>  > more info.
>>>  > java.lang.reflect.InvocationTargetException
>>>  > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>  > at
>>>  >
>>> 
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>  > at
>>>  >
>>> 
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>  > at java.lang.reflect.Method.invoke(Method.java:606)
>>>  > at
>>>  >
>>> 
>>> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
>>>  > Caused by: java.lang.NoSuchMethodError:
>>> com.sun.jna.Native.free(J)V
>>>  > at org.libvirt.Library.free(Unknown Source)
>>>  > at org.libvirt.Connect.getCapabilities(Unknown Source)
>>>  > at
>>>  >
>>> 
>>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
>>>  > at
>>>  >
>>> 
>>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
>>>  > at com.cloud.agent.Agent.(Agent.java:168)
>>>  > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
>>>  > at
>>> 
>>> com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
>>>  > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
>>>  > at com.cloud.agent.AgentShell.start(AgentShell.java:473)
>>>  > ... 5 more
>>>  > Cannot start daemon
>>>  > Service exit with a return value of 5
>>>  >
>>>  >
>>>  > On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
>>>  > mike.tutkow...@solidfire.com> wrote:
>>>  >
>>>  >> Sounds good.
>>>  >>
>>>  >> Thanks, Marcus! :)
>>>  >>
>>>  >>
>>>  >> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen <
>>> shadow...@gmail.com
>>>  >wrote:
>>>  >>
>>>  >>> Ok, so the next step is to track that stdout and see if you can
>>> see
>>>  >>> what jsvc complains about when it fails to start up the service.
>>>  >>>
>>>  >>> On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkowski
>>>  >>>  wrote:
>>>  >>> > These also look good:
>>>  >>> >
>>>  >>> > mtutkowski@ubuntu:/etc/cloudstack/agent$ uname -m
>>>  >>> > x86_64
>>> >>

Re: Managed storage with KVM

[Mike Tutkowski]

By simply switching to 4.2, will CS use the proper version of Libvirt or is
there more I need to do since I've already run 4.3 on this Ubuntu install?

Thanks


On Wed, Sep 25, 2013 at 6:07 PM, Mike Tutkowski <
mike.tutkow...@solidfire.com> wrote:

> It's been a bit rough getting this up and running, but at least I've been
> learning about how CloudStack works on KVM, so that's really good.
>
>
> On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> I mean switch over to 4.2 from master. :)
>>
>>
>> On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski <
>> mike.tutkow...@solidfire.com> wrote:
>>
>>> I can switch my branch over to master. I'm afraid master is not working
>>> with Libvirt on Ubuntu, as well.
>>>
>>>
>>> On Wed, Sep 25, 2013 at 5:55 PM, Marcus Sorensen wrote:
>>>
 It's harder still that you're trying to use master. I know 4.2 works
 on ubuntu, but master is a minefield sometimes. Maybe that's not the
 problem, but I do see emails going back and forth about libvirt/jna
 versions, just need to read them in detail.

  It's a shame that you haven't gotten a working config up yet prior to
 development work (say a 4.2 that we know works), because we don't have
 any clues as to whether it's your setup or master.

 On Wed, Sep 25, 2013 at 5:49 PM, Marcus Sorensen 
 wrote:
 > ok, just a guess. I'm assuming it's still this:
 >
 > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
 >
 > On Wed, Sep 25, 2013 at 5:48 PM, Mike Tutkowski
 >  wrote:
 >> mtutkowski@ubuntu:~$ sudo apt-get install libjna-java
 >> Reading package lists... Done
 >> Building dependency tree
 >> Reading state information... Done
 >> libjna-java is already the newest version.
 >> libjna-java set to manually installed.
 >> 0 upgraded, 0 newly installed, 0 to remove and 468 not upgraded.
 >>
 >>
 >> On Wed, Sep 25, 2013 at 5:46 PM, Mike Tutkowski <
 >> mike.tutkow...@solidfire.com> wrote:
 >>
 >>> Was there a step in the docs I may have missed where I was to
 install
 >>> them? I don't recall installing them, but there are several steps
 and I
 >>> might have forgotten that I did install them, too.
 >>>
 >>> I can check.
 >>>
 >>>
 >>> On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen <
 shadow...@gmail.com>wrote:
 >>>
  are you missing the jna packages?
 
  On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
   wrote:
  > I basically just leveraged the code you provided to redirect the
 output
  on
  > Ubuntu.
  >
  > Here is the standard err:
  >
  > log4j:WARN No appenders could be found for logger
  > (org.apache.commons.httpclient.params.DefaultHttpParams).
  > log4j:WARN Please initialize the log4j system properly.
  > log4j:WARN See
 http://logging.apache.org/log4j/1.2/faq.html#noconfigfor
  > more info.
  > java.lang.reflect.InvocationTargetException
  > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  > at
  >
 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  > at
  >
 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  > at java.lang.reflect.Method.invoke(Method.java:606)
  > at
  >
 
 org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
  > Caused by: java.lang.NoSuchMethodError:
 com.sun.jna.Native.free(J)V
  > at org.libvirt.Library.free(Unknown Source)
  > at org.libvirt.Connect.getCapabilities(Unknown Source)
  > at
  >
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
  > at
  >
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
  > at com.cloud.agent.Agent.(Agent.java:168)
  > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
  > at
 
 com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
  > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:361)
  > at com.cloud.agent.AgentShell.start(AgentShell.java:473)
  > ... 5 more
  > Cannot start daemon
  > Service exit with a return value of 5
  >
  >
  > On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski <
  > mike.tutkow...@solidfire.com> wrote:
  >
  >> Sounds good.
  >>
  >> Thanks, Marcus! :)
  >>
  >>
  >> On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen <
 shadow...@gmail.com
  >wrote:
  >>
  >>> Ok, 

Re: Managed storage with KVM

[Marcus Sorensen]

You'll need to either remove the old debs or force install the new
ones. Also, if any jars have moved location, you may have to delete
the old ones in case they end up in the classpath of your jsvc
command. I'd first try to generate 4.2 debs (or use the release
artifacts), remove the old packages, install the new ones, then you'll
have to clear the database and start fresh on 4.2.

On Wed, Sep 25, 2013 at 6:09 PM, Mike Tutkowski
 wrote:
> By simply switching to 4.2, will CS use the proper version of Libvirt or is
> there more I need to do since I've already run 4.3 on this Ubuntu install?
>
> Thanks
>
>
> On Wed, Sep 25, 2013 at 6:07 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
>> It's been a bit rough getting this up and running, but at least I've been
>> learning about how CloudStack works on KVM, so that's really good.
>>
>>
>> On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski <
>> mike.tutkow...@solidfire.com> wrote:
>>
>>> I mean switch over to 4.2 from master. :)
>>>
>>>
>>> On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski <
>>> mike.tutkow...@solidfire.com> wrote:
>>>
 I can switch my branch over to master. I'm afraid master is not working
 with Libvirt on Ubuntu, as well.


 On Wed, Sep 25, 2013 at 5:55 PM, Marcus Sorensen 
 wrote:

> It's harder still that you're trying to use master. I know 4.2 works
> on ubuntu, but master is a minefield sometimes. Maybe that's not the
> problem, but I do see emails going back and forth about libvirt/jna
> versions, just need to read them in detail.
>
>  It's a shame that you haven't gotten a working config up yet prior to
> development work (say a 4.2 that we know works), because we don't have
> any clues as to whether it's your setup or master.
>
> On Wed, Sep 25, 2013 at 5:49 PM, Marcus Sorensen 
> wrote:
> > ok, just a guess. I'm assuming it's still this:
> >
> > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
> >
> > On Wed, Sep 25, 2013 at 5:48 PM, Mike Tutkowski
> >  wrote:
> >> mtutkowski@ubuntu:~$ sudo apt-get install libjna-java
> >> Reading package lists... Done
> >> Building dependency tree
> >> Reading state information... Done
> >> libjna-java is already the newest version.
> >> libjna-java set to manually installed.
> >> 0 upgraded, 0 newly installed, 0 to remove and 468 not upgraded.
> >>
> >>
> >> On Wed, Sep 25, 2013 at 5:46 PM, Mike Tutkowski <
> >> mike.tutkow...@solidfire.com> wrote:
> >>
> >>> Was there a step in the docs I may have missed where I was to
> install
> >>> them? I don't recall installing them, but there are several steps
> and I
> >>> might have forgotten that I did install them, too.
> >>>
> >>> I can check.
> >>>
> >>>
> >>> On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen <
> shadow...@gmail.com>wrote:
> >>>
>  are you missing the jna packages?
> 
>  On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
>   wrote:
>  > I basically just leveraged the code you provided to redirect the
> output
>  on
>  > Ubuntu.
>  >
>  > Here is the standard err:
>  >
>  > log4j:WARN No appenders could be found for logger
>  > (org.apache.commons.httpclient.params.DefaultHttpParams).
>  > log4j:WARN Please initialize the log4j system properly.
>  > log4j:WARN See
> http://logging.apache.org/log4j/1.2/faq.html#noconfigfor
>  > more info.
>  > java.lang.reflect.InvocationTargetException
>  > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  > at
>  >
> 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>  > at
>  >
> 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  > at java.lang.reflect.Method.invoke(Method.java:606)
>  > at
>  >
> 
> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
>  > Caused by: java.lang.NoSuchMethodError:
> com.sun.jna.Native.free(J)V
>  > at org.libvirt.Library.free(Unknown Source)
>  > at org.libvirt.Connect.getCapabilities(Unknown Source)
>  > at
>  >
> 
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.IsHVMEnabled(LibvirtComputingResource.java:4524)
>  > at
>  >
> 
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.configure(LibvirtComputingResource.java:753)
>  > at com.cloud.agent.Agent.(Agent.java:168)
>  > at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:439)
>  > at
> 
> com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:386)
>  > at com.cloud.agent.AgentShell.launchAgent(AgentS

Re: [VOTE] Accept the donation of a Contrail plugin into Apache CloudStack

[Hugo Trippaers]

+1

Sent from my iPhone

> On 26 sep. 2013, at 05:44, "Musayev, Ilya"  wrote:
> 
> +1(binding)
> 
>> -Original Message-
>> From: Chiradeep Vittal [mailto:chiradeep.vit...@citrix.com]
>> Sent: Wednesday, September 25, 2013 5:23 PM
>> To: dev@cloudstack.apache.org
>> Subject: Re: [VOTE] Accept the donation of a Contrail plugin into Apache
>> CloudStack
>> 
>> +1 (binding)
>> 
>>> On 9/25/13 10:13 AM, "Chip Childers"  wrote:
>>> 
>>> Hi all!
>>> 
>>> As stated in other threads, Juniper is proposing the donation of a
>>> Contrail plugin to Apache CloudStack.  The code itself has been posted
>>> to reviewboard [1].  The design has been documented by Pedro [2].
>>> 
>>> [1] https://reviews.apache.org/r/14325/
>>> [2]
>>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Contrail+netwo
>> rk
>>> +pl
>>> ugin
>>> 
>>> I'm calling a vote here, so that we have a formal consensus on
>>> accepting the code into the project.  As I've suggested earlier, I'd
>>> like us to accept the code into a branch, and then work through any
>>> technical concerns / reviews / changes prior to a master branch merge.
>>> 
>>> So...  voting will end in ~72 hours.  As this is a technical decision,
>>> committer and PMC votes are binding.
>>> 
>>> -chip
>>> 
>>> 
>>> Votes please!
>>> 
>>> [ ] +1 - Accept the donation
>>> [ ] +/-0 - No strong opinion
>>> [ ] -1 - Do not accept the donation
> 
> 

Re: Review Request 14058: Including tests for VPC VM Lifecycle on Tagged hosts

[Sheng Yang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14058/#review26402
---


Please test it before submit.

- Sheng Yang


On Sept. 18, 2013, 2:28 p.m., Ashutosh Kelkar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14058/
> ---
> 
> (Updated Sept. 18, 2013, 2:28 p.m.)
> 
> 
> Review request for cloudstack, Girish Shilamkar, venkata swamy babu  
> budumuru, and Sheng Yang.
> 
> 
> Repository: cloudstack-git
> 
> 
> Description
> ---
> 
> Added 10 tests for VPC VM liftcycle on tagged hosts
> 
> New class added  : TestVMLifeCycleDiffHosts
> 
> def test_01_deploy_instance_in_network(self):
> def test_02_stop_instance_in_network(self):
> def test_03_start_instance_in_network(self):
> def test_04_reboot_instance_in_network(self):
> def test_05_destroy_instance_in_network(self):
> def test_06_recover_instance_in_network(self):
> def test_07_migrate_instance_in_network(self):
> def test_08_user_data(self):
> def test_09_meta_data(self):
> def   test_10_expunge_instance_in_network(self):
> 
> This set of tests requires a multi host tagged setup (3 hosts - 2 hosts with 
> tag 'host1' and  1 host with tag 'host2')
> 
> 
> Diffs
> -
> 
>   test/integration/component/test_vpc_vm_life_cycle.py 9844c1f 
> 
> Diff: https://reviews.apache.org/r/14058/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Ashutosh Kelkar
> 
>

Re: [VOTE] Accept the donation of a Contrail plugin into Apache CloudStack

[David Nalley]

+1

On Wed, Sep 25, 2013 at 10:13 AM, Chip Childers  wrote:
> Hi all!
>
> As stated in other threads, Juniper is proposing the donation of a
> Contrail plugin to Apache CloudStack.  The code itself has been posted
> to reviewboard [1].  The design has been documented by Pedro [2].
>
> [1] https://reviews.apache.org/r/14325/
> [2] 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Contrail+network+plugin
>
> I'm calling a vote here, so that we have a formal consensus on accepting
> the code into the project.  As I've suggested earlier, I'd like us to
> accept the code into a branch, and then work through any technical
> concerns / reviews / changes prior to a master branch merge.
>
> So...  voting will end in ~72 hours.  As this is a technical decision,
> committer and PMC votes are binding.
>
> -chip
>
>
> Votes please!
>
> [ ] +1 - Accept the donation
> [ ] +/-0 - No strong opinion
> [ ] -1 - Do not accept the donation

Re: 4.2 rpm nonoss

[David Nalley]

On Wed, Sep 25, 2013 at 9:49 AM, Larry Hernandez  wrote:
> Does the http://cloudstack.apt-get.eu/rhel/4.2/ repo have nonoss built is
> like 4.1?
>
> -Larry

Yes it does.

--David

Re: Managed storage with KVM

[Mike Tutkowski]

Sounds good

I can:

1) sudo apt-get remove --purge cloudstack-agent

2) sudo apt-get clean

3) Switch to 4.2 branch

4) mvn -P developer,systemvm clean install

5) mvn -P developer -pl developer,tools/devcloud -Ddeploydb

6) Regenerate DEBs and install them



On Wed, Sep 25, 2013 at 6:13 PM, Marcus Sorensen wrote:

> You'll need to either remove the old debs or force install the new
> ones. Also, if any jars have moved location, you may have to delete
> the old ones in case they end up in the classpath of your jsvc
> command. I'd first try to generate 4.2 debs (or use the release
> artifacts), remove the old packages, install the new ones, then you'll
> have to clear the database and start fresh on 4.2.
>
> On Wed, Sep 25, 2013 at 6:09 PM, Mike Tutkowski
>  wrote:
> > By simply switching to 4.2, will CS use the proper version of Libvirt or
> is
> > there more I need to do since I've already run 4.3 on this Ubuntu
> install?
> >
> > Thanks
> >
> >
> > On Wed, Sep 25, 2013 at 6:07 PM, Mike Tutkowski <
> > mike.tutkow...@solidfire.com> wrote:
> >
> >> It's been a bit rough getting this up and running, but at least I've
> been
> >> learning about how CloudStack works on KVM, so that's really good.
> >>
> >>
> >> On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski <
> >> mike.tutkow...@solidfire.com> wrote:
> >>
> >>> I mean switch over to 4.2 from master. :)
> >>>
> >>>
> >>> On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski <
> >>> mike.tutkow...@solidfire.com> wrote:
> >>>
>  I can switch my branch over to master. I'm afraid master is not
> working
>  with Libvirt on Ubuntu, as well.
> 
> 
>  On Wed, Sep 25, 2013 at 5:55 PM, Marcus Sorensen  >wrote:
> 
> > It's harder still that you're trying to use master. I know 4.2 works
> > on ubuntu, but master is a minefield sometimes. Maybe that's not the
> > problem, but I do see emails going back and forth about libvirt/jna
> > versions, just need to read them in detail.
> >
> >  It's a shame that you haven't gotten a working config up yet prior
> to
> > development work (say a 4.2 that we know works), because we don't
> have
> > any clues as to whether it's your setup or master.
> >
> > On Wed, Sep 25, 2013 at 5:49 PM, Marcus Sorensen <
> shadow...@gmail.com>
> > wrote:
> > > ok, just a guess. I'm assuming it's still this:
> > >
> > > Caused by: java.lang.NoSuchMethodError: com.sun.jna.Native.free(J)V
> > >
> > > On Wed, Sep 25, 2013 at 5:48 PM, Mike Tutkowski
> > >  wrote:
> > >> mtutkowski@ubuntu:~$ sudo apt-get install libjna-java
> > >> Reading package lists... Done
> > >> Building dependency tree
> > >> Reading state information... Done
> > >> libjna-java is already the newest version.
> > >> libjna-java set to manually installed.
> > >> 0 upgraded, 0 newly installed, 0 to remove and 468 not upgraded.
> > >>
> > >>
> > >> On Wed, Sep 25, 2013 at 5:46 PM, Mike Tutkowski <
> > >> mike.tutkow...@solidfire.com> wrote:
> > >>
> > >>> Was there a step in the docs I may have missed where I was to
> > install
> > >>> them? I don't recall installing them, but there are several steps
> > and I
> > >>> might have forgotten that I did install them, too.
> > >>>
> > >>> I can check.
> > >>>
> > >>>
> > >>> On Wed, Sep 25, 2013 at 5:44 PM, Marcus Sorensen <
> > shadow...@gmail.com>wrote:
> > >>>
> >  are you missing the jna packages?
> > 
> >  On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski
> >   wrote:
> >  > I basically just leveraged the code you provided to redirect
> the
> > output
> >  on
> >  > Ubuntu.
> >  >
> >  > Here is the standard err:
> >  >
> >  > log4j:WARN No appenders could be found for logger
> >  > (org.apache.commons.httpclient.params.DefaultHttpParams).
> >  > log4j:WARN Please initialize the log4j system properly.
> >  > log4j:WARN See
> > http://logging.apache.org/log4j/1.2/faq.html#noconfigfor
> >  > more info.
> >  > java.lang.reflect.InvocationTargetException
> >  > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >  > at
> >  >
> > 
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >  > at
> >  >
> > 
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >  > at java.lang.reflect.Method.invoke(Method.java:606)
> >  > at
> >  >
> > 
> >
> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:243)
> >  > Caused by: java.lang.NoSuchMethodError:
> > com.sun.jna.Native.free(J)V
> >  > at org.libvirt.Library.free(Unknown Source)
> >  > at org.libvirt.Connect.getCapabilities(Unknown Source)
> >  > a

Re: [VOTE] Accept the donation of a Contrail plugin into Apache CloudStack

[Francois Gaudreault]

Definitely +1 on this :)

Francois

On 2013-09-25 1:13 PM, Chip Childers wrote:

Hi all!

As stated in other threads, Juniper is proposing the donation of a
Contrail plugin to Apache CloudStack.  The code itself has been posted
to reviewboard [1].  The design has been documented by Pedro [2].

[1] https://reviews.apache.org/r/14325/
[2] 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Contrail+network+plugin

I'm calling a vote here, so that we have a formal consensus on accepting
the code into the project.  As I've suggested earlier, I'd like us to
accept the code into a branch, and then work through any technical
concerns / reviews / changes prior to a master branch merge.

So...  voting will end in ~72 hours.  As this is a technical decision,
committer and PMC votes are binding.

-chip


Votes please!

[ ] +1 - Accept the donation
[ ] +/-0 - No strong opinion
[ ] -1 - Do not accept the donation




--
Francois Gaudreault
Architecte de Solution Cloud | Cloud Solutions Architect
fgaudrea...@cloudops.com
514-629-6775
- - -
CloudOps
420 rue Guy
Montréal QC  H3J 1S6
www.cloudops.com
@CloudOps_

Re: [PROPOSAL] move away from time-based releases and/or revamp release process

[David Nalley]

On Wed, Sep 25, 2013 at 11:26 AM, Musayev, Ilya  wrote:
> We can still use scheduled release as we do now and yet have some agility.
>
> An idea was passed around before if we can modularize ACS in future releases 
> VS being it monolithic.
>
> We can still have a core as is, but additional components/plugins can be 
> loaded adhoc pm the need base. As an example, there is no need to bake in 
> vmware support into release if a customer has not need for it. You cant just 
> upgrade vmware code unless you upgrade from version X.y.1 to X.y.2.
>
> Same applies to all other "plugins", that are not truly pluggable.
>
> Splitting components as separate "plugins" (or whatever the proper term is) 
> would ease the release cycle and give us flexibility in my opinion.
>

Can you imagine the complexity of that model? Core version 4.3.x has
to work with VMware plugin 7.2.3, 7.1.5, and 7.0.2 and also has to
work with Nicira plugin version 3.4.1, 3.5.2, and 3.6.0 - except that
both of those plugins interact with each other as well as the core
orchestration platform. We struggle to test well now, the additional
combinations there boggle the mind.

--David

Re: VmWare SDK to vijava

[David Nalley]

On Tue, Sep 24, 2013 at 8:01 PM, Alex Huang  wrote:
> Wow good guess...Hugo had me scratching my head on that oneIs Prussian 
> some code name for Apache legalShould I askWould it make me look 
> stupid if I askedall sorts of doubts going through my mind.
>
> --Alex
>

I think Prasanna just earned a new nickname thanks to autocorrect. :)

--David