I set encryption to none in db.properties and updated the passwords in
host_details to unencrypted versions so I could make progress.
I don’t know what exactly the problem was but this is probably something that
needs better testing. I’m pretty sure I had all the encryption stuff correct
in the db.properties file but could not get it to work.
It would be nice if there was a specialized merging utility for the
db.properties given the change in the organization of the file. I am guessing
if the file had not been reorganized it would have been more obvious how to
merge the 2 and I may have avoided this issue.
Now my hosts come up in an alert state and I’m not sure where to go from here.
Please note I am not using bridge mode because I wanted to to a 4 nic bridge
which bridge does not allow (only 2 nics). This was working fine in 4.1 so
hopefully this is not a requirement for 4.4. I am not using security groups
which was my understanding is what requires bridge networking:
The error in the log is this:
2014-06-30 14:06:50,073 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-1:ctx-35941dc7) Failed to configure brige firewall
2014-06-30 14:06:50,073 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-1:ctx-35941dc7) Check host 172.30.45.32 for CSP is installed or
not and check network mode for bridge
2014-06-30 14:06:50,074 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-1:ctx-35941dc7) Seq 2-6232418934327345153: Response Received:
2014-06-30 14:06:50,075 DEBUG [c.c.a.t.Request] (DirectAgent-1:ctx-35941dc7)
Seq 2-6232418934327345153: Processing: { Ans: , MgmtId: 233845174730253, via:
2, Ver: v1, Flags: 110, [{"com.cloud.agent.api
.SetupAnswer":{"_reconnect":true,"result":false,"details":"Failed to configure
brige firewall","wait":0}}] }
2014-06-30 14:06:50,075 DEBUG [c.c.a.t.Request] (AgentTaskPool-2:ctx-b360d1bb)
Seq 2-6232418934327345153: Received: { Ans: , MgmtId: 233845174730253, via: 2,
Ver: v1, Flags: 110, { SetupAnswer } }
2014-06-30 14:06:50,076 DEBUG [c.c.a.m.AgentAttache]
(DirectAgent-1:ctx-35941dc7) Seq 2-6232418934327345153: No more commands found
2014-06-30 14:06:50,076 WARN [c.c.h.x.d.XcpServerDiscoverer]
(AgentTaskPool-2:ctx-b360d1bb) Unable to setup agent 2 due to Failed to
configure brige firewall
2014-06-30 14:06:50,079 INFO [c.c.u.e.CSExceptionErrorCode]
(AgentTaskPool-2:ctx-b360d1bb) Could not find exception:
com.cloud.exception.ConnectionException in error code list for exceptions
2014-06-30 14:06:50,079 WARN [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Monitor XcpServerDiscoverer says there is an
error in the connect process for 2 due to Reinitialize agent after se
tup.
2014-06-30 14:06:50,079 INFO [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Host 2 is disconnecting with event
AgentDisconnected
2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) The next status of agent 2is Alert, current
status is Connecting
2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Deregistering link for 2 with state Alert
2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Remove Agent : 2
2014-06-30 14:06:50,085 DEBUG [c.c.a.m.DirectAgentAttache]
(AgentTaskPool-2:ctx-b360d1bb) Processing disconnect 2(srvengxen02)
2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer
2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.hypervisor.hyperv.discoverer.HypervServerDiscoverer
2014-06-30 14:06:50,085 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.network.security.SecurityGroupListener
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.vm.ClusteredVirtualMachineManagerImpl
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.storage.secondary.SecondaryStorageListener
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.deploy.DeploymentPlanningManagerImpl
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.storage.listener.StoragePoolMonitor
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.storage.download.DownloadListener
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.network.SshKeysDistriMonitor
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.network.router.VirtualNetworkApplianceManagerImpl
2014-06-30 14:06:50,086 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.consoleproxy.ConsoleProxyListener
2014-06-30 14:06:50,091 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.network.SshKeysDistriMonitor
2014-06-30 14:06:50,091 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl
2014-06-30 14:06:50,091 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.storage.LocalStoragePoolListener
2014-06-30 14:06:50,091 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.storage.upload.UploadListener
2014-06-30 14:06:50,093 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.capacity.StorageCapacityListener
2014-06-30 14:06:50,093 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.capacity.ComputeCapacityListener
2014-06-30 14:06:50,093 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener
2014-06-30 14:06:50,093 DEBUG [c.c.n.NetworkUsageManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Disconnected called on 2 with status Alert
2014-06-30 14:06:50,093 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Sending Disconnect to listener:
com.cloud.agent.manager.AgentManagerImpl$BehindOnPingListener
2014-06-30 14:06:50,093 DEBUG [c.c.h.Status] (AgentTaskPool-2:ctx-b360d1bb)
Transition:[Resource state = Enabled, Agent event = AgentDisconnected, Host id
= 2, name = srvengxen02]
2014-06-30 14:06:50,102 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Notifying other nodes of to disconnect
2014-06-30 14:06:50,108 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-2:ctx-59808af2) Copying
/usr/share/cloudstack-management/webapps/client/WEB-INF/classes/scripts/vm/hypervisor/xenserver/xenserver60/../../../../network/domr//router_proxy.sh
to /opt/cloud/bin on 172.30.45.32 with permission 0755
2014-06-30 14:06:50,108 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-2:ctx-59808af2) Unable to create destination path: /opt/cloud/bin
on 172.30.45.32 but trying anyway
2014-06-30 14:06:50,110 WARN [c.c.r.ResourceManagerImpl]
(AgentTaskPool-2:ctx-b360d1bb) Unable to connect due to
com.cloud.exception.ConnectionException: Reinitialize agent after setup.
at
com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.processConnect(XcpServerDiscoverer.java:656)
at
com.cloud.agent.manager.AgentManagerImpl.notifyMonitorsOfConnection(AgentManagerImpl.java:514)
at
com.cloud.agent.manager.AgentManagerImpl.handleDirectConnectAgent(AgentManagerImpl.java:1427)
at
com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:1765)
at
com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:1891)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
On Jun 30, 2014, at 1:57 PM, Carlos Reátegui <[email protected]> wrote:
> Making a little progress but still stuck…
>
> I realized that when I did the upgrade it had asked me if to keep the old
> dp.properties or use the new one. The structure of the file seemed different
> enough and I did not recall using anything but the defaults so I went ahead
> and told it to use the new one. Seems this was not the right thing to do.
>
> I have updated the password/ecryption settings to match the old file but it
> is still not working. Now I am getting stuck here:
>
> 2014-06-30 13:50:32,139 DEBUG [c.c.s.d.VMTemplateDaoImpl] (main:null) Found
> parameter routing unique name null
> 2014-06-30 13:50:32,139 DEBUG [c.c.s.d.VMTemplateDaoImpl] (main:null) Use
> console proxy template : routing
> 2014-06-30 13:50:32,143 INFO [c.c.u.d.GenericDaoBase] (main:null) Cache
> created: [ name = HostPodDaoImpl status = STATUS_ALIVE eternal = false
> overflowToDisk = false maxEntriesLocalHeap = 50 maxEntriesLocalDisk = 0
> memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 600 timeToIdleSeconds =
> 300 persistence = none diskExpiryThreadIntervalSeconds = 120
> cacheEventListeners: net.sf.ehcache.statistics.LiveCacheStatisticsWrapper
> hitCount = 0 memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound
> = 0 missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false
> maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
> 2014-06-30 13:50:32,157 INFO [c.c.u.d.GenericDaoBase] (main:null) Cache
> created: [ name = DedicatedResourceDaoImpl status = STATUS_ALIVE eternal =
> false overflowToDisk = false maxEntriesLocalHeap = 30 maxEntriesLocalDisk = 0
> memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 3600 timeToIdleSeconds =
> 300 persistence = none diskExpiryThreadIntervalSeconds = 120
> cacheEventListeners: net.sf.ehcache.statistics.LiveCacheStatisticsWrapper
> hitCount = 0 memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound
> = 0 missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false
> maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
> 2014-06-30 13:50:32,168 INFO [c.c.u.d.GenericDaoBase] (main:null) Cache
> created: [ name = HypervisorCapabilitiesDaoImpl status = STATUS_ALIVE eternal
> = false overflowToDisk = false maxEntriesLocalHeap = 100 maxEntriesLocalDisk
> = 0 memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 600 timeToIdleSeconds
> = 300 persistence = none diskExpiryThreadIntervalSeconds = 120
> cacheEventListeners: net.sf.ehcache.statistics.LiveCacheStatisticsWrapper
> hitCount = 0 memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound
> = 0 missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false
> maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
> 2014-06-30 13:50:32,175 INFO [c.c.u.d.GenericDaoBase] (main:null) Cache
> created: [ name = UserDaoImpl status = STATUS_ALIVE eternal = false
> overflowToDisk = false maxEntriesLocalHeap = 5000 maxEntriesLocalDisk = 0
> memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 300 timeToIdleSeconds =
> 300 persistence = none diskExpiryThreadIntervalSeconds = 120
> cacheEventListeners: net.sf.ehcache.statistics.LiveCacheStatisticsWrapper
> hitCount = 0 memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound
> = 0 missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false
> maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
> 2014-06-30 13:50:32,180 INFO [c.c.u.d.GenericDaoBase] (main:null) Cache
> created: [ name = ServiceOfferingDaoImpl status = STATUS_ALIVE eternal =
> false overflowToDisk = false maxEntriesLocalHeap = 50 maxEntriesLocalDisk = 0
> memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 600 timeToIdleSeconds =
> 300 persistence = none diskExpiryThreadIntervalSeconds = 120
> cacheEventListeners: net.sf.ehcache.statistics.LiveCacheStatisticsWrapper
> hitCount = 0 memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound
> = 0 missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false
> maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
> 2014-06-30 13:50:32,187 INFO [c.c.u.d.GenericDaoBase] (main:null) Cache
> created: [ name = DataCenterDaoImpl status = STATUS_ALIVE eternal = false
> overflowToDisk = false maxEntriesLocalHeap = 50 maxEntriesLocalDisk = 0
> memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 600 timeToIdleSeconds =
> 300 persistence = none diskExpiryThreadIntervalSeconds = 120
> cacheEventListeners: net.sf.ehcache.statistics.LiveCacheStatisticsWrapper
> hitCount = 0 memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound
> = 0 missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false
> maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
> 2014-06-30 13:50:32,188 INFO [c.c.u.d.GenericDaoBase] (main:null) Cache
> created: [ name = Ip Alloc status = STATUS_ALIVE eternal = false
> overflowToDisk = false maxEntriesLocalHeap = 50 maxEntriesLocalDisk = 0
> memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 600 timeToIdleSeconds =
> 300 persistence = none diskExpiryThreadIntervalSeconds = 120
> cacheEventListeners: net.sf.ehcache.statistics.LiveCacheStatisticsWrapper
> hitCount = 0 memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound
> = 0 missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false
> maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
> 2014-06-30 13:50:32,189 INFO [c.c.u.d.GenericDaoBase] (main:null) Cache
> created: [ name = vnet Alloc status = STATUS_ALIVE eternal = false
> overflowToDisk = false maxEntriesLocalHeap = 50 maxEntriesLocalDisk = 0
> memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 600 timeToIdleSeconds =
> 300 persistence = none diskExpiryThreadIntervalSeconds = 120
> cacheEventListeners: net.sf.ehcache.statistics.LiveCacheStatisticsWrapper
> hitCount = 0 memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound
> = 0 missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false
> maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
> 2014-06-30 13:50:32,198 INFO [c.c.u.d.GenericDaoBase] (main:null) Cache
> created: [ name = VlanDaoImpl status = STATUS_ALIVE eternal = false
> overflowToDisk = false maxEntriesLocalHeap = 30 maxEntriesLocalDisk = 0
> memoryStoreEvictionPolicy = LRU timeToLiveSeconds = 3600 timeToIdleSeconds =
> 300 persistence = none diskExpiryThreadIntervalSeconds = 120
> cacheEventListeners: net.sf.ehcache.statistics.LiveCacheStatisticsWrapper
> hitCount = 0 memoryStoreHitCount = 0 diskStoreHitCount = 0 missCountNotFound
> = 0 missCountExpired = 0 maxBytesLocalHeap = 0 overflowToOffHeap = false
> maxBytesLocalOffHeap = 0 maxBytesLocalDisk = 0 pinned = false ]
> 2014-06-30 13:50:32,232 DEBUG [c.c.u.c.DBEncryptionUtil] (main:null) Error
> while decrypting: true
>
> The key is still the default password and I have decrypted all the ENC
> parameters from the db.properties file and they seem ok. What am I missing?
>
> thanks,
> Carlos
>
>
> On Jun 30, 2014, at 1:16 PM, Carlos Reátegui <[email protected]> wrote:
>
>> I found the comments in:
>> https://issues.apache.org/jira/browse/CLOUDSTACK-3990 useful but how do I
>> find out the database key so that I can set the pw.
>>
>> Also in looking at my previous backups for the host_details table it seems
>> like the password entry changes on a regular basis.
>>
>> Is there something the keeps updating the db key and re-ecrypts the host
>> passwords?
>>
>> On Jun 30, 2014, at 1:01 PM, Carlos Reátegui <[email protected]> wrote:
>>
>>> Hi All,
>>>
>>> I am having problems bringing my system back up. I have not checked the
>>> credentials of my hosts but the upgraded management server is unable to
>>> connect to them. Where is the password stored?
>>>
>>> thanks.
>>> Carlos
>>>
>>>
>>> 2014-06-30 12:55:59,277 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>> (ClusteredAgentManager Timer:ctx-060c8ace) Loading directly connected host
>>> 1(srvengxen01)
>>> 2014-06-30 12:56:04,394 DEBUG [c.c.n.l.LBHealthCheckManagerImpl]
>>> (LBHealthCheck-1:ctx-c6869648) LB HealthCheck Manager is running and
>>> getting the updates from LB providers and updating service status
>>> 2014-06-30 12:56:04,428 DEBUG [c.c.n.l.LBHealthCheckManagerImpl]
>>> (LBHealthCheck-1:ctx-c6869648) LB HealthCheck Manager is running and
>>> getting the updates from LB providers and updating service status
>>> 2014-06-30 12:56:06,844 DEBUG [c.c.h.x.r.XenServerConnectionPool]
>>> (ClusteredAgentManager Timer:ctx-060c8ace) Unable to create master
>>> connection to host(172.30.45.31) , due to The credentials given by the user
>>> are incorrect, so access has been denied, and you have not been issued a
>>> session handle.
>>> 2014-06-30 12:56:06,848 DEBUG [c.c.h.Status] (ClusteredAgentManager
>>> Timer:ctx-060c8ace) Transition:[Resource state = Enabled, Agent event =
>>> AgentDisconnected, Host id = 1, name = srvengxen01]
>>> 2014-06-30 12:56:06,862 WARN [c.c.a.m.ClusteredAgentManagerImpl]
>>> (ClusteredAgentManager Timer:ctx-060c8ace) can not load directly connected
>>> host 1(srvengxen01) due to
>>> com.cloud.utils.exception.CloudRuntimeException: Unable to create master
>>> connection to host(172.30.45.31) , due to The credentials given by the user
>>> are incorrect, so access has been denied, and you have not been issued a
>>> session handle.
>>> at
>>> com.cloud.hypervisor.xen.resource.XenServerConnectionPool.getConnect(XenServerConnectionPool.java:168)
>>> at
>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.CheckXenHostInfo(CitrixResourceBase.java:5722)
>>> at
>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.configure(CitrixResourceBase.java:5705)
>>> at
>>> com.cloud.resource.DiscovererBase.reloadResource(DiscovererBase.java:157)
>>> at
>>> com.cloud.agent.manager.AgentManagerImpl.loadDirectlyConnectedHost(AgentManagerImpl.java:672)
>>> at
>>> com.cloud.agent.manager.ClusteredAgentManagerImpl.scanDirectAgentToLoad(ClusteredAgentManagerImpl.java:218)
>>> at
>>> com.cloud.agent.manager.ClusteredAgentManagerImpl.runDirectAgentScanTimerTask(ClusteredAgentManagerImpl.java:184)
>>> at
>>> com.cloud.agent.manager.ClusteredAgentManagerImpl.access$100(ClusteredAgentManagerImpl.java:98)
>>> at
>>> com.cloud.agent.manager.ClusteredAgentManagerImpl$DirectAgentScanTimerTask.runInContext(ClusteredAgentManagerImpl.java:234)
>>> at
>>> org.apache.cloudstack.managed.context.ManagedContextTimerTask$1.runInContext(ManagedContextTimerTask.java:30)
>>> at
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>> at
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>> at
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>> at
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>> at
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>> at
>>> org.apache.cloudstack.managed.context.ManagedContextTimerTask.run(ManagedContextTimerTask.java:27)
>>> at java.util.TimerThread.mainLoop(Timer.java:555)
>>> at java.util.TimerThread.run(Timer.java:505)
>>> Caused by: The credentials given by the user are incorrect, so access has
>>> been denied, and you have not been issued a session handle.
>>> at com.xensource.xenapi.Types.checkResponse(Types.java:322)
>>> at com.xensource.xenapi.Connection.dispatch(Connection.java:350)
>>> at com.xensource.xenapi.Session.loginWithPassword(Session.java:537)
>>> at
>>> com.cloud.hypervisor.xen.resource.XenServerConnectionPool.loginWithPassword(XenServerConnectionPool.java:321)
>>> at
>>> com.cloud.hypervisor.xen.resource.XenServerConnectionPool.getConnect(XenServerConnectionPool.java:154)
>>> ... 17 more
>>> 2014-06-30 12:56:06,864 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>> (ClusteredAgentManager Timer:ctx-060c8ace) Loading directly connected host
>>> 2(srvengxen02)
>>> 2014-06-30 12:56:09,225 DEBUG [c.c.s.StatsCollector]
>>> (StatsCollector-1:ctx-8458e286) HostStatsCollector is running...
>>> 2014-06-30 12:56:09,226 DEBUG [c.c.s.StatsCollector]
>>> (StatsCollector-2:ctx-aa245eed) VmStatsCollector is running...
>>> 2014-06-30 12:56:09,227 DEBUG [c.c.s.StatsCollector]
>>> (StatsCollector-3:ctx-19894fa1) StorageCollector is running...
>>> 2014-06-30 12:56:09,230 DEBUG [c.c.s.StatsCollector]
>>> (StatsCollector-4:ctx-d66c71fb) AutoScaling Monitor is running...
>>>
>>>
>>>
>>> On Jun 30, 2014, at 9:54 AM, Carlos Reátegui <[email protected]> wrote:
>>>
>>>> Hi Sudha,
>>>> Thanks for checking in. I was out for the weekend and just getting back
>>>> to this now.
>>>>
>>>> My main question at this point is if it is ok for me to kill the system
>>>> vms with the xe vm-shutdown command since the script provided by
>>>> cloudstack does not work with ubuntu.
>>>>
>>>> Also it would be great if someone could have a look at my logs to see if
>>>> they look normal. I am seeing a lot of HA-Worker messages but I do not
>>>> have an HA deployment (unless this is the thread that keeps the system vas
>>>> running).
>>>>
>>>> thanks,
>>>> Carlos
>>>>
>>>>
>>>>
>>>> On Jun 29, 2014, at 11:51 PM, Sudha Ponnaganti
>>>> <[email protected]> wrote:
>>>>
>>>>> Hi Carlos,
>>>>>
>>>>> Were you able to resolve the following? Was your upgrade successful?
>>>>>
>>>>> Thanks
>>>>> /sudha
>>>>>
>>>>> -----Original Message-----
>>>>> From: Carlos Reátegui [mailto:[email protected]]
>>>>> Sent: Friday, June 27, 2014 8:55 PM
>>>>> To: CloudStack-Users
>>>>> Cc: [email protected]
>>>>> Subject: 4.4 upgrade issues
>>>>>
>>>>> I am trying out the upgrade instructions from
>>>>> http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.3/rnotes.html#upgrade-from-4-1-x-to-4-3
>>>>> but going to 4.4 built from source today.
>>>>>
>>>>> My setup: XenServer 6.0.2 Hosts, Management Server on Ubuntu 12.04,
>>>>> Primary and Secondary on NFS, Basic Network, no security groups
>>>>>
>>>>> -----
>>>>> Notes on the docs:
>>>>>
>>>>> 8.4 - 8.6: This is only for hosts that use the cloudstack agent. Does not
>>>>> apply to KVM. In general this whole section does not do a good job of
>>>>> explaining what is on the MS vs the Hosts.
>>>>>
>>>>> 13: This fails on ubuntu because: cloudstack-sysvmadm sources
>>>>> /etc/rc.d/init.d/functions which does not exist on ubuntu/debian systems.
>>>>>
>>>>> 14: Copy vhf-util from where? Also the path
>>>>> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver does not
>>>>> exist on the hosts so I am assuming this is on the MS, however the MS
>>>>> already has it since it is an upgrade and was put there by the original
>>>>> install. Or is this a new version that needs to be grabbed from
>>>>> somewhere?
>>>>>
>>>>> Other: earlier versions like 4.1 worked with JDK 1.6 current releases
>>>>> require 1.7 but the Upgrade doc does not mention that.
>>>>>
>>>>> --
>>>>> Issues:
>>>>>
>>>>> Saw the following in catalina.out, not sure if it is an issues:
>>>>> Jun 27, 2014 5:28:42 PM org.apache.catalina.loader.WebappClassLoader
>>>>> validateJarFile
>>>>> INFO:
>>>>> validateJarFile(/usr/share/cloudstack-management/webapps/client/WEB-INF/lib/servlet-api-2.5-20081211.jar)
>>>>> - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class:
>>>>> javax/servlet/Servlet.class Jun 27, 2014 5:28:42 PM
>>>>> org.apache.catalina.loader.WebappClassLoader validateJarFile
>>>>> INFO:
>>>>> validateJarFile(/usr/share/cloudstack-management/webapps/client/WEB-INF/lib/tomcat-embed-core-7.0.30.jar)
>>>>> - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class:
>>>>> javax/servlet/Servlet.class
>>>>>
>>>>> Since the above script in step 13 did not work is it ok to do "xe
>>>>> vm-shutdown vm=." on each of the system vms? Will CloudStack notice they
>>>>> are ton and start new ones?
>>>>>
>>>>> Here are my log files (please note I stopped the service prior to
>>>>> capturing these logs in case you are wondering):
>>>>> Management server log:
>>>>> https://www.dropbox.com/s/7xhkutt8e724il1/management-server.log
>>>>> Catalina log:
>>>>> https://www.dropbox.com/s/f45ypkbazhkogyj/catalina.2014-06-27.log
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
