weizhouapache commented on issue #6716:
URL: https://github.com/apache/cloudstack/issues/6716#issuecomment-2051629390
> @weizhouapache Below given full log of management server while adding an
host..
>
> tail -f /var/log/cloudstack/management/management-server.log
>
> ```
> 2024-04-12 11:48:39,663 DEBUG [c.c.u.s.SSHCmdHelper]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) SSH command: sudo
/usr/share/cloudstack-common/scripts/util/keystore-setup
/etc/cloudstack/agent/agent.properties /etc/cloudstack/agent/
> SSH command output:Failed to generate CSR file, retrying after removing
existing settings
> Reverting libvirtd to not listen on TLS
> Removing cloud.* files in /etc/cloudstack/agent
> Retrying to generate CSR file
> Failed to generate CSR file while retrying
>
>
> 2024-04-12 11:48:39,663 DEBUG [c.c.u.s.SSHCmdHelper]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) Executing cmd:
sudo /usr/share/cloudstack-common/scripts/util/keystore-setup
/etc/cloudstack/agent/agent.properties /etc/cloudstack/agent/
> 2024-04-12 11:48:41,860 DEBUG [c.c.u.s.SSHCmdHelper]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) SSH command: sudo
/usr/share/cloudstack-common/scripts/util/keystore-setup
/etc/cloudstack/agent/agent.properties /etc/cloudstack/agent/
> SSH command output:
> chmod: cannot access '/etc/cloudstack/agent/agent.properties': No such
file or directory
>
> 2024-04-12 11:48:41,886 DEBUG [c.c.u.s.SSHCmdHelper]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) Executing cmd:
sudo /usr/share/cloudstack-common/scripts/util/keystore-cert-import
/etc/cloudstack/agent/agent.properties y5F5wnMdvsJSAFOw /etc/cloudstack/agent/
> 2024-04-12 11:48:42,774 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-1:ctx-2784ff02) (logid:0eda3e49) HA health check
task is running...
> 2024-04-12 11:48:42,788 DEBUG [c.c.a.ApiServlet]
(qtp239372207-307:ctx-2d97f1c5) (logid:95a2f6aa) ===START=== 192.168.10.111 --
GET command=readyForShutdown&response=json
> 2024-04-12 11:48:42,788 DEBUG [c.c.a.ApiServlet]
(qtp239372207-307:ctx-2d97f1c5) (logid:95a2f6aa) Two factor authentication is
already verified for the user 2, so skipping
> 2024-04-12 11:48:42,794 DEBUG [c.c.a.ApiServer]
(qtp239372207-307:ctx-2d97f1c5 ctx-bd572d21) (logid:95a2f6aa) CIDRs from which
account 'Account
[{"accountName":"admin","id":2,"uuid":"8b9bbc51-f746-11ee-9e73-000c29962f22"}]'
is allowed to perform API calls: 0.0.0.0/0,::/0
> 2024-04-12 11:48:42,797 INFO [o.a.c.a.DynamicRoleBasedAPIAccessChecker]
(qtp239372207-307:ctx-2d97f1c5 ctx-bd572d21) (logid:95a2f6aa) Account [Account
[{"accountName":"admin","id":2,"uuid":"8b9bbc51-f746-11ee-9e73-000c29962f22"}]]
is Root Admin or Domain Admin, all APIs are allowed.
> 2024-04-12 11:48:42,798 WARN [o.a.c.a.ProjectRoleBasedApiAccessChecker]
(qtp239372207-307:ctx-2d97f1c5 ctx-bd572d21) (logid:95a2f6aa) Project is null,
ProjectRoleBasedApiAccessChecker only applies to projects, returning API
[readyForShutdown] for user [User
{"username":"admin","uuid":"8b9cdbeb-f746-11ee-9e73-000c29962f22"}.] as allowed.
> 2024-04-12 11:48:42,799 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker]
(qtp239372207-307:ctx-2d97f1c5 ctx-bd572d21) (logid:95a2f6aa) RoleService is
enabled. We will use it instead of StaticRoleBasedAPIAccessChecker.
> 2024-04-12 11:48:42,800 DEBUG [o.a.c.r.ApiRateLimitServiceImpl]
(qtp239372207-307:ctx-2d97f1c5 ctx-bd572d21) (logid:95a2f6aa) API rate limiting
is disabled. We will not use ApiRateLimitService.
> 2024-04-12 11:48:42,802 DEBUG [c.c.a.ApiServlet]
(qtp239372207-307:ctx-2d97f1c5 ctx-bd572d21) (logid:95a2f6aa) ===END===
192.168.10.111 -- GET command=readyForShutdown&response=json
> 2024-04-12 11:48:42,929 DEBUG [c.c.u.s.SSHCmdHelper]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) SSH command: sudo
/usr/share/cloudstack-common/scripts/util/keystore-cert-import
/etc/cloudstack/agent/agent.properties y5F5wnMdvsJSAFOw /etc/cloudstack/agent/
> SSH command output:Failed to find keystore passphrase from file:
/etc/cloudstack/agent/agent.properties, quitting!
>
>
> 2024-04-12 11:48:42,929 DEBUG [c.c.u.s.SSHCmdHelper]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) Executing cmd:
sudo /usr/share/cloudstack-common/scripts/util/keystore-cert-import
/etc/cloudstack/agent/agent.properties y5F5wnMdvsJSAFOw /etc/cloudstack/agent/
> 2024-04-12 11:48:43,414 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Vm-Operations-Cleanup-1:ctx-e1dfc0f1) (logid:c70e7745) VM Operation Thread
Running
> 2024-04-12 11:48:43,420 DEBUG [o.a.c.c.ClusterDrsServiceImpl]
(VMSchedulerPollTask:ctx-6086b31e) (logid:e94208a8) ClusterDRS.poll is being
called at 2024-04-12 11:49:00 GMT
> 2024-04-12 11:48:43,425 DEBUG [o.a.c.c.ClusterDrsServiceImpl]
(VMSchedulerPollTask:ctx-6086b31e) (logid:e94208a8) Removed 0 old drs migration
plans
> 2024-04-12 11:48:43,431 DEBUG [o.a.c.v.s.VMSchedulerImpl]
(VMSchedulerPollTask:ctx-980e9c28) (logid:f9c3982d) VM scheduler.poll is being
called at 2024-04-12 11:49:00 GMT
> 2024-04-12 11:48:43,434 DEBUG [o.a.c.v.s.VMSchedulerImpl]
(VMSchedulerPollTask:ctx-980e9c28) (logid:f9c3982d) Got 0 scheduled jobs to be
executed at 2024-04-12 11:49:00 GMT
> 2024-04-12 11:48:43,436 INFO [o.a.c.v.s.VMSchedulerImpl]
(VMSchedulerPollTask:ctx-980e9c28) (logid:f9c3982d) Cleaned up 0 VM scheduled
job entries
> 2024-04-12 11:48:43,994 DEBUG [c.c.u.s.SSHCmdHelper]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) SSH command: sudo
/usr/share/cloudstack-common/scripts/util/keystore-cert-import
/etc/cloudstack/agent/agent.properties y5F5wnMdvsJSAFOw /etc/cloudstack/agent/
> SSH command output:Failed to find keystore passphrase from file:
/etc/cloudstack/agent/agent.properties, quitting!
>
>
> 2024-04-12 11:48:43,994 DEBUG [c.c.u.s.SSHCmdHelper]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) Executing cmd:
sudo /usr/share/cloudstack-common/scripts/util/keystore-cert-import
/etc/cloudstack/agent/agent.properties y5F5wnMdvsJSAFOw /etc/cloudstack/agent/
> 2024-04-12 11:48:45,058 DEBUG [c.c.u.s.SSHCmdHelper]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) SSH command: sudo
/usr/share/cloudstack-common/scripts/util/keystore-cert-import
/etc/cloudstack/agent/agent.properties y5F5wnMdvsJSAFOw /etc/cloudstack/agent/
> SSH command output:Failed to find keystore passphrase from file:
/etc/cloudstack/agent/agent.properties, quitting!
>
>
> 2024-04-12 11:48:45,058 WARN [c.c.h.k.d.LibvirtServerDiscoverer]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) can't setup
agent, due to com.cloud.utils.exception.CloudRuntimeException: Failed to setup
certificate in the KVM agent's keystore file, please see logs and configure
manually! - Failed to setup certificate in the KVM agent's keystore file,
please see logs and configure manually!
> 2024-04-12 11:48:45,058 DEBUG [c.c.h.k.d.LibvirtServerDiscoverer]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) can't setup
agent, due to com.cloud.utils.exception.CloudRuntimeException: Failed to setup
certificate in the KVM agent's keystore file, please see logs and configure
manually! - Failed to setup certificate in the KVM agent's keystore file,
please see logs and configure manually!
> com.cloud.utils.exception.CloudRuntimeException: Failed to setup
certificate in the KVM agent's keystore file, please see logs and configure
manually!
> at
com.cloud.hypervisor.kvm.discoverer.LibvirtServerDiscoverer.setupAgentSecurity(LibvirtServerDiscoverer.java:206)
> at
com.cloud.hypervisor.kvm.discoverer.LibvirtServerDiscoverer.find(LibvirtServerDiscoverer.java:321)
> at
com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:827)
> at
com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:660)
> at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
> at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
> at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
> at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
> at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
> at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
> at com.sun.proxy.$Proxy195.discoverHosts(Unknown Source)
> at
org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:136)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:172)
> at com.cloud.api.ApiServer.queueCommand(ApiServer.java:803)
> at com.cloud.api.ApiServer.handleRequest(ApiServer.java:624)
> at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:342)
> at com.cloud.api.ApiServlet$1.run(ApiServlet.java:149)
> at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
> at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
> at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
> at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:146)
> at com.cloud.api.ApiServlet.doPost(ApiServlet.java:105)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:665)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
> at
org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1450)
> at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
> at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554)
> at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
> at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600)
> at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
> at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
> at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
> at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
> at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
> at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
> at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
> at
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
> at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)
> at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
> at org.eclipse.jetty.server.Server.handle(Server.java:516)
> at
org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
> at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
> at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
> at
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
> at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
> at
org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
> at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
> at
org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
> at java.base/java.lang.Thread.run(Thread.java:829)
> 2024-04-12 11:48:45,059 DEBUG [c.c.r.ResourceManagerImpl]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) Could not add
host at [http://192.168.10.118] with zone [6], pod [7] and cluster [6] due to:
[ can't setup agent, due to com.cloud.utils.exception.CloudRuntimeException:
Failed to setup certificate in the KVM agent's keystore file, please see logs
and configure manually! - Failed to setup certificate in the KVM agent's
keystore file, please see logs and configure manually!].
> com.cloud.exception.DiscoveredWithErrorException: can't setup agent, due
to com.cloud.utils.exception.CloudRuntimeException: Failed to setup certificate
in the KVM agent's keystore file, please see logs and configure manually! -
Failed to setup certificate in the KVM agent's keystore file, please see logs
and configure manually!
> at
com.cloud.hypervisor.kvm.discoverer.LibvirtServerDiscoverer.find(LibvirtServerDiscoverer.java:376)
> at
com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:827)
> at
com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:660)
> at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
> at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
> at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
> at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
> at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
> at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
> at com.sun.proxy.$Proxy195.discoverHosts(Unknown Source)
> at
org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:136)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:172)
> at com.cloud.api.ApiServer.queueCommand(ApiServer.java:803)
> at com.cloud.api.ApiServer.handleRequest(ApiServer.java:624)
> at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:342)
> at com.cloud.api.ApiServlet$1.run(ApiServlet.java:149)
> at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
> at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
> at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
> at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:146)
> at com.cloud.api.ApiServlet.doPost(ApiServlet.java:105)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:665)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
> at
org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1450)
> at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
> at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554)
> at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
> at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600)
> at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
> at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
> at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
> at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
> at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
> at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
> at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
> at
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
> at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)
> at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
> at org.eclipse.jetty.server.Server.handle(Server.java:516)
> at
org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
> at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
> at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
> at
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
> at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
> at
org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
> at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
> at
org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to
setup certificate in the KVM agent's keystore file, please see logs and
configure manually!
> at
com.cloud.hypervisor.kvm.discoverer.LibvirtServerDiscoverer.setupAgentSecurity(LibvirtServerDiscoverer.java:206)
> at
com.cloud.hypervisor.kvm.discoverer.LibvirtServerDiscoverer.find(LibvirtServerDiscoverer.java:321)
> at
com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:827)
> ... 60 more
> 2024-04-12 11:48:45,060 INFO [c.c.u.e.CSExceptionErrorCode]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) Could not find
exception: com.cloud.exception.DiscoveryException in error code list for
exceptions
> 2024-04-12 11:48:45,060 WARN [o.a.c.a.c.a.h.AddHostCmd]
(qtp239372207-304:ctx-e8455b79 ctx-8e6fb9a4) (logid:c5b46620) Exception:
> com.cloud.exception.DiscoveryException: Could not add host at
[http://192.168.10.118] with zone [6], pod [7] and cluster [6] due to: [ can't
setup agent, due to com.cloud.utils.exception.CloudRuntimeException: Failed to
setup certificate in the KVM agent's keystore file, please see logs and
configure manually! - Failed to setup certificate in the KVM agent's keystore
file, please see logs and configure manually!].
> at
com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:834)
> at
com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:660)
> at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
> at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
> at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
> at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
> at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
> at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
> at com.sun.proxy.$Proxy195.discoverHosts(Unknown Source)
> at
org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:136)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:172)
> at com.cloud.api.ApiServer.queueCommand(ApiServer.java:803)
> at com.cloud.api.ApiServer.handleRequest(ApiServer.java:624)
> at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:342)
> at com.cloud.api.ApiServlet$1.run(ApiServlet.java:149)
> at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
> at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
> at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
> at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:146)
> at com.cloud.api.ApiServlet.doPost(ApiServlet.java:105)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:665)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
> at
org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1450)
> at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
> at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554)
> at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
> at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600)
> at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
> at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
> at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
> at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
> at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
> at
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
> at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
> at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
> at
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
> at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)
> at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
> at org.eclipse.jetty.server.Server.handle(Server.java:516)
> at
org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
> at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
> at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
> at
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
> at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
> at
org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
> at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
> at
org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: com.cloud.exception.DiscoveredWithErrorException: can't setup
agent, due to com.cloud.utils.exception.CloudRuntimeException: Failed to setup
certificate in the KVM agent's keystore file, please see logs and configure
manually! - Failed to setup certificate in the KVM agent's keystore file,
please see logs and configure manually!
> at
com.cloud.hypervisor.kvm.discoverer.LibvirtServerDiscoverer.find(LibvirtServerDiscoverer.java:376)
> at
com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:827)
> at
com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:660)
> ... 59 more
> Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to
setup certificate in the KVM agent's keystore file, please see logs and
configure manually!
> at
com.cloud.hypervisor.kvm.discoverer.LibvirtServerDiscoverer.setupAgentSecurity(LibvirtServerDiscoverer.java:206)
> at
com.cloud.hypervisor.kvm.discoverer.LibvirtServerDiscoverer.find(LibvirtServerDiscoverer.java:321)
> at
com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:827)
> ... 60 more
> ```
>
> i could'nt see any log for setup...while checking on the path
/var/log/cloudstack/agent/ is an empty directory
>
> 
can you upload the logs right after `command=addHost` ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
