Hi, You can check the /var/log/cloud.log in SSVM
Since the agent status of CPVM is Up, I suspect the Alert state with SSVM is related to the secondary storage. -Wei On Mon, Feb 17, 2025 at 5:31 PM TechnologyRss <technologyrss.m...@gmail.com> wrote: > Hello, > > ALL is working fine but ssvm agent status is Alert what is my setup > problem... > What can I do now ? How can I troubleshoot? > https://prnt.sc/s-OtND4iXJvh > > See log from below link > https://drive.google.com/drive/folders/1Efcuzx64fV1pbRH00Ya_tRIRfs9bjCXL > -- > > > *Thanks & Regards.**Support Admin* > ------------------------------ > > > *Facebook <https://www.facebook.com/TechnologyRSS> | Twitter > <https://twitter.com/technologyrss1> | YouTube > <https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw> | LinkedIn > <https://www.linkedin.com/company/technologyrss/>**Address : *Rayerbagh > Complex Super Market > Level #01, Shop No #211, Rayerbagh Bus Stand > Dhaka. Bangladesh > *Mob :* +88 01716915504 > *Email :* support.ad...@technologyrss.com > *Web :* www.technologyrss.com > > > On Mon, Feb 17, 2025 at 6:26 PM TechnologyRss < > technologyrss.m...@gmail.com> > wrote: > > > I am added manually but I see ssvm & cpvm create and deleted > > see kvm error log > > +++++++++++++++++++++ > > 2025-02-17 13:04:21,387 WARN [kvm.resource.LibvirtKvmAgentHook] > > (agentRequest-Handler-2:[]) (logid:e9f76953) Groovy script > > '/etc/cloudstack/agent/hooks/libvirt-vm-xml-transformer.groovy' is not > > available. Transformations will not be applied. > > 2025-02-17 13:04:21,387 WARN [kvm.resource.LibvirtKvmAgentHook] > > (agentRequest-Handler-2:[]) (logid:e9f76953) Groovy scripting engine is > not > > initialized. Data transformation skipped. > > 2025-02-17 13:04:21,486 WARN > > [resource.wrapper.LibvirtStartCommandWrapper] > (agentRequest-Handler-4:[]) > > (logid:727c93eb) LibvirtException org.libvirt.LibvirtException: internal > > error: process exited while connecting to monitor: > > 2025-02-17T12:04:21.271945Z qemu-kvm: -blockdev > > > {"driver":"gluster","volume":"primary","path":"12a81185-5997-4591-a778-10aef3faa6c0","server":[{"type":"inet","host":"192.168.1.1","port":"24007"}],"debug":4,"node-name":"libvirt-2-storage","auto-read-only":true,"discard":"unmap","cache":{"direct":true,"no-flush":false}}: > > Unknown driver 'gluster' > > at org.libvirt.ErrorHandler.processError(Unknown Source) > > at org.libvirt.ErrorHandler.processError(Unknown Source) > > at org.libvirt.Connect.domainCreateXML(Unknown Source) > > at > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1909) > > at > > > com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:87) > > at > > > com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:48) > > at > > > com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78) > > at > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1945) > > at com.cloud.agent.Agent.processRequest(Agent.java:686) > > at > > com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1109) > > at com.cloud.utils.nio.Task.call(Task.java:83) > > at com.cloud.utils.nio.Task.call(Task.java:29) > > at > > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > > at > > > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) > > at > > > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) > > at java.base/java.lang.Thread.run(Thread.java:840) > > > > 2025-02-17 13:04:21,512 INFO [kvm.storage.LibvirtStorageAdaptor] > > (agentRequest-Handler-4:[]) (logid:727c93eb) Trying to fetch storage pool > > 9fcb2109-a2db-3bb3-856a-70c37fd44f46 from libvirt > > 2025-02-17 13:04:22,254 WARN > > [resource.wrapper.LibvirtStartCommandWrapper] > (agentRequest-Handler-2:[]) > > (logid:e9f76953) LibvirtException org.libvirt.LibvirtException: internal > > error: QEMU unexpectedly closed the monitor (vm='s-4-VM'): > > 2025-02-17T12:04:21.905873Z qemu-kvm: -blockdev > > > {"driver":"gluster","volume":"primary","path":"a3873a92-2ada-4dfc-8652-146d1f7d7ef3","server":[{"type":"inet","host":"192.168.1.1","port":"24007"}],"debug":4,"node-name":"libvirt-2-storage","auto-read-only":true,"discard":"unmap","cache":{"direct":true,"no-flush":false}}: > > Unknown driver 'gluster' > > at org.libvirt.ErrorHandler.processError(Unknown Source) > > at org.libvirt.ErrorHandler.processError(Unknown Source) > > at org.libvirt.Connect.domainCreateXML(Unknown Source) > > at > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1909) > > at > > > com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:87) > > at > > > com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:48) > > at > > > com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78) > > at > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1945) > > at com.cloud.agent.Agent.processRequest(Agent.java:686) > > at > > com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1109) > > at com.cloud.utils.nio.Task.call(Task.java:83) > > at com.cloud.utils.nio.Task.call(Task.java:29) > > at > > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > > at > > > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) > > at > > > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) > > at java.base/java.lang.Thread.run(Thread.java:840) > > > > 2025-02-17 13:04:22,278 INFO [kvm.storage.LibvirtStorageAdaptor] > > (agentRequest-Handler-2:[]) (logid:e9f76953) Trying to fetch storage pool > > 9fcb2109-a2db-3bb3-856a-70c37fd44f46 from libvirt > > 2025-02-17 13:04:25,374 INFO [kvm.resource.LibvirtConnection] > > (agentRequest-Handler-1:[]) (logid:e9f76953) No existing libvirtd > > connection found. Opening a new one > > +++++++++++++++++++ > > -- > > > > > > *Thanks & Regards.**Support Admin* > > ------------------------------ > > > > > > *Facebook <https://www.facebook.com/TechnologyRSS> | Twitter > > <https://twitter.com/technologyrss1> | YouTube > > <https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw> | LinkedIn > > <https://www.linkedin.com/company/technologyrss/>**Address : *Rayerbagh > > Complex Super Market > > Level #01, Shop No #211, Rayerbagh Bus Stand > > Dhaka. Bangladesh > > *Mob :* +88 01716915504 > > *Email :* support.ad...@technologyrss.com > > *Web :* www.technologyrss.com > > > > > > On Mon, Feb 17, 2025 at 6:01 PM Wei ZHOU <ustcweiz...@gmail.com> wrote: > > > >> Yes, this seems to be a UI bug. > >> As a workaround, you can manually add primary and secondary store and > >> enable the zone > >> > >> > >> -Wei > >> > >> On Mon, Feb 17, 2025 at 12:56 PM TechnologyRss < > >> technologyrss.m...@gmail.com> > >> wrote: > >> > >> > I delete db and then re create zone but I see my host is error > >> > https://prnt.sc/xIJVKgGbgZ7O > >> > but open another window and access my cloud zone and then see host is > up > >> > https://prnt.sc/xIJVKgGbgZ7O > >> > primary and secondary not added at that time can I add it manually ? > >> > > >> > -- > >> > > >> > > >> > *Thanks & Regards.**Support Admin* > >> > ------------------------------ > >> > > >> > > >> > *Facebook <https://www.facebook.com/TechnologyRSS> | Twitter > >> > <https://twitter.com/technologyrss1> | YouTube > >> > <https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw> | LinkedIn > >> > <https://www.linkedin.com/company/technologyrss/>**Address : > *Rayerbagh > >> > Complex Super Market > >> > Level #01, Shop No #211, Rayerbagh Bus Stand > >> > Dhaka. Bangladesh > >> > *Mob :* +88 01716915504 > >> > *Email :* support.ad...@technologyrss.com > >> > *Web :* www.technologyrss.com > >> > > >> > > >> > On Mon, Feb 17, 2025 at 10:00 AM TechnologyRss < > >> > technologyrss.m...@gmail.com> > >> > wrote: > >> > > >> > > Now I see create ssvm and cpvm but dont start properly, auto create > >> and > >> > > auto delete it. I think secondary storage issue, secondary storage > >> > iptables > >> > > ensble needed or not? > >> > > > >> > > On Sun, 16 Feb 2025, 10:01 pm TechnologyRss, < > >> > technologyrss.m...@gmail.com> > >> > > wrote: > >> > > > >> > >> Yes now I am use same as ip all status is ok but ssvm and cpvm dont > >> > >> create, what can I do? > >> > >> > >> > >> On Sun, 16 Feb 2025, 9:11 pm Wei ZHOU, <ustcweiz...@gmail.com> > >> wrote: > >> > >> > >> > >>> Please check your network design. > >> > >>> The systemvm IP should be able to reach 192.168.1.x > >> > >>> You can use 192.168.1.x as pod IP > >> > >>> > >> > >>> > >> > >>> -Wei > >> > >>> > >> > >>> > >> > >>> > >> > >>> On Sunday, February 16, 2025, TechnologyRss < > >> > >>> technologyrss.m...@gmail.com> > >> > >>> wrote: > >> > >>> > >> > >>> > Any update for me what can I do now, please > >> > >>> > > >> > >>> > On Sun, 16 Feb 2025, 6:40 pm TechnologyRss, < > >> > >>> technologyrss.m...@gmail.com> > >> > >>> > wrote: > >> > >>> > > >> > >>> > > 1. I am using management and all server LAN is 192.168.1.0/24 > >> > >>> > > 2. Create pod using 192.168.3.0/24 > >> > >>> > > I am remove public ip and replace 192.168.1.0 network ip, > >> error is > >> > >>> same > >> > >>> > > > >> > >>> > > On Sun, 16 Feb 2025, 6:07 pm Wei ZHOU, <ustcweiz...@gmail.com > > > >> > >>> wrote: > >> > >>> > > > >> > >>> > >> Change to the IP on management network and retry. > >> > >>> > >> > >> > >>> > >> > >> > >>> > >> > >> > >>> > >> > >> > >>> > >> On Sunday, February 16, 2025, TechnologyRss < > >> > >>> > technologyrss.m...@gmail.com > >> > >>> > >> > > >> > >>> > >> wrote: > >> > >>> > >> > >> > >>> > >> > I see this is cloud management server public ip address, > >> > >>> > >> > https://prnt.sc/iwdoRVir9V7v > >> > >>> > >> > > >> > >>> > >> > On Sun, 16 Feb 2025, 5:29 pm TechnologyRss, < > >> > >>> > >> technologyrss.m...@gmail.com> > >> > >>> > >> > wrote: > >> > >>> > >> > > >> > >>> > >> > > Sorry, I am not clear which setting you want to see, > >> please > >> > >>> let me > >> > >>> > >> know > >> > >>> > >> > > details > >> > >>> > >> > > > >> > >>> > >> > > On Sun, 16 Feb 2025, 5:19 pm Wei ZHOU, < > >> ustcweiz...@gmail.com > >> > > > >> > >>> > wrote: > >> > >>> > >> > > > >> > >>> > >> > >> I could not find the setting "host" > >> > >>> > >> > >> > >> > >>> > >> > >> > >> > >>> > >> > >> > >> > >>> > >> > >> On Sunday, February 16, 2025, TechnologyRss < > >> > >>> > >> > technologyrss.m...@gmail.com > >> > >>> > >> > >> > > >> > >>> > >> > >> wrote: > >> > >>> > >> > >> > >> > >>> > >> > >> > Please see https://prnt.sc/qdjEreosdCtm > >> > >>> > >> > >> > > >> > >>> > >> > >> > On Sun, 16 Feb 2025, 5:05 pm Wei ZHOU, < > >> > >>> ustcweiz...@gmail.com> > >> > >>> > >> wrote: > >> > >>> > >> > >> > > >> > >>> > >> > >> > > Please check the global setting "host" > >> > >>> > >> > >> > > > >> > >>> > >> > >> > > > >> > >>> > >> > >> > > > >> > >>> > >> > >> > > On Sunday, February 16, 2025, TechnologyRss < > >> > >>> > >> > >> > technologyrss.m...@gmail.com> > >> > >>> > >> > >> > > wrote: > >> > >>> > >> > >> > > > >> > >>> > >> > >> > > > Host added done using reinstall cloud agent. But I > >> see > >> > >>> > >> different > >> > >>> > >> > >> error. > >> > >>> > >> > >> > > > Ssvm status error. Not open console. > >> > >>> > >> > >> > > > My added kvm host status is > >> > https://prnt.sc/8fBmSNCSbVv- > >> > >>> > >> > >> > > > Primary storage is gluster volume added > >> > >>> > >> > >> https://prnt.sc/25aXAZ8K6ubz > >> > >>> > >> > >> > > > SSVm & CPVM is https://prnt.sc/j_8S1Gv-dTxt > >> > >>> > >> > >> > > > > >> > >>> > >> > >> > > > Error from SSVM no rote to hos. > >> > >>> > >> > >> > > > +++++++++++++++ > >> > >>> > >> > >> > > > at > >> > com.cloud.agent.AgentShell.start(AgentShell.java:512) > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]: at > >> > >>> > >> > >> > > > > com.cloud.agent.AgentShell.main(AgentShell.java:542) > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]: Caused by: > >> > >>> > >> > >> > > > java.net.NoRouteToHostException: No route to host > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]: at > >> > >>> > >> > >> > > > java.base/sun.nio.ch.Net.connect0(Native Method) > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]: at > >> > >>> > >> > >> > > > java.base/sun.nio.ch.Net.connect(Net.java:579) > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]: at > >> > >>> > >> > >> > > > java.base/sun.nio.ch.Net.connect(Net.java:586) > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]: at > >> > >>> > >> > >> > > > java.base/sun.nio.ch > >> > >>> > >> > >> > > > .SocketChannelImpl.connect(SocketChannelImpl.java:853) > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]: at > >> > >>> > >> > >> > > > > >> com.cloud.utils.nio.NioClient.init(NioClient.java:54) > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]: at > >> > >>> > >> > >> > > > com.cloud.utils.nio.NioConnection.start( > >> > >>> > NioConnection.java:96) > >> > >>> > >> > >> > > > +++++++++++++ > >> > >>> > >> > >> > > > > >> > >>> > >> > >> > > > Please give me an idea what is issue ? > >> > >>> > >> > >> > > > > >> > >>> > >> > >> > > > On Sat, 15 Feb 2025, 1:40 pm TechnologyRss, < > >> > >>> > >> > >> > > technologyrss.m...@gmail.com> > >> > >>> > >> > >> > > > wrote: > >> > >>> > >> > >> > > > > >> > >>> > >> > >> > > > > I added this interface and then remove all file > >> from > >> > >>> > >> > >> > > > > rm -rf /etc/cloudstack/agent/* > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > Then I try to add host but I see different error > >> as > >> > >>> like > >> > >>> > >> below. > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > +++++++++++++++++++ > >> > >>> > >> > >> > > > > Error 530 > >> > >>> > >> > >> > > > > Could not add host at [http://192.168.1.120] > with > >> > zone > >> > >>> > [1], > >> > >>> > >> pod > >> > >>> > >> > >> [1] > >> > >>> > >> > >> > > and > >> > >>> > >> > >> > > > > cluster [1] due to: [ can't setup agent, due to > >> > >>> > >> > >> > > > > com.cloud.utils.exception.CloudRuntimeException: > >> > >>> Failed to > >> > >>> > >> > setup > >> > >>> > >> > >> > > > > certificate in the KVM agent's keystore file, > >> please > >> > >>> see > >> > >>> > logs > >> > >>> > >> > and > >> > >>> > >> > >> > > > configure > >> > >>> > >> > >> > > > > manually! - Failed to setup certificate in the > KVM > >> > >>> agent's > >> > >>> > >> > >> keystore > >> > >>> > >> > >> > > file, > >> > >>> > >> > >> > > > > please see logs and configure manually!]. > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > Please see this > >> > >>> > >> > >> > > > > -- > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > *Thanks & Regards.**Support Admin* > >> > >>> > >> > >> > > > > ------------------------------ > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > *Facebook < > https://www.facebook.com/TechnologyRSS> > >> | > >> > >>> > Twitter > >> > >>> > >> > >> > > > > <https://twitter.com/technologyrss1> | YouTube > >> > >>> > >> > >> > > > > < > >> > >>> https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw> > >> > >>> > | > >> > >>> > >> > >> > LinkedIn > >> > >>> > >> > >> > > > > < > https://www.linkedin.com/company/technologyrss/ > >> > >>> >**Address > >> > >>> > : > >> > >>> > >> > >> > > *Rayerbagh > >> > >>> > >> > >> > > > > Complex Super Market > >> > >>> > >> > >> > > > > Level #01, Shop No #211, Rayerbagh Bus Stand > >> > >>> > >> > >> > > > > Dhaka. Bangladesh > >> > >>> > >> > >> > > > > *Mob :* +88 01716915504 > >> > >>> > >> > >> > > > > *Email :* support.ad...@technologyrss.com > >> > >>> > >> > >> > > > > *Web :* www.technologyrss.com > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > On Sat, Feb 15, 2025 at 12:20 AM Wei ZHOU < > >> > >>> > >> > ustcweiz...@gmail.com> > >> > >>> > >> > >> > > wrote: > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > >> please check this error > >> > >>> > >> > >> > > > >> > >> > >>> > >> > >> > > > >> 2025-02-14 18:12:17,786 WARN > >> > >>> > >> [o.a.c.e.o.NetworkOrchestrator] > >> > >>> > >> > >> > > > >> (AgentConnectTaskPool-1:[ctx-d4de9400]) > >> > >>> (logid:2a710cff) > >> > >>> > >> > Unable > >> > >>> > >> > >> to > >> > >>> > >> > >> > > > setup > >> > >>> > >> > >> > > > >> agent 1 due to Can not find network: cloudbr1 > >> > >>> > >> > >> > > > >> > >> > >>> > >> > >> > > > >> > >> > >>> > >> > >> > > > >> -Wei > >> > >>> > >> > >> > > > >> > >> > >>> > >> > >> > > > >> On Fri, Feb 14, 2025 at 2:40 PM TechnologyRss < > >> > >>> > >> > >> > > > >> technologyrss.m...@gmail.com> > >> > >>> > >> > >> > > > >> wrote: > >> > >>> > >> > >> > > > >> > >> > >>> > >> > >> > > > >> > Hello, > >> > >>> > >> > >> > > > >> > > >> > >>> > >> > >> > > > >> > I am using primary storage is gluster and > >> > secondary > >> > >>> > >> storage > >> > >>> > >> > is > >> > >>> > >> > >> > nfs, > >> > >>> > >> > >> > > I > >> > >>> > >> > >> > > > >> can't > >> > >>> > >> > >> > > > >> > add host to management server, please see my > >> both > >> > >>> cloud > >> > >>> > >> log > >> > >>> > >> > >> from > >> > >>> > >> > >> > > below > >> > >>> > >> > >> > > > >> > link. > >> > >>> > >> > >> > > > >> > > >> > >>> > >> > >> > > > >> > https://shorturl.at/pfB1N > >> > >>> > >> > >> > > > >> > > >> > >>> > >> > >> > > > >> > > >> > >>> > >> > >> > > > >> > -- > >> > >>> > >> > >> > > > >> > > >> > >>> > >> > >> > > > >> > > >> > >>> > >> > >> > > > >> > *Thanks & Regards.**Support Admin* > >> > >>> > >> > >> > > > >> > ------------------------------ > >> > >>> > >> > >> > > > >> > > >> > >>> > >> > >> > > > >> > > >> > >>> > >> > >> > > > >> > *Facebook < > >> https://www.facebook.com/TechnologyRSS > >> > > > >> > >>> | > >> > >>> > >> Twitter > >> > >>> > >> > >> > > > >> > <https://twitter.com/technologyrss1> | > YouTube > >> > >>> > >> > >> > > > >> > <https://www.youtube.com/channel/ > >> > >>> > UCBq7qGqFEUe6ObVHMuxudTw> > >> > >>> > >> | > >> > >>> > >> > >> > > LinkedIn > >> > >>> > >> > >> > > > >> > < > >> https://www.linkedin.com/company/technologyrss/ > >> > >** > >> > >>> > Address > >> > >>> > >> : > >> > >>> > >> > >> > > > *Rayerbagh > >> > >>> > >> > >> > > > >> > Complex Super Market > >> > >>> > >> > >> > > > >> > Level #01, Shop No #211, Rayerbagh Bus Stand > >> > >>> > >> > >> > > > >> > Dhaka. Bangladesh > >> > >>> > >> > >> > > > >> > *Mob :* +88 01716915504 > >> > >>> > >> > >> > > > >> > *Email :* support.ad...@technologyrss.com > >> > >>> > >> > >> > > > >> > *Web :* www.technologyrss.com > >> > >>> > >> > >> > > > >> > > >> > >>> > >> > >> > > > >> > >> > >>> > >> > >> > > > > > >> > >>> > >> > >> > > > > >> > >>> > >> > >> > > > >> > >>> > >> > >> > > >> > >>> > >> > >> > >> > >>> > >> > > > >> > >>> > >> > > >> > >>> > >> > >> > >>> > > > >> > >>> > > >> > >>> > >> > >> > >> > > >> > > >
