After much hard work now I am all success status, all status is working
fine,
Last I am changed to the ssvm and cpvm used as local storage when creating
the zone.
I think primary storage can't create ssvm and cpvm volume disk,

1. one thing I see on the dashboard is secondary storage is 00.00 but why ?
https://prnt.sc/WAlemWV6xIqH

Now I am try to upload iso then I create vm instance, 🙂

Please connect with us for next any help needed,

Your kindness has been much appreciated.
--


*Thanks & Regards.**Support Admin*
------------------------------


*Facebook <https://www.facebook.com/TechnologyRSS> | Twitter
<https://twitter.com/technologyrss1> | YouTube
<https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw> | LinkedIn
<https://www.linkedin.com/company/technologyrss/>**Address : *Rayerbagh
Complex Super Market
Level #01, Shop No #211, Rayerbagh Bus Stand
Dhaka. Bangladesh
*Mob :* +88 01716915504
*Email :* support.ad...@technologyrss.com
*Web :* www.technologyrss.com


On Tue, Feb 18, 2025 at 7:40 PM TechnologyRss <technologyrss.m...@gmail.com>
wrote:

> Skip previous error, because I think my primary storage problem, so I try
> to use primary storage as nfs,
> But in my production environment needed use gluster primary storage and
> nfs as secondary storage,
> So now I am again deleting the zone and creating using primary gluster but
> I see below error.
> primary status is up https://prnt.sc/DfjwH7mZi-BG
>
> this error from kvm host.
> ++++++++++
> 2025-02-18 14:33:46,951 WARN
>  [resource.wrapper.LibvirtStartCommandWrapper] (agentRequest-Handler-4:[])
> (logid:2c7d971e) LibvirtException org.libvirt.LibvirtException: internal
> error: process exited while connecting to monitor:
> 2025-02-18T13:33:46.747677Z qemu-kvm: -blockdev
> {"driver":"gluster","volume":"primary","path":"ba0511fb-e5be-48f4-9aa3-823f04077a41","server":[{"type":"inet","host":"192.168.1.1","port":"24007"}],"debug":4,"node-name":"libvirt-2-storage","auto-read-only":true,"discard":"unmap","cache":{"direct":true,"no-flush":false}}:
> Unknown driver 'gluster'
>         at org.libvirt.ErrorHandler.processError(Unknown Source)
>         at org.libvirt.ErrorHandler.processError(Unknown Source)
>         at org.libvirt.Connect.domainCreateXML(Unknown Source)
>         at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1909)
>         at
> com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:87)
>         at
> com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:48)
>         at
> com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
>         at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1945)
>         at com.cloud.agent.Agent.processRequest(Agent.java:686)
>         at
> com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1109)
>         at com.cloud.utils.nio.Task.call(Task.java:83)
>         at com.cloud.utils.nio.Task.call(Task.java:29)
>         at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>         at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
>         at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
>         at java.base/java.lang.Thread.run(Thread.java:840)
> ++++++++++++
>
> --
>
>
> *Thanks & Regards.**Support Admin*
> ------------------------------
>
>
> *Facebook <https://www.facebook.com/TechnologyRSS> | Twitter
> <https://twitter.com/technologyrss1> | YouTube
> <https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw> | LinkedIn
> <https://www.linkedin.com/company/technologyrss/>**Address : *Rayerbagh
> Complex Super Market
> Level #01, Shop No #211, Rayerbagh Bus Stand
> Dhaka. Bangladesh
> *Mob :* +88 01716915504
> *Email :* support.ad...@technologyrss.com
> *Web :* www.technologyrss.com
>
>
> On Tue, Feb 18, 2025 at 5:40 PM Wei ZHOU <ustcweiz...@gmail.com> wrote:
>
>> I do not understand "alert is running" .
>>
>> As I remember, there are routes for DNS servers in system vms
>> Can you share the output of the "ip route" command ?
>> If your management network cannot reach the public internet, you may
>> remove
>> the route for 8.8.8.8
>>
>>
>>
>>
>>
>>
>> -Wei
>>
>> On Tue, Feb 18, 2025 at 12:15 PM TechnologyRss <
>> technologyrss.m...@gmail.com>
>> wrote:
>>
>> > Now I am using 1.1.1.1 then ping internet is ok, but alert is running.
>> >
>> > On Tue, 18 Feb 2025, 5:11 pm Wei ZHOU, <ustcweiz...@gmail.com> wrote:
>> >
>> > > Hi,
>> > >
>> > > Do you use 8.8.8.8 as internal DNS or public DNS ?
>> > >
>> > > Can you ping other DNS servers, for example 1.1.1.1 or 9.9.9.9 ?
>> > >
>> > > -Wei
>> > >
>> > > On Tue, Feb 18, 2025 at 10:20 AM TechnologyRss <
>> > > technologyrss.m...@gmail.com>
>> > > wrote:
>> > >
>> > > > Which version can I use production  without any error? Please let me
>> > > know.
>> > > >
>> > > > On Tue, 18 Feb 2025, 11:15 am TechnologyRss, <
>> > > technologyrss.m...@gmail.com
>> > > > >
>> > > > wrote:
>> > > >
>> > > > > All status is up and running but I see cloud log error with web
>> > *Alert
>> > > *
>> > > > >
>> > > > > *Host status *https://prnt.sc/iTLUXtXCSl9S
>> > > > > *Primary storage* https://prnt.sc/_3gNLZJpBoLk
>> > > > > *Secondary storage* https://prnt.sc/AUt-eOaVMT4v
>> > > > > *SSVM & CPVM status* https://prnt.sc/lpCfHwfiCsRG
>> > > > > *What can I do now? I am try to ping 8.8.8.8 from ssvm but not ok,
>> > but
>> > > > > ssvm got public ip address, this ip address can ping from
>> outside. *
>> > > > >
>> > > > > *++++++++++++++++*
>> > > > > 2025-02-18T05:02:40,801 INFO  [utils.nio.NioClient]
>> > > (Agent-Handler-5:[])
>> > > > > NioClient connection closed
>> > > > > 2025-02-18T05:02:45,801 INFO  [cloud.agent.Agent]
>> > (Agent-Handler-5:[])
>> > > > > Reconnecting to host:192.168.1.11
>> > > > > 2025-02-18T05:02:45,803 INFO  [utils.nio.NioClient]
>> > > (Agent-Handler-5:[])
>> > > > > Connecting to 192.168.1.11:8250
>> > > > > 2025-02-18T05:02:45,804 INFO  [utils.nio.Link]
>> (Agent-Handler-5:[])
>> > > Conf
>> > > > > file found: /usr/local/cloud/systemvm/conf/agent.properties
>> > > > > 2025-02-18T05:02:45,847 INFO  [utils.nio.NioClient]
>> > > (Agent-Handler-5:[])
>> > > > > SSL: Handshake done
>> > > > > 2025-02-18T05:02:45,847 INFO  [utils.nio.NioClient]
>> > > (Agent-Handler-5:[])
>> > > > > Connected to 192.168.1.11:8250
>> > > > > 2025-02-18T05:02:45,943 INFO  [cloud.agent.Agent]
>> > (Agent-Handler-2:[])
>> > > > > Process agent startup answer, agent id = 0
>> > > > > 2025-02-18T05:02:45,944 INFO  [cloud.agent.Agent]
>> > (Agent-Handler-2:[])
>> > > > > Startup Response Received: agent id = 0
>> > > > > 2025-02-18T05:02:45,944 INFO
>> > > > >  [storage.resource.NfsSecondaryStorageResource]
>> > > > (agentRequest-Handler-1:[])
>> > > > > Determined host 192.168.1.12 corresponds to IP 192.168.1.12
>> > > > > 2025-02-18T05:02:45,945 WARN
>> > > > >  [storage.resource.NfsSecondaryStorageResource]
>> > > > (agentRequest-Handler-1:[])
>> > > > > addRouteToInternalIp: unable to determine same subnet:
>> _eth1ip=null,
>> > > dest
>> > > > > ip=192.168.1.12, _eth1mask=null
>> > > > > 2025-02-18T05:02:45,949 WARN
>> > > > >  [storage.resource.NfsSecondaryStorageResource]
>> > > > (agentRequest-Handler-1:[])
>> > > > > Execution of process [440407] for command [/bin/bash -c ip route
>> > delete
>> > > > > 192.168.1.12 ] failed.
>> > > > > 2025-02-18T05:02:45,950 WARN
>> > > > >  [storage.resource.NfsSecondaryStorageResource]
>> > > > (agentRequest-Handler-1:[])
>> > > > > Process [440407] for command [/bin/bash -c ip route delete
>> > > 192.168.1.12 ]
>> > > > > encountered the error: [RTNETLINK answers: No such process].
>> > > > > 2025-02-18T05:02:45,954 WARN
>> > > > >  [storage.resource.NfsSecondaryStorageResource]
>> > > > (agentRequest-Handler-1:[])
>> > > > > Execution of process [440408] for command [/bin/bash -c ip route
>> add
>> > > > > 192.168.1.12 via null ] failed.
>> > > > > 2025-02-18T05:02:45,955 WARN
>> > > > >  [storage.resource.NfsSecondaryStorageResource]
>> > > > (agentRequest-Handler-1:[])
>> > > > > Process [440408] for command [/bin/bash -c ip route add
>> 192.168.1.12
>> > > via
>> > > > > null ] encountered the error: [Error: inet address is expected
>> rather
>> > > > than
>> > > > > "null".].
>> > > > > 2025-02-18T05:02:45,955 WARN
>> > > > >  [storage.resource.NfsSecondaryStorageResource]
>> > > > (agentRequest-Handler-1:[])
>> > > > > Error in configuring route to internal ip err=Error: inet address
>> is
>> > > > > expected rather than "null".
>> > > > > 2025-02-18T05:02:45,955 INFO
>> > > > >  [storage.resource.NfsSecondaryStorageResource]
>> > > > (agentRequest-Handler-1:[])
>> > > > > Determined host 192.168.1.12 corresponds to IP 192.168.1.12
>> > > > > 2025-02-18T05:02:46,081 INFO
>> > > > >  [storage.resource.NfsSecondaryStorageResource]
>> > > > (agentRequest-Handler-1:[])
>> > > > > created a thread to start post upload server
>> > > > > 2025-02-18T05:02:46,086 INFO  [handler.logging.LoggingHandler]
>> > > > > (nioEventLoopGroup-7934-1:[]) [id: 0x18271469] REGISTERED
>> > > > > 2025-02-18T05:02:46,087 INFO  [handler.logging.LoggingHandler]
>> > > > > (nioEventLoopGroup-7934-1:[]) [id: 0x18271469] BIND:
>> > > > 0.0.0.0/0.0.0.0:8210
>> > > > > 2025-02-18T05:02:46,087 INFO  [handler.logging.LoggingHandler]
>> > > > > (nioEventLoopGroup-7934-1:[]) [id: 0x18271469] CLOSE
>> > > > > 2025-02-18T05:02:46,087 INFO  [handler.logging.LoggingHandler]
>> > > > > (nioEventLoopGroup-7934-1:[]) [id: 0x18271469] UNREGISTERED
>> > > > > 2025-02-18T05:02:46,094 INFO
>> > > > >  [storage.resource.NfsSecondaryStorageResource] (Thread-3968:[])
>> > > shutting
>> > > > > down post upload server
>> > > > > 2025-02-18T05:02:50,848 INFO  [cloud.agent.Agent]
>> > (Agent-Handler-5:[])
>> > > > > Connected to the host: 192.168.1.11
>> > > > > 2025-02-18T05:02:51,128 INFO  [cloud.agent.Agent]
>> > (Agent-Handler-5:[])
>> > > > > Lost connection to host: 192.168.1.11. Attempting reconnection
>> while
>> > we
>> > > > > still have 0 commands in progress.
>> > > > > 2025-02-18T05:02:51,129 INFO  [utils.nio.NioClient]
>> > > (Agent-Handler-5:[])
>> > > > > NioClient connection closed
>> > > > >
>> > > > >
>> > > > > *++++++++++++++++++++++++*
>> > > > > --
>> > > > >
>> > > > >
>> > > > > *Thanks & Regards.**Support Admin*
>> > > > > ------------------------------
>> > > > >
>> > > > >
>> > > > > *Facebook <https://www.facebook.com/TechnologyRSS> | Twitter
>> > > > > <https://twitter.com/technologyrss1> | YouTube
>> > > > > <https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw> |
>> > LinkedIn
>> > > > > <https://www.linkedin.com/company/technologyrss/>**Address :
>> > > *Rayerbagh
>> > > > > Complex Super Market
>> > > > > Level #01, Shop No #211, Rayerbagh Bus Stand
>> > > > > Dhaka. Bangladesh
>> > > > > *Mob :* +88 01716915504
>> > > > > *Email :* support.ad...@technologyrss.com
>> > > > > *Web :* www.technologyrss.com
>> > > > >
>> > > > >
>> > > > > On Mon, Feb 17, 2025 at 11:01 PM Wei ZHOU <ustcweiz...@gmail.com>
>> > > wrote:
>> > > > >
>> > > > >> Hi,
>> > > > >>
>> > > > >> You can check the /var/log/cloud.log in SSVM
>> > > > >>
>> > > > >> Since the agent status of CPVM is Up, I suspect the Alert state
>> > with
>> > > > SSVM
>> > > > >> is related to the secondary storage.
>> > > > >>
>> > > > >>
>> > > > >> -Wei
>> > > > >>
>> > > > >> On Mon, Feb 17, 2025 at 5:31 PM TechnologyRss <
>> > > > >> technologyrss.m...@gmail.com>
>> > > > >> wrote:
>> > > > >>
>> > > > >> > Hello,
>> > > > >> >
>> > > > >> > ALL is working fine but ssvm agent status is Alert what is my
>> > setup
>> > > > >> > problem...
>> > > > >> > What can I do now ? How can I troubleshoot?
>> > > > >> > https://prnt.sc/s-OtND4iXJvh
>> > > > >> >
>> > > > >> > See log from below link
>> > > > >> >
>> > > > >>
>> > > >
>> >
>> https://drive.google.com/drive/folders/1Efcuzx64fV1pbRH00Ya_tRIRfs9bjCXL
>> > > > >> > --
>> > > > >> >
>> > > > >> >
>> > > > >> > *Thanks & Regards.**Support Admin*
>> > > > >> > ------------------------------
>> > > > >> >
>> > > > >> >
>> > > > >> > *Facebook <https://www.facebook.com/TechnologyRSS> | Twitter
>> > > > >> > <https://twitter.com/technologyrss1> | YouTube
>> > > > >> > <https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw> |
>> > > LinkedIn
>> > > > >> > <https://www.linkedin.com/company/technologyrss/>**Address :
>> > > > *Rayerbagh
>> > > > >> > Complex Super Market
>> > > > >> > Level #01, Shop No #211, Rayerbagh Bus Stand
>> > > > >> > Dhaka. Bangladesh
>> > > > >> > *Mob :* +88 01716915504
>> > > > >> > *Email :* support.ad...@technologyrss.com
>> > > > >> > *Web :* www.technologyrss.com
>> > > > >> >
>> > > > >> >
>> > > > >> > On Mon, Feb 17, 2025 at 6:26 PM TechnologyRss <
>> > > > >> > technologyrss.m...@gmail.com>
>> > > > >> > wrote:
>> > > > >> >
>> > > > >> > > I am added manually but I see ssvm & cpvm create and deleted
>> > > > >> > > see kvm error log
>> > > > >> > > +++++++++++++++++++++
>> > > > >> > > 2025-02-17 13:04:21,387 WARN
>> [kvm.resource.LibvirtKvmAgentHook]
>> > > > >> > > (agentRequest-Handler-2:[]) (logid:e9f76953) Groovy script
>> > > > >> > >
>> '/etc/cloudstack/agent/hooks/libvirt-vm-xml-transformer.groovy'
>> > is
>> > > > not
>> > > > >> > > available. Transformations will not be applied.
>> > > > >> > > 2025-02-17 13:04:21,387 WARN
>> [kvm.resource.LibvirtKvmAgentHook]
>> > > > >> > > (agentRequest-Handler-2:[]) (logid:e9f76953) Groovy scripting
>> > > engine
>> > > > >> is
>> > > > >> > not
>> > > > >> > > initialized. Data transformation skipped.
>> > > > >> > > 2025-02-17 13:04:21,486 WARN
>> > > > >> > >  [resource.wrapper.LibvirtStartCommandWrapper]
>> > > > >> > (agentRequest-Handler-4:[])
>> > > > >> > > (logid:727c93eb) LibvirtException
>> org.libvirt.LibvirtException:
>> > > > >> internal
>> > > > >> > > error: process exited while connecting to monitor:
>> > > > >> > > 2025-02-17T12:04:21.271945Z qemu-kvm: -blockdev
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> {"driver":"gluster","volume":"primary","path":"12a81185-5997-4591-a778-10aef3faa6c0","server":[{"type":"inet","host":"192.168.1.1","port":"24007"}],"debug":4,"node-name":"libvirt-2-storage","auto-read-only":true,"discard":"unmap","cache":{"direct":true,"no-flush":false}}:
>> > > > >> > > Unknown driver 'gluster'
>> > > > >> > >         at org.libvirt.ErrorHandler.processError(Unknown
>> Source)
>> > > > >> > >         at org.libvirt.ErrorHandler.processError(Unknown
>> Source)
>> > > > >> > >         at org.libvirt.Connect.domainCreateXML(Unknown
>> Source)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1909)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:87)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:48)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1945)
>> > > > >> > >         at
>> com.cloud.agent.Agent.processRequest(Agent.java:686)
>> > > > >> > >         at
>> > > > >> > >
>> > com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1109)
>> > > > >> > >         at com.cloud.utils.nio.Task.call(Task.java:83)
>> > > > >> > >         at com.cloud.utils.nio.Task.call(Task.java:29)
>> > > > >> > >         at
>> > > > >> > >
>> > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
>> > > > >> > >         at java.base/java.lang.Thread.run(Thread.java:840)
>> > > > >> > >
>> > > > >> > > 2025-02-17 13:04:21,512 INFO
>> > [kvm.storage.LibvirtStorageAdaptor]
>> > > > >> > > (agentRequest-Handler-4:[]) (logid:727c93eb) Trying to fetch
>> > > storage
>> > > > >> pool
>> > > > >> > > 9fcb2109-a2db-3bb3-856a-70c37fd44f46 from libvirt
>> > > > >> > > 2025-02-17 13:04:22,254 WARN
>> > > > >> > >  [resource.wrapper.LibvirtStartCommandWrapper]
>> > > > >> > (agentRequest-Handler-2:[])
>> > > > >> > > (logid:e9f76953) LibvirtException
>> org.libvirt.LibvirtException:
>> > > > >> internal
>> > > > >> > > error: QEMU unexpectedly closed the monitor (vm='s-4-VM'):
>> > > > >> > > 2025-02-17T12:04:21.905873Z qemu-kvm: -blockdev
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> {"driver":"gluster","volume":"primary","path":"a3873a92-2ada-4dfc-8652-146d1f7d7ef3","server":[{"type":"inet","host":"192.168.1.1","port":"24007"}],"debug":4,"node-name":"libvirt-2-storage","auto-read-only":true,"discard":"unmap","cache":{"direct":true,"no-flush":false}}:
>> > > > >> > > Unknown driver 'gluster'
>> > > > >> > >         at org.libvirt.ErrorHandler.processError(Unknown
>> Source)
>> > > > >> > >         at org.libvirt.ErrorHandler.processError(Unknown
>> Source)
>> > > > >> > >         at org.libvirt.Connect.domainCreateXML(Unknown
>> Source)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1909)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:87)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:48)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1945)
>> > > > >> > >         at
>> com.cloud.agent.Agent.processRequest(Agent.java:686)
>> > > > >> > >         at
>> > > > >> > >
>> > com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1109)
>> > > > >> > >         at com.cloud.utils.nio.Task.call(Task.java:83)
>> > > > >> > >         at com.cloud.utils.nio.Task.call(Task.java:29)
>> > > > >> > >         at
>> > > > >> > >
>> > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
>> > > > >> > >         at
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
>> > > > >> > >         at java.base/java.lang.Thread.run(Thread.java:840)
>> > > > >> > >
>> > > > >> > > 2025-02-17 13:04:22,278 INFO
>> > [kvm.storage.LibvirtStorageAdaptor]
>> > > > >> > > (agentRequest-Handler-2:[]) (logid:e9f76953) Trying to fetch
>> > > storage
>> > > > >> pool
>> > > > >> > > 9fcb2109-a2db-3bb3-856a-70c37fd44f46 from libvirt
>> > > > >> > > 2025-02-17 13:04:25,374 INFO
>> [kvm.resource.LibvirtConnection]
>> > > > >> > > (agentRequest-Handler-1:[]) (logid:e9f76953) No existing
>> > libvirtd
>> > > > >> > > connection found. Opening a new one
>> > > > >> > > +++++++++++++++++++
>> > > > >> > > --
>> > > > >> > >
>> > > > >> > >
>> > > > >> > > *Thanks & Regards.**Support Admin*
>> > > > >> > > ------------------------------
>> > > > >> > >
>> > > > >> > >
>> > > > >> > > *Facebook <https://www.facebook.com/TechnologyRSS> | Twitter
>> > > > >> > > <https://twitter.com/technologyrss1> | YouTube
>> > > > >> > > <https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw> |
>> > > > LinkedIn
>> > > > >> > > <https://www.linkedin.com/company/technologyrss/>**Address :
>> > > > >> *Rayerbagh
>> > > > >> > > Complex Super Market
>> > > > >> > > Level #01, Shop No #211, Rayerbagh Bus Stand
>> > > > >> > > Dhaka. Bangladesh
>> > > > >> > > *Mob :* +88 01716915504
>> > > > >> > > *Email :* support.ad...@technologyrss.com
>> > > > >> > > *Web :* www.technologyrss.com
>> > > > >> > >
>> > > > >> > >
>> > > > >> > > On Mon, Feb 17, 2025 at 6:01 PM Wei ZHOU <
>> ustcweiz...@gmail.com
>> > >
>> > > > >> wrote:
>> > > > >> > >
>> > > > >> > >> Yes, this seems to be a UI bug.
>> > > > >> > >> As a workaround, you can manually add primary and secondary
>> > store
>> > > > and
>> > > > >> > >> enable the zone
>> > > > >> > >>
>> > > > >> > >>
>> > > > >> > >> -Wei
>> > > > >> > >>
>> > > > >> > >> On Mon, Feb 17, 2025 at 12:56 PM TechnologyRss <
>> > > > >> > >> technologyrss.m...@gmail.com>
>> > > > >> > >> wrote:
>> > > > >> > >>
>> > > > >> > >> > I delete db and then re create zone but I see my host is
>> > error
>> > > > >> > >> > https://prnt.sc/xIJVKgGbgZ7O
>> > > > >> > >> > but open another window and access my cloud zone and then
>> see
>> > > > host
>> > > > >> is
>> > > > >> > up
>> > > > >> > >> > https://prnt.sc/xIJVKgGbgZ7O
>> > > > >> > >> > primary and secondary not added at that time can I add it
>> > > > manually
>> > > > >> ?
>> > > > >> > >> >
>> > > > >> > >> > --
>> > > > >> > >> >
>> > > > >> > >> >
>> > > > >> > >> > *Thanks & Regards.**Support Admin*
>> > > > >> > >> > ------------------------------
>> > > > >> > >> >
>> > > > >> > >> >
>> > > > >> > >> > *Facebook <https://www.facebook.com/TechnologyRSS> |
>> Twitter
>> > > > >> > >> > <https://twitter.com/technologyrss1> | YouTube
>> > > > >> > >> > <https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw>
>> |
>> > > > >> LinkedIn
>> > > > >> > >> > <https://www.linkedin.com/company/technologyrss/>**Address
>> :
>> > > > >> > *Rayerbagh
>> > > > >> > >> > Complex Super Market
>> > > > >> > >> > Level #01, Shop No #211, Rayerbagh Bus Stand
>> > > > >> > >> > Dhaka. Bangladesh
>> > > > >> > >> > *Mob :* +88 01716915504
>> > > > >> > >> > *Email :* support.ad...@technologyrss.com
>> > > > >> > >> > *Web :* www.technologyrss.com
>> > > > >> > >> >
>> > > > >> > >> >
>> > > > >> > >> > On Mon, Feb 17, 2025 at 10:00 AM TechnologyRss <
>> > > > >> > >> > technologyrss.m...@gmail.com>
>> > > > >> > >> > wrote:
>> > > > >> > >> >
>> > > > >> > >> > > Now I see create ssvm and cpvm but dont start properly,
>> > auto
>> > > > >> create
>> > > > >> > >> and
>> > > > >> > >> > > auto delete it. I think secondary storage issue,
>> secondary
>> > > > >> storage
>> > > > >> > >> > iptables
>> > > > >> > >> > > ensble needed or not?
>> > > > >> > >> > >
>> > > > >> > >> > > On Sun, 16 Feb 2025, 10:01 pm TechnologyRss, <
>> > > > >> > >> > technologyrss.m...@gmail.com>
>> > > > >> > >> > > wrote:
>> > > > >> > >> > >
>> > > > >> > >> > >> Yes now I am use same as ip all status is ok but ssvm
>> and
>> > > cpvm
>> > > > >> dont
>> > > > >> > >> > >> create,  what can I do?
>> > > > >> > >> > >>
>> > > > >> > >> > >> On Sun, 16 Feb 2025, 9:11 pm Wei ZHOU, <
>> > > ustcweiz...@gmail.com
>> > > > >
>> > > > >> > >> wrote:
>> > > > >> > >> > >>
>> > > > >> > >> > >>> Please check your network design.
>> > > > >> > >> > >>> The systemvm IP should be able to reach 192.168.1.x
>> > > > >> > >> > >>> You can use 192.168.1.x as pod IP
>> > > > >> > >> > >>>
>> > > > >> > >> > >>>
>> > > > >> > >> > >>> -Wei
>> > > > >> > >> > >>>
>> > > > >> > >> > >>>
>> > > > >> > >> > >>>
>> > > > >> > >> > >>> On Sunday, February 16, 2025, TechnologyRss <
>> > > > >> > >> > >>> technologyrss.m...@gmail.com>
>> > > > >> > >> > >>> wrote:
>> > > > >> > >> > >>>
>> > > > >> > >> > >>> > Any update for me what can I do now,  please
>> > > > >> > >> > >>> >
>> > > > >> > >> > >>> > On Sun, 16 Feb 2025, 6:40 pm TechnologyRss, <
>> > > > >> > >> > >>> technologyrss.m...@gmail.com>
>> > > > >> > >> > >>> > wrote:
>> > > > >> > >> > >>> >
>> > > > >> > >> > >>> > > 1. I am using management and all server LAN is
>> > > > >> 192.168.1.0/24
>> > > > >> > >> > >>> > > 2. Create pod using 192.168.3.0/24
>> > > > >> > >> > >>> > > I am remove public ip and replace 192.168.1.0
>> network
>> > > ip,
>> > > > >> > >> error is
>> > > > >> > >> > >>> same
>> > > > >> > >> > >>> > >
>> > > > >> > >> > >>> > > On Sun, 16 Feb 2025, 6:07 pm Wei ZHOU, <
>> > > > >> ustcweiz...@gmail.com
>> > > > >> > >
>> > > > >> > >> > >>> wrote:
>> > > > >> > >> > >>> > >
>> > > > >> > >> > >>> > >> Change to the  IP on management network and
>> retry.
>> > > > >> > >> > >>> > >>
>> > > > >> > >> > >>> > >>
>> > > > >> > >> > >>> > >>
>> > > > >> > >> > >>> > >>
>> > > > >> > >> > >>> > >> On Sunday, February 16, 2025, TechnologyRss <
>> > > > >> > >> > >>> > technologyrss.m...@gmail.com
>> > > > >> > >> > >>> > >> >
>> > > > >> > >> > >>> > >> wrote:
>> > > > >> > >> > >>> > >>
>> > > > >> > >> > >>> > >> > I see this is cloud management server public ip
>> > > > address,
>> > > > >> > >> > >>> > >> > https://prnt.sc/iwdoRVir9V7v
>> > > > >> > >> > >>> > >> >
>> > > > >> > >> > >>> > >> > On Sun, 16 Feb 2025, 5:29 pm TechnologyRss, <
>> > > > >> > >> > >>> > >> technologyrss.m...@gmail.com>
>> > > > >> > >> > >>> > >> > wrote:
>> > > > >> > >> > >>> > >> >
>> > > > >> > >> > >>> > >> > > Sorry,  I am not clear which setting you
>> want to
>> > > > see,
>> > > > >> > >> please
>> > > > >> > >> > >>> let me
>> > > > >> > >> > >>> > >> know
>> > > > >> > >> > >>> > >> > > details
>> > > > >> > >> > >>> > >> > >
>> > > > >> > >> > >>> > >> > > On Sun, 16 Feb 2025, 5:19 pm Wei ZHOU, <
>> > > > >> > >> ustcweiz...@gmail.com
>> > > > >> > >> > >
>> > > > >> > >> > >>> > wrote:
>> > > > >> > >> > >>> > >> > >
>> > > > >> > >> > >>> > >> > >>  I could not find the setting "host"
>> > > > >> > >> > >>> > >> > >>
>> > > > >> > >> > >>> > >> > >>
>> > > > >> > >> > >>> > >> > >>
>> > > > >> > >> > >>> > >> > >> On Sunday, February 16, 2025, TechnologyRss
>> <
>> > > > >> > >> > >>> > >> > technologyrss.m...@gmail.com
>> > > > >> > >> > >>> > >> > >> >
>> > > > >> > >> > >>> > >> > >> wrote:
>> > > > >> > >> > >>> > >> > >>
>> > > > >> > >> > >>> > >> > >> > Please see https://prnt.sc/qdjEreosdCtm
>> > > > >> > >> > >>> > >> > >> >
>> > > > >> > >> > >>> > >> > >> > On Sun, 16 Feb 2025, 5:05 pm Wei ZHOU, <
>> > > > >> > >> > >>> ustcweiz...@gmail.com>
>> > > > >> > >> > >>> > >> wrote:
>> > > > >> > >> > >>> > >> > >> >
>> > > > >> > >> > >>> > >> > >> > > Please check the global setting "host"
>> > > > >> > >> > >>> > >> > >> > >
>> > > > >> > >> > >>> > >> > >> > >
>> > > > >> > >> > >>> > >> > >> > >
>> > > > >> > >> > >>> > >> > >> > > On Sunday, February 16, 2025,
>> > TechnologyRss <
>> > > > >> > >> > >>> > >> > >> > technologyrss.m...@gmail.com>
>> > > > >> > >> > >>> > >> > >> > > wrote:
>> > > > >> > >> > >>> > >> > >> > >
>> > > > >> > >> > >>> > >> > >> > > > Host added done using reinstall cloud
>> > > agent.
>> > > > >> But I
>> > > > >> > >> see
>> > > > >> > >> > >>> > >> different
>> > > > >> > >> > >>> > >> > >> error.
>> > > > >> > >> > >>> > >> > >> > > > Ssvm status error. Not open console.
>> > > > >> > >> > >>> > >> > >> > > > My added kvm host status is
>> > > > >> > >> > https://prnt.sc/8fBmSNCSbVv-
>> > > > >> > >> > >>> > >> > >> > > > Primary storage is gluster volume
>> added
>> > > > >> > >> > >>> > >> > >> https://prnt.sc/25aXAZ8K6ubz
>> > > > >> > >> > >>> > >> > >> > > > SSVm & CPVM is
>> > > https://prnt.sc/j_8S1Gv-dTxt
>> > > > >> > >> > >>> > >> > >> > > >
>> > > > >> > >> > >>> > >> > >> > > > Error from SSVM no rote to hos.
>> > > > >> > >> > >>> > >> > >> > > > +++++++++++++++
>> > > > >> > >> > >>> > >> > >> > > > at
>> > > > >> > >> > com.cloud.agent.AgentShell.start(AgentShell.java:512)
>> > > > >> > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]:
>> > > > >>  at
>> > > > >> > >> > >>> > >> > >> > > >
>> > > > >> > com.cloud.agent.AgentShell.main(AgentShell.java:542)
>> > > > >> > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]:
>> > > Caused
>> > > > >> by:
>> > > > >> > >> > >>> > >> > >> > > > java.net.NoRouteToHostException: No
>> > route
>> > > to
>> > > > >> host
>> > > > >> > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]:
>> > > > >>  at
>> > > > >> > >> > >>> > >> > >> > > > java.base/sun.nio.ch.Net
>> .connect0(Native
>> > > > >> Method)
>> > > > >> > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]:
>> > > > >>  at
>> > > > >> > >> > >>> > >> > >> > > > java.base/sun.nio.ch.Net
>> > > > .connect(Net.java:579)
>> > > > >> > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]:
>> > > > >>  at
>> > > > >> > >> > >>> > >> > >> > > > java.base/sun.nio.ch.Net
>> > > > .connect(Net.java:586)
>> > > > >> > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]:
>> > > > >>  at
>> > > > >> > >> > >>> > >> > >> > > > java.base/sun.nio.ch
>> > > > >> > >> > >>> > >> > >> > >
>> > > > >> > .SocketChannelImpl.connect(SocketChannelImpl.java:853)
>> > > > >> > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]:
>> > > > >>  at
>> > > > >> > >> > >>> > >> > >> > > >
>> > > > >> > >> com.cloud.utils.nio.NioClient.init(NioClient.java:54)
>> > > > >> > >> > >>> > >> > >> > > > Feb 16 06:57:34 s-2-VM _run.sh[3178]:
>> > > > >>  at
>> > > > >> > >> > >>> > >> > >> > > >
>> com.cloud.utils.nio.NioConnection.start(
>> > > > >> > >> > >>> > NioConnection.java:96)
>> > > > >> > >> > >>> > >> > >> > > > +++++++++++++
>> > > > >> > >> > >>> > >> > >> > > >
>> > > > >> > >> > >>> > >> > >> > > > Please give me an idea what is issue ?
>> > > > >> > >> > >>> > >> > >> > > >
>> > > > >> > >> > >>> > >> > >> > > > On Sat, 15 Feb 2025, 1:40 pm
>> > > TechnologyRss, <
>> > > > >> > >> > >>> > >> > >> > > technologyrss.m...@gmail.com>
>> > > > >> > >> > >>> > >> > >> > > > wrote:
>> > > > >> > >> > >>> > >> > >> > > >
>> > > > >> > >> > >>> > >> > >> > > > > I added this interface and then
>> remove
>> > > all
>> > > > >> file
>> > > > >> > >> from
>> > > > >> > >> > >>> > >> > >> > > > > rm -rf /etc/cloudstack/agent/*
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > > Then I try to add host but I see
>> > > different
>> > > > >> error
>> > > > >> > >> as
>> > > > >> > >> > >>> like
>> > > > >> > >> > >>> > >> below.
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > > +++++++++++++++++++
>> > > > >> > >> > >>> > >> > >> > > > > Error 530
>> > > > >> > >> > >>> > >> > >> > > > > Could not add host at [
>> > > > http://192.168.1.120]
>> > > > >> > with
>> > > > >> > >> > zone
>> > > > >> > >> > >>> > [1],
>> > > > >> > >> > >>> > >> pod
>> > > > >> > >> > >>> > >> > >> [1]
>> > > > >> > >> > >>> > >> > >> > > and
>> > > > >> > >> > >>> > >> > >> > > > > cluster [1] due to: [ can't setup
>> > agent,
>> > > > due
>> > > > >> to
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> com.cloud.utils.exception.CloudRuntimeException:
>> > > > >> > >> > >>> Failed to
>> > > > >> > >> > >>> > >> > setup
>> > > > >> > >> > >>> > >> > >> > > > > certificate in the KVM agent's
>> keystore
>> > > > file,
>> > > > >> > >> please
>> > > > >> > >> > >>> see
>> > > > >> > >> > >>> > logs
>> > > > >> > >> > >>> > >> > and
>> > > > >> > >> > >>> > >> > >> > > > configure
>> > > > >> > >> > >>> > >> > >> > > > > manually! - Failed to setup
>> certificate
>> > > in
>> > > > >> the
>> > > > >> > KVM
>> > > > >> > >> > >>> agent's
>> > > > >> > >> > >>> > >> > >> keystore
>> > > > >> > >> > >>> > >> > >> > > file,
>> > > > >> > >> > >>> > >> > >> > > > > please see logs and configure
>> > manually!].
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > > Please see this
>> > > > >> > >> > >>> > >> > >> > > > > --
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > > *Thanks & Regards.**Support Admin*
>> > > > >> > >> > >>> > >> > >> > > > > ------------------------------
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > > *Facebook <
>> > > > >> > https://www.facebook.com/TechnologyRSS>
>> > > > >> > >> |
>> > > > >> > >> > >>> > Twitter
>> > > > >> > >> > >>> > >> > >> > > > > <https://twitter.com/technologyrss1>
>> |
>> > > > >> YouTube
>> > > > >> > >> > >>> > >> > >> > > > > <
>> > > > >> > >> > >>>
>> https://www.youtube.com/channel/UCBq7qGqFEUe6ObVHMuxudTw
>> > >
>> > > > >> > >> > >>> > |
>> > > > >> > >> > >>> > >> > >> > LinkedIn
>> > > > >> > >> > >>> > >> > >> > > > > <
>> > > > >> > https://www.linkedin.com/company/technologyrss/
>> > > > >> > >> > >>> >**Address
>> > > > >> > >> > >>> > :
>> > > > >> > >> > >>> > >> > >> > > *Rayerbagh
>> > > > >> > >> > >>> > >> > >> > > > > Complex Super Market
>> > > > >> > >> > >>> > >> > >> > > > > Level #01, Shop No #211, Rayerbagh
>> Bus
>> > > > Stand
>> > > > >> > >> > >>> > >> > >> > > > > Dhaka. Bangladesh
>> > > > >> > >> > >>> > >> > >> > > > > *Mob :* +88 01716915504
>> > > > >> > >> > >>> > >> > >> > > > > *Email :*
>> > > support.ad...@technologyrss.com
>> > > > >> > >> > >>> > >> > >> > > > > *Web :* www.technologyrss.com
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > > On Sat, Feb 15, 2025 at 12:20 AM Wei
>> > > ZHOU <
>> > > > >> > >> > >>> > >> > ustcweiz...@gmail.com>
>> > > > >> > >> > >>> > >> > >> > > wrote:
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > > >> please check this error
>> > > > >> > >> > >>> > >> > >> > > > >>
>> > > > >> > >> > >>> > >> > >> > > > >> 2025-02-14 18:12:17,786 WARN
>> > > > >> > >> > >>> > >> [o.a.c.e.o.NetworkOrchestrator]
>> > > > >> > >> > >>> > >> > >> > > > >>
>> > (AgentConnectTaskPool-1:[ctx-d4de9400])
>> > > > >> > >> > >>> (logid:2a710cff)
>> > > > >> > >> > >>> > >> > Unable
>> > > > >> > >> > >>> > >> > >> to
>> > > > >> > >> > >>> > >> > >> > > > setup
>> > > > >> > >> > >>> > >> > >> > > > >> agent 1 due to Can not find
>> network:
>> > > > >> cloudbr1
>> > > > >> > >> > >>> > >> > >> > > > >>
>> > > > >> > >> > >>> > >> > >> > > > >>
>> > > > >> > >> > >>> > >> > >> > > > >> -Wei
>> > > > >> > >> > >>> > >> > >> > > > >>
>> > > > >> > >> > >>> > >> > >> > > > >> On Fri, Feb 14, 2025 at 2:40 PM
>> > > > >> TechnologyRss <
>> > > > >> > >> > >>> > >> > >> > > > >> technologyrss.m...@gmail.com>
>> > > > >> > >> > >>> > >> > >> > > > >> wrote:
>> > > > >> > >> > >>> > >> > >> > > > >>
>> > > > >> > >> > >>> > >> > >> > > > >> > Hello,
>> > > > >> > >> > >>> > >> > >> > > > >> >
>> > > > >> > >> > >>> > >> > >> > > > >> > I am using primary storage is
>> > gluster
>> > > > and
>> > > > >> > >> > secondary
>> > > > >> > >> > >>> > >> storage
>> > > > >> > >> > >>> > >> > is
>> > > > >> > >> > >>> > >> > >> > nfs,
>> > > > >> > >> > >>> > >> > >> > > I
>> > > > >> > >> > >>> > >> > >> > > > >> can't
>> > > > >> > >> > >>> > >> > >> > > > >> > add host to management server,
>> > please
>> > > > see
>> > > > >> my
>> > > > >> > >> both
>> > > > >> > >> > >>> cloud
>> > > > >> > >> > >>> > >> log
>> > > > >> > >> > >>> > >> > >> from
>> > > > >> > >> > >>> > >> > >> > > below
>> > > > >> > >> > >>> > >> > >> > > > >> > link.
>> > > > >> > >> > >>> > >> > >> > > > >> >
>> > > > >> > >> > >>> > >> > >> > > > >> > https://shorturl.at/pfB1N
>> > > > >> > >> > >>> > >> > >> > > > >> >
>> > > > >> > >> > >>> > >> > >> > > > >> >
>> > > > >> > >> > >>> > >> > >> > > > >> > --
>> > > > >> > >> > >>> > >> > >> > > > >> >
>> > > > >> > >> > >>> > >> > >> > > > >> >
>> > > > >> > >> > >>> > >> > >> > > > >> > *Thanks & Regards.**Support
>> Admin*
>> > > > >> > >> > >>> > >> > >> > > > >> > ------------------------------
>> > > > >> > >> > >>> > >> > >> > > > >> >
>> > > > >> > >> > >>> > >> > >> > > > >> >
>> > > > >> > >> > >>> > >> > >> > > > >> > *Facebook <
>> > > > >> > >> https://www.facebook.com/TechnologyRSS
>> > > > >> > >> > >
>> > > > >> > >> > >>> |
>> > > > >> > >> > >>> > >> Twitter
>> > > > >> > >> > >>> > >> > >> > > > >> > <
>> https://twitter.com/technologyrss1
>> > >
>> > > |
>> > > > >> > YouTube
>> > > > >> > >> > >>> > >> > >> > > > >> > <
>> https://www.youtube.com/channel/
>> > > > >> > >> > >>> > UCBq7qGqFEUe6ObVHMuxudTw>
>> > > > >> > >> > >>> > >> |
>> > > > >> > >> > >>> > >> > >> > > LinkedIn
>> > > > >> > >> > >>> > >> > >> > > > >> > <
>> > > > >> > >> https://www.linkedin.com/company/technologyrss/
>> > > > >> > >> > >**
>> > > > >> > >> > >>> > Address
>> > > > >> > >> > >>> > >> :
>> > > > >> > >> > >>> > >> > >> > > > *Rayerbagh
>> > > > >> > >> > >>> > >> > >> > > > >> > Complex Super Market
>> > > > >> > >> > >>> > >> > >> > > > >> > Level #01, Shop No #211,
>> Rayerbagh
>> > Bus
>> > > > >> Stand
>> > > > >> > >> > >>> > >> > >> > > > >> > Dhaka. Bangladesh
>> > > > >> > >> > >>> > >> > >> > > > >> > *Mob :* +88 01716915504
>> > > > >> > >> > >>> > >> > >> > > > >> > *Email :*
>> > > > support.ad...@technologyrss.com
>> > > > >> > >> > >>> > >> > >> > > > >> > *Web :* www.technologyrss.com
>> > > > >> > >> > >>> > >> > >> > > > >> >
>> > > > >> > >> > >>> > >> > >> > > > >>
>> > > > >> > >> > >>> > >> > >> > > > >
>> > > > >> > >> > >>> > >> > >> > > >
>> > > > >> > >> > >>> > >> > >> > >
>> > > > >> > >> > >>> > >> > >> >
>> > > > >> > >> > >>> > >> > >>
>> > > > >> > >> > >>> > >> > >
>> > > > >> > >> > >>> > >> >
>> > > > >> > >> > >>> > >>
>> > > > >> > >> > >>> > >
>> > > > >> > >> > >>> >
>> > > > >> > >> > >>>
>> > > > >> > >> > >>
>> > > > >> > >> >
>> > > > >> > >>
>> > > > >> > >
>> > > > >> >
>> > > > >>
>> > > > >
>> > > >
>> > >
>> >
>>
>

Reply via email to