Hi Geoff, Thanks for the reply, I was able to manually mount the secondary storage NFS:
[root@cs-east-prod1 secondaryStorage]# hostname cs-east-prod1 [root@cs-east-prod1 secondaryStorage]# hostname --fqdn cs-east-prod1.na.tibco.com [root@cs-east-prod1 secondaryStorage]# [root@cs-east-prod1 ~]# mkdir /secondaryStorage [root@cs-east-prod1 ~]# mount -t nfs cs-east-prod1:/export/secondary /secondaryStorage [root@cs-east-prod1 ~]# cd / [root@cs-east-prod1 /]# ls -l total 120 dr-xr-xr-x. 2 root root 4096 Oct 23 04:48 bin dr-xr-xr-x. 5 root root 3072 Oct 22 21:10 boot drwxr-xr-x. 10 root root 4096 Jun 25 10:23 cgroup drwxr-xr-x. 19 root root 3960 Oct 29 10:38 dev drwxr-xr-x. 121 root root 12288 Oct 29 11:07 etc drwxrwxrwx. 4 root root 4096 Jul 3 20:10 export drwxr-xr-x. 3 root root 4096 Jul 3 19:14 home lrwxrwxrwx. 1 root root 25 Aug 28 15:46 Installers -> /var/www/html/Installers/ lrwxrwxrwx. 1 root root 19 Jul 5 20:58 ISOs -> /var/www/html/ISOs/ dr-xr-xr-x. 11 root root 4096 Jul 3 19:02 lib dr-xr-xr-x. 10 root root 12288 Oct 28 03:33 lib64 drwx------. 2 root root 16384 Jul 3 18:44 lost+found drwxr-xr-x. 3 root root 4096 Oct 27 12:05 media drwxr-xr-x. 2 root root 0 Oct 29 10:08 misc drwxr-xr-x. 39 root root 4096 Sep 6 12:07 mnt drwxr-xr-x. 2 root root 0 Oct 29 10:08 net drwxr-xr-x. 3 root root 4096 Jul 3 19:05 opt drwxr-xr-x. 2 root root 4096 Oct 27 10:06 primarymount dr-xr-xr-x. 557 root root 0 Oct 29 10:08 proc dr-xr-x---. 35 root root 4096 Oct 29 10:09 root dr-xr-xr-x. 2 root root 12288 Oct 28 03:33 sbin drwxr-xr-x. 2 root root 4096 Oct 27 10:07 secondarymount drwxrwxrwx. 5 root root 4096 Jul 16 11:27 secondaryStorage drwxr-xr-x. 7 root root 0 Oct 29 10:08 selinux drwxr-xr-x. 2 root root 4096 Sep 23 2011 srv drwxr-xr-x. 13 root root 0 Oct 29 10:08 sys drwxrwxrwt. 16 root root 4096 Oct 29 11:07 tmp drwxr-xr-x. 13 root root 4096 Jul 3 18:55 usr drwxr-xr-x. 23 root root 4096 Jul 3 19:45 var [root@cs-east-prod1 /]# cd secondaryStorage/ [root@cs-east-prod1 secondaryStorage]# ls -l total 12 drwxrwxrwx. 2 root root 4096 Jul 16 11:27 snapshots drwxrwxrwx. 3 root root 4096 Jul 16 11:10 template drwxrwxrwx. 3 root root 4096 Jul 22 09:38 volumes [root@cs-east-prod1 secondaryStorage]# Best Regards, Adam Scarcella On Tue, Oct 29, 2013 at 10:54 AM, Geoff Higginbottom < [email protected]> wrote: > Adam, > > System VMs looping and failing to create is often caused by the Host being > unable to access Sec Storage. > > Do a manual mount of the Sec Storage NFS on the Host to confirm it can > access it. > > Regards > > Geoff Higginbottom > > D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 > > [email protected] > > -----Original Message----- > From: Adam [mailto:[email protected]] > Sent: 29 October 2013 14:44 > To: [email protected] > Subject: Re: How to recover entire self contained CloudStack after major > network changes? > > I exported the db as a *.sql file, did search/replace and that seemed to > help a lot, but still not 100% out of the woods. Now I'm hitting the issue > where the System VMs (SecondaryStorageVm & ConsoleProxy) do not start. They > just keep looping from creation to being expunged. > > My Zone is enabled, Pod is enabled, Cluster is enabled, Host is Up, > Primary Storage is online: > > [root@cs-east-prod1 ~]# df -kh > Filesystem Size Used Avail Use% Mounted on > /dev/mapper/vg_cloudstackuse-lv_root > 5.7T 921G 4.5T 17% / > tmpfs 64G 72K 64G 1% /dev/shm > /dev/sda1 485M 118M 342M 26% /boot > 10.97.38.10:/export/primary > 5.7T 921G 4.5T 17% > /mnt/910365e6-a298-37b8-904f-2b49198c8286 > > Here is an excerpt from my most recent log: > > 2013-10-29 09:22:23,389 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-10-29 09:22:23,391 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-10-29 09:22:23,441 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 routers to update status. > 2013-10-29 09:22:23,443 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-10-29 09:22:26,872 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-5:null) Ping from 10 > 2013-10-29 09:22:38,509 DEBUG [cloud.server.StatsCollector] > (StatsCollector-2:null) VmStatsCollector is running... > 2013-10-29 09:22:38,708 DEBUG [cloud.server.StatsCollector] > (StatsCollector-3:null) StorageCollector is running... > 2013-10-29 09:22:38,716 INFO [storage.endpoint.DefaultEndPointSelector] > (StatsCollector-3:null) No running ssvm is found, so command will be sent > to LocalHostEndPoint > 2013-10-29 09:22:44,969 DEBUG [cloud.server.StatsCollector] > (StatsCollector-1:null) HostStatsCollector is running... > 2013-10-29 09:22:45,587 DEBUG [agent.transport.Request] > (StatsCollector-1:null) Seq 10-768344083: Received: { Ans: , MgmtId: > 86691596708691, via: 10, Ver: v1, Flags: 10, { GetHostStatsAnswer } } > 2013-10-29 09:22:51,802 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 > is ready to launch secondary storage VM > 2013-10-29 09:22:51,807 INFO > [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) > No running secondary storage vms found in datacenter id=1, starting one > 2013-10-29 09:22:51,814 INFO > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) No > stopped secondary storage vm is available, need to allocate a new secondary > storage vm > 2013-10-29 09:22:51,817 DEBUG > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Assign > secondary storage vm from a newly started instance for request from data > center : 1 > 2013-10-29 09:22:51,837 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Found existing network configuration for offering > [Network Offering [6-Guest-DefaultSharedNetworkOfferingWithSGService]: > Ntwk[204|Guest|6] > 2013-10-29 09:22:51,837 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Releasing lock for > Acct[6f5c60f0-ee29-11e2-b62c-ac162d84d424-system] > 2013-10-29 09:22:51,842 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Found existing network configuration for offering > [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3] > 2013-10-29 09:22:51,842 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Releasing lock for > Acct[6f5c60f0-ee29-11e2-b62c-ac162d84d424-system] > 2013-10-29 09:22:51,846 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Found existing network configuration for offering > [Network Offering [2-Management-System-Management-Network]: > Ntwk[201|Management|2] > 2013-10-29 09:22:51,847 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Releasing lock for > Acct[6f5c60f0-ee29-11e2-b62c-ac162d84d424-system] > 2013-10-29 09:22:51,851 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Found existing network configuration for offering > [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4] > 2013-10-29 09:22:51,851 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Releasing lock for > Acct[6f5c60f0-ee29-11e2-b62c-ac162d84d424-system] > 2013-10-29 09:22:51,860 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Allocating entries for VM: > VM[SecondaryStorageVm|s-4930-VM] > 2013-10-29 09:22:51,865 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Allocating nics for VM[SecondaryStorageVm|s-4930-VM] > 2013-10-29 09:22:51,866 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-4930-VM] > in network Ntwk[204|Guest|6] with requested profile > NicProfile[0-0-null-null-null > 2013-10-29 09:22:51,881 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-4930-VM] > in network Ntwk[202|Control|3] with requested profile null > 2013-10-29 09:22:51,890 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-4930-VM] > in network Ntwk[201|Management|2] with requested profile null > 2013-10-29 09:22:51,903 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-4930-VM] > in network Ntwk[203|Storage|4] with requested profile null > 2013-10-29 09:22:51,915 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Allocating disks for VM[SecondaryStorageVm|s-4930-VM] > 2013-10-29 09:22:51,922 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Allocation completed for VM: > VM[SecondaryStorageVm|s-4930-VM] > 2013-10-29 09:22:51,925 DEBUG [cloud.alert.SecondaryStorageVmAlertAdapter] > (secstorage-1:null) received secondary storage vm alert > 2013-10-29 09:22:51,925 DEBUG [cloud.alert.SecondaryStorageVmAlertAdapter] > (secstorage-1:null) New secondary storage vm created, zone: EastProdZone1, > secStorageVm: s-4930-VM, public IP: null, private IP: null > 2013-10-29 09:22:51,942 DEBUG [cloud.capacity.CapacityManagerImpl] > (secstorage-1:null) VM state transitted from :Stopped to Starting with > event: StartRequestedvm's original host id: null new host id: null host id > before state transition: null > 2013-10-29 09:22:51,942 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Successfully transitioned to start state for > VM[SecondaryStorageVm|s-4930-VM] reservation id = > 3b2435a0-9e32-4777-a42f-a766a375bc1b > 2013-10-29 09:22:51,944 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Trying to deploy VM, vm has dcId: 1 and podId: null > 2013-10-29 09:22:51,944 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Deploy avoids pods: null, clusters: null, hosts: null > 2013-10-29 09:22:51,945 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (secstorage-1:null) Deploy avoids pods: null, clusters: null, hosts: null > 2013-10-29 09:22:51,946 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (secstorage-1:null) DeploymentPlanner allocation algorithm: > com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_d4b92e44@713baeaa > 2013-10-29 09:22:51,946 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (secstorage-1:null) Trying to allocate a host and storage pools from dc:1, > pod:null,cluster:null, requested cpu: 500, requested ram: 268435456 > 2013-10-29 09:22:51,946 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No > 2013-10-29 09:22:51,946 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Searching all possible resources under this Zone: 1 > 2013-10-29 09:22:51,946 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Listing clusters in order of aggregate capacity, that > have (atleast one host with) enough CPU and RAM capacity under this Zone: 1 > 2013-10-29 09:22:51,958 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (secstorage-1:null) Checking resources in Cluster: 1 under Pod: 1 > 2013-10-29 09:22:51,958 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 > cluster:1 > 2013-10-29 09:22:51,962 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 0 hosts to > check for allocation: [] > 2013-10-29 09:22:51,964 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) Found 0 hosts for allocation after > prioritization: [] > 2013-10-29 09:22:51,964 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256 > 2013-10-29 09:22:51,964 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 0 > suitable hosts > 2013-10-29 09:22:51,965 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (secstorage-1:null) No suitable hosts found > 2013-10-29 09:22:51,965 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (secstorage-1:null) No suitable hosts found under this Cluster: 1 > 2013-10-29 09:22:51,968 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (secstorage-1:null) Could not find suitable Deployment Destination for > this VM under any clusters, returning. > 2013-10-29 09:22:51,968 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Searching all possible resources under this Zone: 1 > 2013-10-29 09:22:51,969 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Listing clusters in order of aggregate capacity, that > have (atleast one host with) enough CPU and RAM capacity under this Zone: 1 > 2013-10-29 09:22:51,973 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Removing from the clusterId list these clusters from > avoid set: [1] > 2013-10-29 09:22:51,973 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) No clusters found after removing disabled clusters and > clusters in avoid list, returning. > 2013-10-29 09:22:51,981 DEBUG [cloud.capacity.CapacityManagerImpl] > (secstorage-1:null) VM state transitted from :Starting to Stopped with > event: OperationFailedvm's original host id: null new host id: null host > id before state transition: null > 2013-10-29 09:22:51,985 WARN > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) > Exception while trying to start secondary storage vm > com.cloud.exception.InsufficientServerCapacityException: Unable to create > a deployment for VM[SecondaryStorageVm|s-4930-VM]Scope=interface > com.cloud.dc.DataCenter; id=1 > at > > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:842) > at > > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578) > at > > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:571) > at > > com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:267) > at > > com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:696) > at > > com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1300) > at > > com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) > at > > com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) > at > com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:104) > at > com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33) > at > com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81) > at > com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > 2013-10-29 09:22:51,987 INFO > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) > Unable to start secondary storage vm for standby capacity, secStorageVm vm > Id : > 4930, will recycle it and start a new one > 2013-10-29 09:22:51,987 INFO > [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) > Primary secondary storage is not even started, wait until next turn > 2013-10-29 09:22:52,009 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-10-29 09:22:52,009 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] > (consoleproxy-1:null) Expand console proxy standby capacity for zone > EastProdZone1 > 2013-10-29 09:22:52,012 INFO [cloud.consoleproxy.ConsoleProxyManagerImpl] > (consoleproxy-1:null) Found a stopped console proxy, bring it up to > running pool. proxy vm id : 4271 > 2013-10-29 09:22:52,020 DEBUG [cloud.capacity.CapacityManagerImpl] > (consoleproxy-1:null) VM state transitted from :Stopped to Starting with > event: StartRequestedvm's original host id: null new host id: null host id > before state transition: null > 2013-10-29 09:22:52,020 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Successfully transitioned to start state for > VM[ConsoleProxy|v-4271-VM] reservation id = > 11861d83-fc09-4b25-8c07-bcb6ad8e7f54 > 2013-10-29 09:22:52,021 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Trying to deploy VM, vm has dcId: 1 and podId: null > 2013-10-29 09:22:52,022 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null > 2013-10-29 09:22:52,023 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null > 2013-10-29 09:22:52,024 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (consoleproxy-1:null) DeploymentPlanner allocation algorithm: > com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_d4b92e44@713baeaa > 2013-10-29 09:22:52,024 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (consoleproxy-1:null) Trying to allocate a host and storage pools from > dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824 > 2013-10-29 09:22:52,024 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No > 2013-10-29 09:22:52,024 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Searching all possible resources under this Zone: 1 > 2013-10-29 09:22:52,024 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Listing clusters in order of aggregate capacity, > that have (atleast one host with) enough CPU and RAM capacity under this > Zone: 1 > 2013-10-29 09:22:52,031 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (consoleproxy-1:null) Checking resources in Cluster: 1 under Pod: 1 > 2013-10-29 09:22:52,031 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 > cluster:1 > 2013-10-29 09:22:52,033 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 0 hosts to > check for allocation: [] > 2013-10-29 09:22:52,034 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) Found 0 hosts for allocation > after prioritization: [] > 2013-10-29 09:22:52,034 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, > Ram=1024 > 2013-10-29 09:22:52,034 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 0 > suitable hosts > 2013-10-29 09:22:52,034 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (consoleproxy-1:null) No suitable hosts found > 2013-10-29 09:22:52,034 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (consoleproxy-1:null) No suitable hosts found under this Cluster: 1 > 2013-10-29 09:22:52,036 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] > (consoleproxy-1:null) Could not find suitable Deployment Destination for > this VM under any clusters, returning. > 2013-10-29 09:22:52,036 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Searching all possible resources under this Zone: 1 > 2013-10-29 09:22:52,037 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Listing clusters in order of aggregate capacity, > that have (atleast one host with) enough CPU and RAM capacity under this > Zone: 1 > 2013-10-29 09:22:52,039 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Removing from the clusterId list these clusters from > avoid set: [1] > 2013-10-29 09:22:52,039 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) No clusters found after removing disabled clusters > and clusters in avoid list, returning. > 2013-10-29 09:22:52,043 DEBUG [cloud.capacity.CapacityManagerImpl] > (consoleproxy-1:null) VM state transitted from :Starting to Stopped with > event: OperationFailedvm's original host id: null new host id: null host > id before state transition: null > 2013-10-29 09:22:52,045 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] > (consoleproxy-1:null) Exception while trying to start console proxy > com.cloud.exception.InsufficientServerCapacityException: Unable to create > a deployment for VM[ConsoleProxy|v-4271-VM]Scope=interface > com.cloud.dc.DataCenter; id=1 > at > > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:842) > at > > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578) > at > > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:571) > at > > com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:556) > at > > com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:928) > at > > com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1672) > at > > com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157) > at > com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) > at > com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33) > at > com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81) > at > com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > > > What am I missing? How can I get these two system VMs online? > > Best Regards, > > > > Adam Scarcella > > > On Mon, Oct 28, 2013 at 8:07 PM, Adam <[email protected]> wrote: > > > It's worth a shot. I've gone through the db manually, and changed all > > the places where I could see the old IPs, but your way is much more > efficient. > > Doing it now and will report back soon. Thanks. > > > > Best Regards, > > > > > > > > Adam Scarcella > > > > > > On Mon, Oct 28, 2013 at 6:53 PM, Andrija Panic <[email protected] > >wrote: > > > >> one of the crazy tries: > >> backup your database, search for all IP addresses inside SQL file, > >> map old to new IP addresses (old1 --> new1, old2 -->new2...) and then > >> do search/replace each old one with new one. > >> This is for netowrking/ip addresses (guest, public,etc), same for NFS > >> serves, same for NFS host, etc... > >> > >> Not sure if that is going to make you UP again, but... > >> > >> > >> On 28 October 2013 22:59, Adam <[email protected]> wrote: > >> > >> > Hi All, > >> > > >> > I know what I'm about to ask may seem like crazy talk, but I have a > >> > situation at work where our CloudStack "box" was moved to another > >> network. > >> > This single server is a self-contained cloud with everything on one > box. > >> > I'm running CS 4.1.1 on CentOS 6.4 x86_64 with KVM and NFS for > >> > primary > >> and > >> > secondary storage mounts. It's a very basic configuration, but my > >> company > >> > moved from one town to another, and the IT dept decided to move our > >> server > >> > to a different switch and subnet without asking. So now literally > >> > every single IP address of any importance has been changed. > >> > > >> > I've been trying in vain to get this CS up and running again, but > >> > it > >> seems > >> > like everything has changed including the guids, or at least that > >> > seems > >> to > >> > be the case since I cannot match up guids from the database to > >> > guids on > >> the > >> > primary/secondary NFS. > >> > > >> > I'm sure if each piece were separate and moved one piece at a time, > >> > it would be fairly straightforward, but since this box is > >> > self-contained > >> and > >> > everything changed at the same time, it is proving to be very > difficult. > >> > > >> > Does anyone have any suggestions for me to attempt to recover my CS? > >> > > >> > Best Regards, > >> > > >> > > >> > > >> > Adam Scarcella > >> > > >> > >> > >> > >> -- > >> > >> Andrija Panić > >> -------------------------------------- > >> http://admintweets.com > >> -------------------------------------- > >> > > > > > This email and any attachments to it may be confidential and are intended > solely for the use of the individual to whom it is addressed. Any views or > opinions expressed are solely those of the author and do not necessarily > represent those of Shape Blue Ltd or related companies. If you are not the > intended recipient of this email, you must neither take any action based > upon its contents, nor copy or show it to anyone. Please contact the sender > if you believe you have received this email in error. Shape Blue Ltd is a > company incorporated in England & Wales. ShapeBlue Services India LLP is a > company incorporated in India and is operated under license from Shape Blue > Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil > and is operated under license from Shape Blue Ltd. ShapeBlue is a > registered trademark. >
