Raafat Mhamed created CLOUDSTACK-6894: -----------------------------------------
Summary: Secondary storage problem Key: CLOUDSTACK-6894 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6894 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the default.) Components: KVM Affects Versions: 4.3.0 Reporter: Raafat Mhamed Priority: Critical I have a problem in secondary storage that the NFS is not mounted and the cloud service is not running. root@s-3-VM:~# /usr/local/cloud/systemvm/ssvm-check.sh ================================================ First DNS server is 172.20.20.20 PING 172.20.20.20 (172.20.20.20): 48 data bytes --- 172.20.20.20 ping statistics --- 2 packets transmitted, 0 packets received, 100% packet loss WARNING: cannot ping DNS server route follows Kernel IP routing table Destination Gateway Genmask Flags Metric Ref Use Iface 0.0.0.0 192.168.140.254 0.0.0.0 UG 0 0 0 eth2 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth0 192.168.129.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1 192.168.129.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3 192.168.140.0 0.0.0.0 255.255.252.0 U 0 0 0 eth2 ================================================ Good: DNS resolves download.cloud.com ================================================ ERROR: NFS is not currently mounted Try manually mounting from inside the VM NFS server is eth2 ping: unknown host WARNING: cannot ping nfs server routing table follows Kernel IP routing table Destination Gateway Genmask Flags Metric Ref Use Iface 0.0.0.0 192.168.140.254 0.0.0.0 UG 0 0 0 eth2 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth0 192.168.129.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1 192.168.129.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3 192.168.140.0 0.0.0.0 255.255.252.0 U 0 0 0 eth2 ================================================ Management server is 192.168.129.9. Checking connectivity. Good: Can connect to management server port 8250 ================================================ ERROR: Java process not running. Try restarting the SSVM. root@s-3-VM:~# tail /var/log/cloud.log 2014-06-11 12:57:44,666 ERROR [cloud.agent.AgentShell] (main:null) Unable to start agent: Resource class not found: com.cloud.storage.resource.PremiumSecondaryStorageResource due to: java.lang.ClassNotFoundException: com.cloud.storage.resource.PremiumSecondaryStorageResource 2014-06-11 12:57:52,169 INFO [cloud.agent.AgentShell] (main:null) Agent started 2014-06-11 12:57:52,171 INFO [cloud.agent.AgentShell] (main:null) Implementation Version is 4.3.0 2014-06-11 12:57:52,171 INFO [cloud.agent.AgentShell] (main:null) agent.properties found at /usr/local/cloud/systemvm/conf/agent.properties 2014-06-11 12:57:52,181 DEBUG [cloud.agent.AgentShell] (main:null) Found property: instance 2014-06-11 12:57:52,181 DEBUG [cloud.agent.AgentShell] (main:null) Found property: resource 2014-06-11 12:57:52,181 INFO [cloud.agent.AgentShell] (main:null) Defaulting to using properties file for storage 2014-06-11 12:57:52,183 INFO [cloud.agent.AgentShell] (main:null) Defaulting to the constant time backoff algorithm 2014-06-11 12:57:52,197 INFO [cloud.utils.LogUtils] (main:null) log4j configuration found at /usr/local/cloud/systemvm/conf/log4j-cloud.xml 2014-06-11 12:57:52,212 DEBUG [cloud.agent.AgentShell] (main:null) Checking to see if agent.SecStorage.pid exists. 2014-06-11 12:57:52,214 DEBUG [cloud.utils.ProcessUtil] (main:null) environment.properties could not be opened 2014-06-11 12:57:52,220 DEBUG [cloud.utils.ProcessUtil] (main:null) Executing: bash -c echo $PPID 2014-06-11 12:57:52,224 DEBUG [cloud.utils.ProcessUtil] (main:null) Execution is successful. 2014-06-11 12:57:52,228 ERROR [cloud.agent.AgentShell] (main:null) Unable to start agent: Resource class not found: com.cloud.storage.resource.PremiumSecondaryStorageResource due to: java.lang.ClassNotFoundException: com.cloud.storage.resource.PremiumSecondaryStorageResource root@s-3-VM:~# route -n Kernel IP routing table Destination Gateway Genmask Flags Metric Ref Use Iface 0.0.0.0 192.168.140.254 0.0.0.0 UG 0 0 0 eth2 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth0 192.168.129.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1 192.168.129.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3 192.168.140.0 0.0.0.0 255.255.252.0 U 0 0 0 eth2 root@s-3-VM:~# ip route show default via 192.168.140.254 dev eth2 169.254.0.0/16 dev eth0 proto kernel scope link src 169.254.2.51 192.168.129.0/24 dev eth1 proto kernel scope link src 192.168.129.60 192.168.129.0/24 dev eth3 proto kernel scope link src 192.168.129.81 192.168.140.0/22 dev eth2 proto kernel scope link src 192.168.142.5 root@s-3-VM:~# df -h Filesystem Size Used Avail Use% Mounted on rootfs 276M 144M 119M 55% / udev 10M 0 10M 0% /dev tmpfs 50M 232K 50M 1% /run /dev/disk/by-uuid/89eb6b0a-5f5a-47cc-8bd1-371987c5700e 276M 144M 119M 55% / tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 213M 0 213M 0% /run/shm /dev/vda1 45M 22M 21M 51% /boot /dev/vda6 98M 5.6M 88M 6% /home /dev/vda8 368M 11M 339M 3% /opt /dev/vda10 63M 5.3M 55M 9% /tmp /dev/vda7 610M 535M 44M 93% /usr /dev/vda9 415M 259M 135M 66% /var root@s-3-VM:~# -- This message was sent by Atlassian JIRA (v6.2#6252)