Hello,
I try to build a basic cloudstack environment, and i have some issue, my
question is if someone can help me with this issue.
1x CentOS 6.6 - CloudStack Management 4.5
1x CentOS 6.6 - Agent
After i configured all the Zone, Pod, Cluster, Host, Storage.
I get this error :
Agent
=======================
agent.log
at org.libvirt.ErrorHandler.processError(Unknown Source)
at org.libvirt.Connect.processError(Unknown Source)
at org.libvirt.Connect.processError(Unknown Source)
at org.libvirt.Connect.domainCreateXML(Unknown Source)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1267)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3828)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1361)
at com.cloud.agent.Agent.processRequest(Agent.java:503)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)
at com.cloud.utils.nio.Task.run(Task.java:84)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2015-08-24 19:58:27,398 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) Attempting to remove volume
784dfb3b-38a0-4364-85c3-957559d0b996 from pool
8b0ef411-dcbf-4af5-a6f5-d75f70f69fda
2015-08-24 19:58:53,858 WARN [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-1:null) LibvirtException
org.libvirt.LibvirtException: internal error Process exited while reading
console log output: 2015-08-24T23:58:53.671841Z qemu-kvm: -chardev
pty,id=charserial0: Failed to create chardev
========================
Management
========================
2015-08-24 19:59:25,141 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-46:ctx-74cf9cb8 job-1/job-167) Done executing
com.cloud.vm.VmWorkStart for job-167
2015-08-24 19:59:25,142 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-46:ctx-74cf9cb8 job-1/job-167) Remove job-167 from job
monitoring
2015-08-24 19:59:25,176 WARN [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-df02251a) Exception while trying to start secondary storage vm
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[SecondaryStorageVm|s-31-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:947)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4480)
at sun.reflect.GeneratedMethodAccessor193.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4636)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2015-08-24 19:59:25,177 INFO [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-df02251a) Unable to start secondary storage vm for standby
capacity, secStorageVm vm Id : 31, will recycle it and start a new one
2015-08-24 19:59:25,181 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(secstorage-1:ctx-df02251a) Sync job-169 execution on object VmWorkJobQueue.31
2015-08-24 19:59:27,062 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-47a5509d) Execute sync-queue item: SyncQueueItemVO
{id:153, queueId: 150, contentType: AsyncJob, contentId: 169, lastProcessMsid:
130591767396, lastprocessNumber: 3, lastProcessTime: Mon Aug 24 19:59:26 EDT
2015, created: Mon Aug 24 19:59:25 EDT 2015}
2015-08-24 19:59:27,062 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-47a5509d) Schedule queued job-169
2015-08-24 19:59:27,083 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Add job-169 into job
monitoring
2015-08-24 19:59:27,085 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Executing AsyncJobVO {id:169,
userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd:
com.cloud.vm.VmWorkStop, cmdInfo:
rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAH3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 130591767396, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Mon Aug 24 19:59:25 EDT 2015}
2015-08-24 19:59:27,086 DEBUG [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Run VM work job:
com.cloud.vm.VmWorkStop for VM 31, job origin: 1
2015-08-24 19:59:27,086 DEBUG [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Execute VM work
job:
com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":31,"handlerName":"VirtualMachineManagerImpl"}
2015-08-24 19:59:27,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) VM is already
stopped: VM[SecondaryStorageVm|s-31-VM]
2015-08-24 19:59:27,088 DEBUG [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Done executing
VM work job:
com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":31,"handlerName":"VirtualMachineManagerImpl"}
2015-08-24 19:59:27,088 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Complete async
job-169, jobStatus: SUCCEEDED, resultCode: 0, result: null
2015-08-24 19:59:27,088 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Publish async
job-169 complete on message bus
2015-08-24 19:59:27,088 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Wake up jobs
related to job-169
2015-08-24 19:59:27,088 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Update db status
for job-169
2015-08-24 19:59:27,088 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Wake up jobs
joined with job-169 and disjoin all subjobs created from job- 169
2015-08-24 19:59:27,104 DEBUG [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Done with run of VM work job:
com.cloud.vm.VmWorkStop for VM 31, job origin: 1
2015-08-24 19:59:27,104 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Done executing
com.cloud.vm.VmWorkStop for job-169
2015-08-24 19:59:27,104 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Remove job-169 from job
monitoring
2015-08-24 19:59:27,141 DEBUG [c.c.c.CapacityManagerImpl]
(secstorage-1:ctx-df02251a) VM state transitted from :Stopped to Expunging with
event: ExpungeOperationvm's original host id: null new host id: null host id
before state transition: null
2015-08-24 19:59:27,141 DEBUG [c.c.v.VirtualMachineManagerImpl]
(secstorage-1:ctx-df02251a) Destroying vm VM[SecondaryStorageVm|s-31-VM]
2015-08-24 19:59:27,141 DEBUG [c.c.v.VirtualMachineManagerImpl]
(secstorage-1:ctx-df02251a) Cleaning up NICS
2015-08-24 19:59:27,141 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(secstorage-1:ctx-df02251a) Cleaning network for vm: 31
2015-08-24 19:59:27,160 DEBUG [c.c.n.g.DirectNetworkGuru]
(secstorage-1:ctx-df02251a) Deallocate network: networkId: 204, ip:
172.20.255.113
2015-08-24 19:59:27,161 DEBUG [c.c.n.g.DirectNetworkGuru]
(secstorage-1:ctx-df02251a) remove nic 120 secondary ip
2015-08-24 19:59:27,195 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(secstorage-1:ctx-df02251a) Removed nic id=120
2015-08-24 19:59:27,195 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(secstorage-1:ctx-df02251a) Revoving nic secondary ip entry ...
2015-08-24 19:59:27,228 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(secstorage-1:ctx-df02251a) Removed nic id=121
2015-08-24 19:59:27,229 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(secstorage-1:ctx-df02251a) Revoving nic secondary ip entry ...
2015-08-24 19:59:27,262 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(secstorage-1:ctx-df02251a) Removed nic id=122
2015-08-24 19:59:27,262 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(secstorage-1:ctx-df02251a) Revoving nic secondary ip entry ...
2015-08-24 19:59:27,295 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(secstorage-1:ctx-df02251a) Removed nic id=123
2015-08-24 19:59:27,295 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(secstorage-1:ctx-df02251a) Revoving nic secondary ip entry ...
2015-08-24 19:59:27,295 DEBUG [c.c.v.VirtualMachineManagerImpl]
(secstorage-1:ctx-df02251a) Cleaning up hypervisor data structures (ex. SRs in
XenServer) for managed storage
2015-08-24 19:59:27,295 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(secstorage-1:ctx-df02251a) Cleaning storage for vm: 31
2015-08-24 19:59:27,337 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-df02251a) Seq
1-3472275312702652538: Sending { Cmd , MgmtId: 130591767396, via:
1(kvm001.shape.host), Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"3eb007ec-7839-41e5-9ab1-65655fa13a3f","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b0ef411-dcbf-4af5-a6f5-d75f70f69fda","id":1,"poolType":"Filesystem","host":"167.114.101.20","path":"/var/lib/libvirt/images","port":0,"url":"Filesystem://167.114.101.20/var/lib/libvirt/images/?ROLE=Primary&STOREUUID=8b0ef411-dcbf-4af5-a6f5-d75f70f69fda"}},"name":"ROOT-31","size":0,"path":"3eb007ec-7839-41e5-9ab1-65655fa13a3f","volumeId":33,"vmName":"s-31-VM","accountId":1,"format":"QCOW2","provisioningType":"THIN","id":33,"deviceId":0,"hypervisorType":"KVM"}},"wait":0}}]
}
2015-08-24 19:59:27,345 DEBUG [c.c.a.t.Request] (AgentManager-Handler-7:null)
Seq 1-3472275312702652538: Processing: { Ans: , MgmtId: 130591767396, via: 1,
Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
2015-08-24 19:59:27,345 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-df02251a) Seq
1-3472275312702652538: Received: { Ans: , MgmtId: 130591767396, via: 1, Ver:
v1, Flags: 10, { Answer } }
2015-08-24 19:59:27,363 INFO [o.a.c.s.v.VolumeServiceImpl]
(secstorage-1:ctx-df02251a) Volume 33 is not referred anywhere, remove it from
volumes table
2015-08-24 19:59:27,395 DEBUG [c.c.v.VirtualMachineManagerImpl]
(secstorage-1:ctx-df02251a) Expunged VM[SecondaryStorageVm|s-31-VM]
2015-08-24 19:59:27,412 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter]
(secstorage-1:ctx-df02251a) received secondary storage vm alert
2015-08-24 19:59:27,412 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter]
(secstorage-1:ctx-df02251a) Secondary Storage Vm creation failure, zone: zone001
2015-08-24 19:59:27,413 WARN [o.a.c.alerts] (secstorage-1:ctx-df02251a)
alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null //
message:: Secondary Storage Vm creation failure. zone: zone001, error details:
null
2015-08-24 19:59:27,429 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl]
(secstorage-1:ctx-df02251a) Primary secondary storage is not even started, wait
until next turn
2015-08-24 19:59:28,993 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-0abaaa2d) Begin cleanup expired async-jobs
2015-08-24 19:59:28,995 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-0abaaa2d) End cleanup expired async-jobs
2015-08-24 19:59:29,067 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterMonitor-1:ctx-42ef39cb) Found 0 running routers.
2015-08-24 19:59:29,067 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-43f5076d) Found 0 routers to update status.
2015-08-24 19:59:29,068 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-43f5076d) Found 0 networks to update RvR status.
2015-08-24 19:59:29,093 DEBUG [c.c.n.ExternalDeviceUsageManagerImpl]
(ExternalNetworkMonitor-1:ctx-9b08ea84) External devices stats collector is
running...
2015-08-24 19:59:29,152 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
(SnapshotPollTask:ctx-acd70702) Snapshot scheduler.poll is being called at
2015-08-24 23:59:29 GMT
2015-08-24 19:59:29,153 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
(SnapshotPollTask:ctx-acd70702) Got 0 snapshots to be executed at 2015-08-24
23:59:29 GMT
2015-08-24 19:59:38,993 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-ed734d53) Begin cleanup expired async-jobs
2015-08-24 19:59:38,995 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-ed734d53) End cleanup expired async-jobs
2015-08-24 19:59:39,138 DEBUG [c.c.n.l.LBHealthCheckManagerImpl]
(LBHealthCheck-1:ctx-7c74ed95) LB HealthCheck Manager is running and getting
the updates from LB providers and updating service status
2015-08-24 19:59:39,142 DEBUG [c.c.n.l.LBHealthCheckManagerImpl]
(LBHealthCheck-1:ctx-7c74ed95) LB HealthCheck Manager is running and getting
the updates from LB providers and updating service status
2015-08-24 19:59:40,849 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-8:null) Ping from 1
2015-08-24 19:59:40,849 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-8:null) Process host VM state report from ping process.
host: 1
2015-08-24 19:59:40,849 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-8:null) Process VM state report. host: 1, number of
records in report: 0
2015-08-24 19:59:40,850 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-8:null) Done with process of VM state report. host: 1
2015-08-24 19:59:44,071 DEBUG [c.c.s.StatsCollector]
(StatsCollector-4:ctx-13add4f6) AutoScaling Monitor is running...
2015-08-24 19:59:44,084 DEBUG [c.c.s.StatsCollector]
(StatsCollector-2:ctx-f71544c1) VmStatsCollector is running...
2015-08-24 19:59:44,569 DEBUG [c.c.s.StatsCollector]
(StatsCollector-3:ctx-53233e04) StorageCollector is running...
2015-08-24 19:59:44,570 DEBUG [c.c.s.StatsCollector]
(StatsCollector-3:ctx-53233e04) There is no secondary storage VM for secondary
storage host Primary
2015-08-24 19:59:44,617 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-53233e04)
Seq 1-3472275312702652539: Received: { Ans: , MgmtId: 130591767396, via: 1,
Ver: v1, Fl
Regards,
Cristian
