Glenn, this sounds like it is related to a bug that was just fixed; https://github.com/apache/cloudstack/pull/2653 Did you do a AddNicToVMCmd manually or was it a consequential action as a result? When saying it is related I do not think it is the same.
On Mon, May 21, 2018 at 6:21 AM, Glen Baars <g...@onsitecomputers.com.au> wrote: > Hello Devs, > > I was just chasing down as issue with not being able to add a NIC to a VM. > Below is the relevant logs. I found that the NICs table's domain router > placeholder for this network had a NULL MAC address and this was preventing > new NICs from being added. When I added a MAC manually to the domain > routers placeholder record all started working. > > My question is, should the router router's placeholder NIC entry have a > MAC address? If so, none of mine do. > Not all of my networks have placeholder entries, why is that? > Should I be removing the placeholder entries? > > This seems to be almost the last issue we are facing from 4.3 -> 4.11 > upgrade. It has been very successful. ( 400 ish vms, 6 Datacenters, 80 VRs ) > > > 2018-05-21 11:48:16,423 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (qtp1401132667-595:ctx-310c59ef ctx-f99ddc35) (logid:51491bb7) submit > async job-83360, details: AsyncJobVO {id:83360, userId: 98, accountId: 95, > instanceType: None, instanceId: null, cmd: > org.apache.cloudstack.api.command.user.vm.AddNicToVMCmd, > cmdInfo: {"virtualmachineid":"22fbba97-2bee-42f9-80db-4bcbaa0ba1fc"," > response":"json","ctxUserId":"98","httpmethod":"GET"," > networkid":"a3e01c87-042a-44c5-870d-8676143940ee"," > ctxStartEventId":"2191577","ctxDetails":"{\"interface > com.cloud.vm.VirtualMachine\":\"22fbba97-2bee-42f9-80db-4bcbaa0ba1fc\",\"interface > com.cloud.network.Network\":\"a3e01c87-042a-44c5-870d-8676143940ee\"}"," > ctxAccountId":"95","cmdEventType":"NIC.CREATE","_":"1526874496277"}, > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, > result: null, initMsid: 52242469890, completeMsid: null, lastUpdated: null, > lastPolled: null, > created: null} > > > 2018-05-21 11:48:16,424 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (API-Job-Executor-1:ctx-dcdc8f3a job-83360) (logid:5254cc87) Executing > AsyncJobVO {id:83360, userId: 98, accountId: 95, instanceType: None, > instanceId: null, cmd: > org.apache.cloudstack.api.command.user.vm.AddNicToVMCmd, > cmdInfo: {"virtualmachineid":"22fbba97-2bee-42f9-80db-4bcbaa0ba1fc"," > response":"json","ctxUserId":"98","httpmethod":"GET"," > networkid":"a3e01c87-042a-44c5-870d-8676143940ee"," > ctxStartEventId":"2191577","ctxDetails":"{\"interface > com.cloud.vm.VirtualMachine\":\"22fbba97-2bee-42f9-80db-4bcbaa0ba1fc\",\"interface > com.cloud.network.Network\":\"a3e01c87-042a-44c5-870d-8676143940ee\"}"," > ctxAccountId":"95","cmdEventType":"NIC.CREATE","_":"1526874496277"}, > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, > result: null, initMsid: 52242469890, completeMsid: null, lastUpdated: null, > lastPolled: null, created: null} > 2018-05-21 11:48:16,424 DEBUG [c.c.a.ApiServlet] > (qtp1401132667-595:ctx-310c59ef > ctx-f99ddc35) (logid:51491bb7) ===END=== 103.4.132.4 -- GET command= > addNicToVirtualMachine&response=json&virtualmachineid=22fbba97- > 2bee-42f9-80db-4bcbaa0ba1fc&networkid=a3e01c87-042a-44c5- > 870d-8676143940ee&_=1526874496277 > > > 2018-05-21 11:48:16,474 ERROR [c.c.a.ApiAsyncJobDispatcher] > (API-Job-Executor-1:ctx-dcdc8f3a job-83360) (logid:5254cc87) Unexpected > exception while executing org.apache.cloudstack.api. > command.user.vm.AddNicToVMCmd > com.cloud.utils.exception.CloudRuntimeException: A NIC with this MAC > address exists for network: a3e01c87-042a-44c5-870d-8676143940ee > at com.cloud.vm.UserVmManagerImpl.addNicToVirtualMachine( > UserVmManagerImpl.java:1203) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.springframework.aop.support.AopUtils. > invokeJoinpointUsingReflection(AopUtils.java:338) > at org.springframework.aop.framework.ReflectiveMethodInvocation. > invokeJoinpoint(ReflectiveMethodInvocation.java:197) > at org.springframework.aop.framework.ReflectiveMethodInvocation. > proceed(ReflectiveMethodInvocation.java:163) > at org.apache.cloudstack.network.contrail.management. > EventUtils$EventInterceptor.invoke(EventUtils.java:107) > at org.springframework.aop.framework.ReflectiveMethodInvocation. > proceed(ReflectiveMethodInvocation.java:174) > at com.cloud.event.ActionEventInterceptor.invoke( > ActionEventInterceptor.java:51) > at org.springframework.aop.framework.ReflectiveMethodInvocation. > proceed(ReflectiveMethodInvocation.java:174) > at org.springframework.aop.interceptor. > ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) > at org.springframework.aop.framework.ReflectiveMethodInvocation. > proceed(ReflectiveMethodInvocation.java:185) > at org.springframework.aop.framework.JdkDynamicAopProxy. > invoke(JdkDynamicAopProxy.java:212) > at com.sun.proxy.$Proxy169.addNicToVirtualMachine(Unknown Source) > at org.apache.cloudstack.api.command.user.vm.AddNicToVMCmd. > execute(AddNicToVMCmd.java:161) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) > at com.cloud.api.ApiAsyncJobDispatcher.runJob( > ApiAsyncJobDispatcher.java:108) > at org.apache.cloudstack.framework.jobs.impl. > AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:581) > at org.apache.cloudstack.managed.context. > ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > at org.apache.cloudstack.managed.context.impl. > DefaultManagedContext$1.call(DefaultManagedContext.java:56) > at org.apache.cloudstack.managed.context.impl. > DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > at org.apache.cloudstack.managed.context.impl. > DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > at org.apache.cloudstack.managed.context. > ManagedContextRunnable.run(ManagedContextRunnable.java:46) > at org.apache.cloudstack.framework.jobs.impl. > AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:529) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1149) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > > > Kind regards, > Glen Baars > > This e-mail is intended solely for the benefit of the addressee(s) and any > other named recipient. It is confidential and may contain legally > privileged or confidential information. If you are not the recipient, any > use, distribution, disclosure or copying of this e-mail is prohibited. The > confidentiality and legal privilege attached to this communication is not > waived or lost by reason of the mistaken transmission or delivery to you. > If you have received this e-mail in error, please notify us immediately. > -- Daan