Denis, By the way. Do you know who else receives messages for moderation (I do not)?
Best regards, Ivan Pavlukhin ср, 11 мар. 2020 г. в 19:05, Denis Magda <dma...@apache.org>: > > Hi, > > Please subscribe to the dev mailing list so that we don't need to moderate > and approve your emails. > https://ignite.apache.org/community/resources.html#mail-lists > > Also, it looks like this question is more suited for the user list. Please > send it there (don't forget to subscribe on the user if you haven't done so > yet). > > - > Denis > > > On Wed, Mar 11, 2020 at 5:39 AM < > dev-reject-1583930390.40791.ooeeajdjnfgedgbbd...@ignite.apache.org> wrote: > > > > > To approve: > > dev-accept-1583930390.40791.ooeeajdjnfgedgbbd...@ignite.apache.org > > To reject: > > dev-reject-1583930390.40791.ooeeajdjnfgedgbbd...@ignite.apache.org > > To give a reason to reject: > > %%% Start comment > > %%% End comment > > > > > > > > > > ---------- Forwarded message ---------- > > From: VeenaMithare <v.mith...@cmcmarkets.com> > > To: dev@ignite.apache.org > > Cc: > > Bcc: > > Date: Wed, 11 Mar 2020 07:39:42 -0500 (CDT) > > Subject: Server Node comes down with : (err) Failed to notify listener: > > GridDhtTxPrepareFuture Error > > Hi Team, > > > > We have a 3 node server cluster > > > > A 4th node joins as a client with a continuous query on a Table A( > > Transaction_mode = transactional ). > > > > Now If I bring the client down and issue an update to the Table A within > > failureDetectionTimeout 30000 , I get the following error and */this error > > brings the server down/*: > > > > "(err) Failed to notify listener: GridDhtTxPrepareFuture Error" > > =================================== > > Basically the server , tries to update the record on the Table A, and tries > > to notify Client since it had registered a continuous query for Table A. > > But since the Client Node has been brought down, and it undeploys the > > remotefilterfactory lambda, and the server is no longer able to complete > > the > > transaction . > > > > */This also brings the server down./ > > * > > How can I resolve this issue ? > > ======================================= > > Please find the complete stack trace for this error : > > > > [12:14:12] (err) Failed to notify listener: GridDhtTxPrepareFuture > > [futId=0a69e79c071-93faf34d-a776-4166-9f3b-4b5a0f54b8f9, err=null, > > replied=1, mapped=1, req=GridNearTxPrepareRequest > > [futId=4250e79c071-51438f4f-c061-45f7-b34e-57c90f2055e9, miniId=1, > > topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], > > subjId=da486d0b-36a1-43d4-b05b-47d126fd880e, taskNameHash=0, > > flags=[implicitSingle], super=GridDistributedTxPrepareRequest > > [threadId=382, > > concurrency=OPTIMISTIC, isolation=READ_COMMITTED, writeVer=GridCacheVersion > > [topVer=195408427, order=1583928843624, nodeOrder=1], timeout=1000, > > reads=null, writes=[IgniteTxEntry [key=ABCKEY [idHash=1413504800, > > hash=-1419375634, VALUETYPE=somevaluetype, NAME=TEST4375234], > > cacheId=-1512899836, txKey=IgniteTxKey [key=ABCKEY [idHash=1413504800, > > hash=-1419375634, VALUETYPE=somevaluetype, NAME=TEST4375234], > > cacheId=-1512899836], val=[op=CREATE, val=ABC [idHash=108633195, > > hash=-965148880, ACTIVE=true, MODIFICATIONDATE=2020-02-03 18:29:03.501, > > VALUETYPE=null, SCHEMAREF=null, VALUE=DEV, MACHINENAME=null, COMMENT=null, > > NAME=null, APPLICATIONNAME=null, SCHEMANAME=null, KEYNAME=ENVIRONMENT, > > USERNAME=null, INTERNALVERSION=null, MODIFICATIONTYPE=null]], > > prevVal=[op=NOOP, val=null], oldVal=[op=NOOP, val=null], > > entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, > > explicitVer=null, dhtVer=null, > > filters=[o.a.i.i.processors.cache.CacheEntrySerializablePredicate@388c822f > > ], > > filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=[], > > part=136, super=GridDistributedCacheEntry [super=GridCacheMapEntry > > [key=ABCKEY [idHash=1413504800, hash=-1419375634, VALUETYPE=somevaluetype, > > NAME=TEST4375234], val=null, ver=GridCacheVersion [topVer=195408427, > > order=1583928843625, nodeOrder=4], hash=-1419375634, > > extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion > > [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=1, > > locked=false, nodeId=null, locMapped=false, expiryPlc=null, > > transferExpiryPlc=false, flags=2, partUpdateCntr=0, serReadVer=null, > > xidVer=null]], dhtVers=null, txSize=0, plc=2, > > txState=IgniteTxImplicitSingleStateImpl [init=true, recovery=false], > > flags=onePhase|last, super=GridDistributedBaseMessage [ver=GridCacheVersion > > [topVer=195408427, order=1583928843624, nodeOrder=1], committedVers=null, > > rolledbackVers=null, cnt=0, super=GridCacheIdMessage [cacheId=0]]]], > > trackable=true, nearMiniId=1, last=true, retVal=false, ret=GridCacheReturn > > [v=null, cacheObj=null, success=true, invokeRes=false, loc=false, > > cacheId=0], lockKeys=[], forceKeysFut=null, locksReady=true, invoke=false, > > timeoutObj=PrepareTimeoutObject [timeout=1000], xid=GridCacheVersion > > [topVer=195408427, order=1583928843625, nodeOrder=4], > > innerFuts=[[node=da486d0b-36a1-43d4-b05b-47d126fd880e, loc=false, > > done=true]], super=GridCompoundFuture > > > > [rdc=o.a.i.i.processors.cache.distributed.dht.GridDhtTxPrepareFuture$1@73415bf > > , > > initFlag=1, lsnrCalls=1, done=true, cancelled=false, err=null, > > futs=[true]]]java.lang.NoClassDefFoundError: > > com/companyname/abc/configstore/helper/ContinuousQueryHelper > > at > > > > com.companyname.abc.configstore.helper.ContinuousQueryHelper$ConfigStoreTableRemoteFilterFactory$1.evaluate(ContinuousQueryHelper.java:293) > > at > > > > org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryHandler.filter(CacheContinuousQueryHandler.java:833) > > at > > > > org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryHandler$2.onEntryUpdated(CacheContinuousQueryHandler.java:422) > > at > > > > org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryManager.onEntryUpdated(CacheContinuousQueryManager.java:426) > > at > > > > org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerSet(GridCacheMapEntry.java:1584) > > at > > > > org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocalAdapter.java:741) > > at > > > > org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocalAdapter.localFinish(GridDhtTxLocalAdapter.java:796) > > at > > > > org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.localFinish(GridDhtTxLocal.java:584) > > at > > > > org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.finishTx(GridDhtTxLocal.java:463) > > at > > > > org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.commitDhtLocalAsync(GridDhtTxLocal.java:516) > > at > > > > org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.commitAsync(GridDhtTxLocal.java:525) > > at > > > > org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onDone(GridDhtTxPrepareFuture.java:758) > > at > > > > org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onDone(GridDhtTxPrepareFuture.java:110) > > at > > > > org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:453) > > at > > > > org.apache.ignite.internal.util.future.GridCompoundFuture.checkComplete(GridCompoundFuture.java:285) > > at > > > > org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:144) > > at > > > > org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:45) > > at > > > > org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:385) > > at > > > > org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:349) > > at > > > > org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:337) > > at > > > > org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:497) > > at > > > > org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:476) > > at > > > > org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:453) > > at > > > > org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture$MiniFuture.onResult(GridDhtTxPrepareFuture.java:1948) > > at > > > > org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onResult(GridDhtTxPrepareFuture.java:572) > > at > > > > org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.processDhtTxPrepareResponse(IgniteTxHandler.java:798) > > at > > > > org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.access$500(IgniteTxHandler.java:119) > > at > > > > org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$6.apply(IgniteTxHandler.java:229) > > at > > > > org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$6.apply(IgniteTxHandler.java:227) > > at > > > > org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:1056) > > at > > > > org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:581) > > at > > > > org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:380) > > at > > > > org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:306) > > at > > > > org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:101) > > at > > > > org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:295) > > at > > > > org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1569) > > at > > > > org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1197) > > at > > > > org.apache.ignite.internal.managers.communication.GridIoManager.access$4200(GridIoManager.java:127) > > at > > > > org.apache.ignite.internal.managers.communication.GridIoManager$9.run(GridIoManager.java:1093) > > at > > > > org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:505) > > at > > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.ClassNotFoundException: Failed to peer load class > > [class=com.companyname.abc.configstore.helper.ContinuousQueryHelper, > > > > nodeClsLdrs={fb2b9513-a763-488a-86b8-39d80e18427f=35f0489c071-fb2b9513-a763-488a-86b8-39d80e18427f}, > > parentClsLoader=sun.misc.Launcher$AppClassLoader@73d16e93] > > at > > > > org.apache.ignite.internal.managers.deployment.GridDeploymentClassLoader.sendClassRequest(GridDeploymentClassLoader.java:661) > > at > > > > org.apache.ignite.internal.managers.deployment.GridDeploymentClassLoader.findClass(GridDeploymentClassLoader.java:508) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:418) > > at > > > > org.apache.ignite.internal.managers.deployment.GridDeploymentClassLoader.loadClass(GridDeploymentClassLoader.java:440) > > ... 42 more > > Caused by: class org.apache.ignite.IgniteCheckedException: Failed to send > > message (node may have left the grid or TCP connection cannot be > > established > > due to firewall issues) [node=TcpDiscoveryNode > > [id=fb2b9513-a763-488a-86b8-39d80e18427f, addrs=[0:0:0:0:0:0:0:1, > > x.x.x.100, > > 127.0.0.1], sockAddrs=[machinename.companyname.LOCAL/x.x.x.100:0, > > /0:0:0:0:0:0:0:1:0, /127.0.0.1:0], discPort=0, order=7, intOrder=5, > > lastExchangeTime=1583928842125, loc=false, > > ver=2.7.6#20190911-sha1:21f7ca41, > > isClient=true], topic=TOPIC_CLASSLOAD, msg=GridDeploymentRequest > > > > [rsrcName=com/companyname/abc/configstore/helper/ContinuousQueryHelper.class, > > ldrId=35f0489c071-fb2b9513-a763-488a-86b8-39d80e18427f, isUndeploy=false, > > nodeIds=null], policy=1] > > at > > > > org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1667) > > at > > > > org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1731) > > at > > > > org.apache.ignite.internal.managers.deployment.GridDeploymentCommunication.sendResourceRequest(GridDeploymentCommunication.java:454) > > at > > > > org.apache.ignite.internal.managers.deployment.GridDeploymentClassLoader.sendClassRequest(GridDeploymentClassLoader.java:601) > > ... 45 more > > Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to send > > message to remote node: TcpDiscoveryNode > > [id=fb2b9513-a763-488a-86b8-39d80e18427f, addrs=[0:0:0:0:0:0:0:1, > > x.x.x.100, > > 127.0.0.1], sockAddrs=[machinename.companyname.LOCAL/x.x.x.100:0, > > /0:0:0:0:0:0:0:1:0, /127.0.0.1:0], discPort=0, order=7, intOrder=5, > > lastExchangeTime=1583928842125, loc=false, > > ver=2.7.6#20190911-sha1:21f7ca41, > > isClient=true] > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2747) > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2672) > > at > > > > org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1656) > > ... 48 more > > Caused by: class org.apache.ignite.IgniteCheckedException: Failed to > > connect > > to node (is node still alive?). Make sure that each ComputeTask and cache > > Transaction has a timeout set in order to prevent parties from waiting > > forever in case of network issues > > [nodeId=fb2b9513-a763-488a-86b8-39d80e18427f, addrs=[/127.0.0.1:47102, > > /0:0:0:0:0:0:0:1:47102, machinename.companyname.LOCAL/x.x.x.100:47102]] > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3459) > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createNioClient(TcpCommunicationSpi.java:2987) > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2870) > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.access$6000(TcpCommunicationSpi.java:271) > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$CommunicationWorker.processDisconnect(TcpCommunicationSpi.java:4489) > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$CommunicationWorker.body(TcpCommunicationSpi.java:4294) > > at > > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$5.body(TcpCommunicationSpi.java:2237) > > at > > org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) > > Suppressed: class org.apache.ignite.IgniteCheckedException: Failed > > to > > connect to address [addr=/127.0.0.1:47102, err=Connection refused: no > > further information] > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3462) > > ... 8 more > > Caused by: java.net.ConnectException: Connection refused: no > > further > > information > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > at > > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) > > at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3299) > > ... 8 more > > Suppressed: class org.apache.ignite.IgniteCheckedException: Failed > > to > > connect to address [addr=/0:0:0:0:0:0:0:1:47102, err=Connection refused: no > > further information] > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3462) > > ... 8 more > > Caused by: java.net.ConnectException: Connection refused: no > > further > > information > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > at > > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) > > at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3299) > > ... 8 more > > Suppressed: class org.apache.ignite.IgniteCheckedException: Failed > > to > > connect to address [addr=machinename.companyname.LOCAL/x.x.x.100:47102, > > err=Connection refused: no further information] > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3462) > > ... 8 more > > Caused by: java.net.ConnectException: Connection refused: no > > further > > information > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > at > > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) > > at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) > > at > > > > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3299) > > > > > > > > -- > > Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/ > > > >
