[ https://issues.apache.org/jira/browse/IGNITE-19650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mikhail Petrov updated IGNITE-19650: ------------------------------------ Affects Version/s: 2.13 2.12 > Broken serialization of communication messages due to incorrect > GridCacheQueryRequest class marshalling. > -------------------------------------------------------------------------------------------------------- > > Key: IGNITE-19650 > URL: https://issues.apache.org/jira/browse/IGNITE-19650 > Project: Ignite > Issue Type: Bug > Affects Versions: 2.12, 2.13, 2.14, 2.15 > Reporter: Mikhail Petrov > Assignee: Mikhail Petrov > Priority: Blocker > Labels: ise > Fix For: 2.16 > > Time Spent: 1h 10m > Remaining Estimate: 0h > > GridCacheQueryRequest class writeTo/readForm methods does not increment > message writer/reader state sequentially. Currently idxQryDescBytes field > corresponds message reader/writer state with number 27. But state number 26 > is skipped. This can lead to the following situation: > We write on sender node all fields preceding idxQryDescBytes to byte buffer. > But no space remains for idxQryDescBytes. So we save the state with number > 26 and returns. > When enough free space become available - we do not find any field that > corresponds 26 state and complete serialization without idxQryDescBytes field > being recorded. > Receiver node tries to read all fields including idxQryDescBytes which was > not recorded in the byte buffer by the sender node. As a result receiver node > can read a part of the next message stored in the byte buffer while trying to > read skipped idxQryDescBytes field. This results in corrupted serialization > of communication messages. > User can face the following exceptions in this case. The concrete exception > depends on the message that come after GridCacheQueryRequest. > {code:java} > 2023-05-31 14:49:02.249 > [ERROR][grid-nio-worker-tcp-comm-15-#134%TcpCommunicationSpi%][org.apache.ignite.internal.util.nio.GridDirectParser] > Failed to read message [msg=GridIoMessage [plc=0, topic=null, topicOrd=-1, > ordered=false, timeout=0, skipOnTimeout=false, msg=null], > buf=java.nio.DirectByteBuffer[pos=2 lim=16384 cap=132678], > reader=DirectMessageReader [state=DirectMessageState [pos=0, stack=[StateItem > [stream=DirectByteBufferStreamImplV2 [baseOff=139878897874032, arrOff=-1, > tmpArrOff=0, valReadBytes=0, tmpArrBytes=0, msgTypeDone=true, > msg=GridDhtAtomicNearResponse [partId=0, futId=0, primaryId=null, errs=null, > flags=], mapIt=null, it=null, arrPos=-1, keyDone=false, readSize=-1, > readItems=0, prim=0, primShift=0, uuidState=0, uuidMost=0, uuidLeast=0, > uuidLocId=0], state=0], StateItem [stream=DirectByteBufferStreamImplV2 > [baseOff=139878897874032, arrOff=-1, tmpArrOff=0, valReadBytes=0, > tmpArrBytes=0, msgTypeDone=false, msg=null, mapIt=null, it=null, arrPos=-1, > keyDone=false, readSize=-1, readItems=0, prim=0, primShift=0, uuidState=0, > uuidMost=0, uuidLeast=0, uuidLocId=0], state=0], StateItem > [stream=DirectByteBufferStreamImplV2 [baseOff=16, arrOff=-1, tmpArrOff=0, > valReadBytes=0, tmpArrBytes=0, msgTypeDone=false, msg=null, mapIt=null, > it=null, arrPos=-1, keyDone=false, readSize=-1, readItems=0, prim=0, > primShift=0, uuidState=0, uuidMost=0, uuidLeast=0, uuidLocId=0], state=0], > StateItem [stream=DirectByteBufferStreamImplV2 [baseOff=16, arrOff=-1, > tmpArrOff=0, valReadBytes=0, tmpArrBytes=0, msgTypeDone=false, msg=null, > mapIt=null, it=null, arrPos=-1, keyDone=false, readSize=-1, readItems=0, > prim=0, primShift=0, uuidState=0, uuidMost=0, uuidLeast=0, uuidLocId=0], > state=0], null, null, null, null, null, null]], protoVer=3, lastRead=false], > ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker > [super=AbstractNioClientWorker [idx=15, bytesRcvd=183689349864, bytesSent=0, > bytesRcvd0=24790, bytesSent0=0, select=true, super=GridWorker > [name=grid-nio-worker-tcp-comm-15, igniteInstanceName=TcpCommunicationSpi, > finished=false, heartbeatTs=1685533742239, hashCode=864882861, > interrupted=false, > runner=grid-nio-worker-tcp-comm-15-#134%TcpCommunicationSpi%]]], > writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], > readBuf=java.nio.DirectByteBuffer[pos=24790 lim=24790 cap=32768], > inRecovery=GridNioRecoveryDescriptor [acked=713638068, resendCnt=532, > rcvCnt=738238432, sentCnt=713638600, reserved=true, lastAck=738238432, > nodeLeft=false, node=TcpDiscoveryNode > [id=0881a6ed-5a62-4564-99ad-7cf1bc8e0288, > consistentId=tps_ise_pplad-pprbtspm0053.ca.sbrf.ru, addrs=ArrayList > [10.127.119.241, 127.0.0.1, 192.168.122.1], sockAddrs=HashSet > [/192.168.122.1:47500, /10.127.119.241:47500, /127.0.0.1:47500], > discPort=47500, order=6, intOrder=6, lastExchangeTime=1685394761595, > loc=false, ver=14.1.0#20221221-sha1:24506aa7, isClient=false], > connected=false, connectCnt=21, queueLimit=4096, reserveCnt=22, > pairedConnections=false], outRecovery=GridNioRecoveryDescriptor > [acked=713638068, resendCnt=532, rcvCnt=738238432, sentCnt=713638600, > reserved=true, lastAck=738238432, nodeLeft=false, node=TcpDiscoveryNode > [id=0881a6ed-5a62-4564-99ad-7cf1bc8e0288, > consistentId=tps_ise_pplad-pprbtspm0053.ca.sbrf.ru, addrs=ArrayList > [10.127.119.241, 127.0.0.1, 192.168.122.1], sockAddrs=HashSet > [/192.168.122.1:47500, /10.127.119.241:47500, /127.0.0.1:47500], > discPort=47500, order=6, intOrder=6, lastExchangeTime=1685394761595, > loc=false, ver=14.1.0#20221221-sha1:24506aa7, isClient=false], > connected=false, connectCnt=21, queueLimit=4096, reserveCnt=22, > pairedConnections=false], closeSocket=true, > outboundMessagesQueueSizeMetric=o.a.i.i.processors.metric.impl.LongAdderMetric@69a257d1, > super=GridNioSessionImpl [locAddr=/10.97.19.164:31489, > rmtAddr=/10.127.119.241:47100, createTime=1685533742239, closeTime=0, > bytesSent=0, bytesRcvd=24790, bytesSent0=0, bytesRcvd0=24790, > sndSchedTime=1685533742239, lastSndTime=1685533742239, > lastRcvTime=1685533742239, readsPaused=false, > filterChain=FilterChain[filters=[GridNioCodecFilter > [parser=o.a.i.i.util.nio.GridDirectParser@7529b084, directMode=true], > GridConnectionBytesVerifyFilter, SSL filter], accepted=false, > markedForClose=false]]] > org.apache.ignite.IgniteException: Invalid message type: 384 > at > org.apache.ignite.internal.managers.communication.IgniteMessageFactoryImpl.create(IgniteMessageFactoryImpl.java:133) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.internal.GridNioServerWrapper$2.create(GridNioServerWrapper.java:813) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.direct.stream.v2.DirectByteBufferStreamImplV2.readMessage(DirectByteBufferStreamImplV2.java:1189) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.direct.DirectMessageReader.readMessage(DirectMessageReader.java:336) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.processors.cache.GridCacheMessage.readFrom(GridCacheMessage.java:710) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.processors.cache.GridCacheIdMessage.readFrom(GridCacheIdMessage.java:91) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicNearResponse.readFrom(GridDhtAtomicNearResponse.java:255) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.direct.stream.v2.DirectByteBufferStreamImplV2.readMessage(DirectByteBufferStreamImplV2.java:1200) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.direct.DirectMessageReader.readMessage(DirectMessageReader.java:336) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.managers.communication.GridIoMessage.readFrom(GridIoMessage.java:271) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.managers.communication.GridIoSecurityAwareMessage.readFrom(GridIoSecurityAwareMessage.java:123) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridDirectParser.decode(GridDirectParser.java:90) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioCodecFilter.onMessageReceived(GridNioCodecFilter.java:113) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridConnectionBytesVerifyFilter.onMessageReceived(GridConnectionBytesVerifyFilter.java:88) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.ssl.GridNioSslFilter.onMessageReceived(GridNioSslFilter.java:408) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$HeadFilter.onMessageReceived(GridNioServer.java:3752) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterChain.onMessageReceived(GridNioFilterChain.java:175) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1379) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2526) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2281) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) > ~[ignite-core-14.1.0.jar:14.1.0] > at java.lang.Thread.run(Thread.java:829) ~[?:?] {code} > > {code:java} > 2023-05-31 00:26:50.270 > [ERROR][grid-nio-worker-tcp-comm-7-#126%TcpCommunicationSpi%][org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi] > Failed to process selector key [ses=GridSelectorNioSessionImpl > [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=7, > bytesRcvd=307961844272, bytesSent=0, bytesRcvd0=788711, bytesSent0=0, > select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-7, > igniteInstanceName=TcpCommunicationSpi, finished=false, > heartbeatTs=1685482009267, hashCode=1355815730, interrupted=false, > runner=grid-nio-worker-tcp-comm-7-#126%TcpCommunicationSpi%]]], > writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32594 cap=32768], > readBuf=java.nio.DirectByteBuffer[pos=11514 lim=11514 cap=32768], > inRecovery=GridNioRecoveryDescriptor [acked=435904000, resendCnt=0, > rcvCnt=478893674, sentCnt=435904020, reserved=true, lastAck=478893664, > nodeLeft=false, node=TcpDiscoveryNode > [id=6dbee697-1202-4d6c-b077-f0b00ec69adf, > consistentId=tps_ise_pplad-pprbtspm0049.ca.sbrf.ru, addrs=ArrayList > [10.97.19.163, 127.0.0.1, 192.168.122.1], sockAddrs=null, discPort=47500, > order=3, intOrder=3, lastExchangeTime=1685394761693, loc=false, > ver=14.1.0#20221221-sha1:24506aa7, isClient=false], connected=true, > connectCnt=0, queueLimit=4096, reserveCnt=2, pairedConnections=false], > outRecovery=GridNioRecoveryDescriptor [acked=435904000, resendCnt=0, > rcvCnt=478893674, sentCnt=435904020, reserved=true, lastAck=478893664, > nodeLeft=false, node=TcpDiscoveryNode > [id=6dbee697-1202-4d6c-b077-f0b00ec69adf, > consistentId=tps_ise_pplad-pprbtspm0049.ca.sbrf.ru, addrs=ArrayList > [10.97.19.163, 127.0.0.1, 192.168.122.1], sockAddrs=null, discPort=47500, > order=3, intOrder=3, lastExchangeTime=1685394761693, loc=false, > ver=14.1.0#20221221-sha1:24506aa7, isClient=false], connected=true, > connectCnt=0, queueLimit=4096, reserveCnt=2, pairedConnections=false], > closeSocket=true, > outboundMessagesQueueSizeMetric=o.a.i.i.processors.metric.impl.LongAdderMetric@69a257d1, > super=GridNioSessionImpl [locAddr=/10.127.119.240:47100, > rmtAddr=/10.97.19.163:44182, createTime=1685398068848, closeTime=0, > bytesSent=270613275246, bytesRcvd=307961844272, bytesSent0=870481, > bytesRcvd0=788711, sndSchedTime=1685398068848, lastSndTime=1685482009267, > lastRcvTime=1685482009267, readsPaused=false, > filterChain=FilterChain[filters=[GridNioCodecFilter > [parser=o.a.i.i.util.nio.GridDirectParser@8f4fb5a, directMode=true], > GridConnectionBytesVerifyFilter, SSL filter], accepted=true, > markedForClose=false]]] > java.lang.AssertionError: null > at > org.apache.ignite.internal.binary.GridBinaryMarshaller.deserialize(GridBinaryMarshaller.java:299) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.binary.BinaryMarshaller.unmarshal0(BinaryMarshaller.java:101) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.unmarshal(AbstractNodeNameAwareMarshaller.java:80) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.IgniteUtils.unmarshal(IgniteUtils.java:10742) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.managers.communication.GridIoManager.onMessage0(GridIoManager.java:1273) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.managers.communication.GridIoManager.access$300(GridIoManager.java:243) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.managers.communication.GridIoManager$2.onMessage(GridIoManager.java:509) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.notifyListener(TcpCommunicationSpi.java:1220) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$1.onMessage(TcpCommunicationSpi.java:689) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$1.onMessage(TcpCommunicationSpi.java:687) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.internal.InboundConnectionHandler.onMessage(InboundConnectionHandler.java:393) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.internal.InboundConnectionHandler.onMessage(InboundConnectionHandler.java:79) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioCodecFilter.onMessageReceived(GridNioCodecFilter.java:116) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridConnectionBytesVerifyFilter.onMessageReceived(GridConnectionBytesVerifyFilter.java:133) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.ssl.GridNioSslFilter.onMessageReceived(GridNioSslFilter.java:408) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$HeadFilter.onMessageReceived(GridNioServer.java:3752) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterChain.onMessageReceived(GridNioFilterChain.java:175) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1379) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2526) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2281) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) > ~[ignite-core-14.1.0.jar:14.1.0] > at java.lang.Thread.run(Thread.java:829) ~[?:?] > 2023-05-31 00:26:50.271 > [ERROR][grid-nio-worker-tcp-comm-7-#126%TcpCommunicationSpi%][org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi] > Closing NIO session because of unhandled exception. > org.apache.ignite.internal.util.nio.GridNioException: null > at > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2552) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2281) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) > ~[ignite-core-14.1.0.jar:14.1.0] > at java.lang.Thread.run(Thread.java:829) ~[?:?] > Caused by: java.lang.AssertionError > at > org.apache.ignite.internal.binary.GridBinaryMarshaller.deserialize(GridBinaryMarshaller.java:299) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.binary.BinaryMarshaller.unmarshal0(BinaryMarshaller.java:101) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.unmarshal(AbstractNodeNameAwareMarshaller.java:80) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.IgniteUtils.unmarshal(IgniteUtils.java:10742) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.managers.communication.GridIoManager.onMessage0(GridIoManager.java:1273) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.managers.communication.GridIoManager.access$300(GridIoManager.java:243) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.managers.communication.GridIoManager$2.onMessage(GridIoManager.java:509) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.notifyListener(TcpCommunicationSpi.java:1220) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$1.onMessage(TcpCommunicationSpi.java:689) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$1.onMessage(TcpCommunicationSpi.java:687) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.internal.InboundConnectionHandler.onMessage(InboundConnectionHandler.java:393) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.spi.communication.tcp.internal.InboundConnectionHandler.onMessage(InboundConnectionHandler.java:79) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioCodecFilter.onMessageReceived(GridNioCodecFilter.java:116) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridConnectionBytesVerifyFilter.onMessageReceived(GridConnectionBytesVerifyFilter.java:133) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.ssl.GridNioSslFilter.onMessageReceived(GridNioSslFilter.java:408) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$HeadFilter.onMessageReceived(GridNioServer.java:3752) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioFilterChain.onMessageReceived(GridNioFilterChain.java:175) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1379) > ~[ignite-core-14.1.0.jar:14.1.0] > at > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2526) > ~[ignite-core-14.1.0.jar:14.1.0] > ... 4 more {code} > -- This message was sent by Atlassian Jira (v8.20.10#820010)