Re: Apache Ignite Sink Connector

2021-09-12 Thread Saikat Maitra
Hi Shubham, Here are the documents for Apache Ignite Sink Connector using Kafka https://github.com/apache/ignite-extensions/tree/master/modules/kafka-ext Please let us know if you have any questions. Regards, Saikat On Wed, Aug 18, 2021 at 11:40 PM Shubham Shirur wrote: > Hi, > > I did not fi

Re: Apache Ignite Sink Connector

2021-09-12 Thread Shubham Shirur
Hey, Thanks for replying. I have gone through the documentation and could setup and run connectors in standalone mode as described there in docs. But I want to run it in distributed mode, can you help me with that? Thanks & Regards, Shubham On Sun, Sep 12, 2021, 7:58 PM Saikat Maitra wrote: >

Re: Apache Ignite Sink Connector

2021-09-12 Thread Saikat Maitra
Can you please elaborate on distributed mode? You can always connect multiple client to different kafka topic and write data to cluster of Ignite nodes. Regards, Saikat On Sun, Sep 12, 2021 at 10:47 AM Shubham Shirur wrote: > Hey, > > Thanks for replying. I have gone through the documentation

Re: Apache Ignite Sink Connector

2021-09-12 Thread Shubham Shirur
Yes, I agree with you. Basically kafka connect works in two different ways i.e standalone and distributed mode. In standard mode ignite sink connectors run very smoothly. So if I want to create multiple topic cache data transmission, I need to setup same number of workers and connectors which is n

Re: Apache Ignite Sink Connector

2021-09-12 Thread Saikat Maitra
Are you looking for a parallel Ignite sink connector that can connect to kafka topic? My thoughts are you should be able to do it as long as your group_id is same like mentioned here https://medium.com/@jhansireddy007/how-to-parallelise-kafka-consumers-59c8b0bbc37a I may have misunderstood the qu

Re: Ignite Cluster Snapshots

2021-09-12 Thread Shishkov Ilya
Hi, Siva! As I see, it is not expected behaviour. Is cluster baseline topology correct and all nodes are in the cluster? To check this, you can run the 'control.sh --baseline' command. Have you checked logs for errors on all nodes of the cluster? Is the above behaviour the same when creating snaps

Re: apache ignite 2.10.0 heap starvation

2021-09-12 Thread Shishkov Ilya
Hi, Ibrahim! Have you analyzed the heap dump of the server node JVMs? In case your application executes queries are their cursors closed? пт, 10 сент. 2021 г. в 11:54, Ibrahim Altun : > Igniters any comment on this issue, we are facing huge GC problems on > production environment, please advise.

Re: Ignite CheckpointReadLock /Long running cache futures

2021-09-12 Thread Ilya Kazakov
As I mentioned above, it was hanged PME. PME is a cluster-wide operation that leads to refreshing information about partition distribution across nodes. Ans any cache operations should await PME ending. In your case, client reconnection to another server node does not resolve the issue, because the

Re: Subscribe

2021-09-12 Thread Ilya Kazakov
Hi Ibrahim, to subscribe please email: user-subscr...@ignite.apache.org And welcome! --- Ilya вт, 7 сент. 2021 г. в 20:20, Ibrahim Altun : > please subscribe me > > -- > İbrahim Halil AltunSenior Software Engineer+90 > 536 3327510 • segmentify.com →

Re: apache ignite 2.10.0 heap starvation

2021-09-12 Thread Ibrahim Altun
Hi Ilya, since this is production environment i could not risk to take heap dump for now, but i will try to convince my superiors to get one and analyze it. Queries are heavily used in our system but aren't they autoclosable objects? do we have to close them anyway? here are some usage example