Re: Async IO For Cassandra

2023-07-17 Thread Pritam Agarwala
Hi Team, Any input on this will be really helpful. Thanks! On Tue, Jul 11, 2023 at 12:04 PM Pritam Agarwala < pritamagarwala...@gmail.com> wrote: > Hi Team, > > > I am using "AsyncDataStream.unorderedWait" to connect to cassandra . The > cassandra lookup

Async IO For Cassandra

2023-07-10 Thread Pritam Agarwala
Hi Team, I am using "AsyncDataStream.unorderedWait" to connect to cassandra . The cassandra lookup operators are becoming the busy operator and creating back-pressure result low throughput. The Cassandra lookup is a very simple query. So I increased the capacity parameter to 80 from 15 and cou

Task Slot Resource Allocation

2023-06-20 Thread Pritam Agarwala
Hi Team, I have a confusion about how TM's core will be used for task slots. I have TMs with 3 cores and 4 task slots . Each task slot will be using one core to perform a task and one task slot has to wait to get resources ? If I increase the cores to 4 , same as task slots per TM will it help to

Re: Network Buffers

2023-06-06 Thread Pritam Agarwala
; recommended to combine with buffer debloating. > <https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/memory/network_mem_tuning/#the-buffer-debloating-mechanism> > > > On Tue, Jun 6, 2023 at 2:44 AM Pritam Agarwala < > pritamagarwala...@gmail.com> wrote

Network Buffers

2023-06-05 Thread Pritam Agarwala
Hi All, java.io.IOException: Insufficient number of network buffers: required 2, but only 0 available. The total number of network buffers is currently set to 22773 of 32768 bytes each. What is the meaning of this exception (The total number of network buffers is currently set to 22773 of 32768

OffsetCommitMode.Kafka_periodic with checkpointing enabled

2023-05-08 Thread Pritam Agarwala
ffsets for recovery.* Jira Ticket : https://issues.apache.org/jira/browse/FLINK-32038 Thanks & Regards, Pritam Agarwala Senior Data Engineer