Hi Pritam.. since this is a look-up to an external system considering there
is network i/o in place and also the time to get the results it might be
normal to notice backpressure there.
Also note that the queries in Cassandra highly depend on the data model, so
data can be easy to find between the
Hi Pritam,
I'm sorry that I'm not familiar with Cassandra. If your async function is
always the root cause for backpressure, I think you can check the latency
for the async request in your function and log some metrics.
By the way, I think you can add cache in your async function to speedup the
l
Hi Team,
Any input on this will be really helpful.
Thanks!
On Tue, Jul 11, 2023 at 12:04 PM Pritam Agarwala <
pritamagarwala...@gmail.com> wrote:
> Hi Team,
>
>
> I am using "AsyncDataStream.unorderedWait" to connect to cassandra . The
> cassandra lookup operators are becoming the busy opera
Hi Team,
I am using "AsyncDataStream.unorderedWait" to connect to cassandra . The
cassandra lookup operators are becoming the busy operator and creating
back-pressure result low throughput.
The Cassandra lookup is a very simple query. So I increased the capacity
parameter to 80 from 15 and cou
