Re: How to use pipeline.jobvertex-parallelism-overrides property.

Hi, Krzysztof. As liu ron said, the key of the map for this configuration is the value from JobVertexId#toHexString. Maybe we could improve the docs to provide more details. The condition that two operators have the same parallelism is a must for chaining them. If they have different parallelisms,

Re: How to use pipeline.jobvertex-parallelism-overrides property.

Hi, Krzysztof As stated in the description section, this option is used to override the parallelism of a JobVertex, where the key is JobVertex id, you can see [1] for double check. A JobVertex may contain more than one operator, so we cannot override the parallelism of a given operator alone. One

Help needed on stack overflow query

Hello, Creating a new question for this query as I am not able to reply to the post. Can anyone help with the below query https://stackoverflow.com/questions/76949195/how-to-include-multiple-filters-in-filter-includes-parameter-fo

Re: Request-Response flow for real-time analytics

A .connect() method may work. You can connect the changeLogStream coming from the table with fields Customer and sum with the original stream consisting of Customer and EventId. In a coProcessFunction, you can keep the latest EventID of a Customer in the state and whenever you receive data from tab

Re: Request-Response flow for real-time analytics

Hi Xiagyu, Thank you for providing the SQL query, i will try it out: but i don't think MAX() will work for our use-case as the event ids may not be ordered. when they reach flink. On Wed, 23 Aug 2023 at 15:23, xiangyu feng wrote: > Hi Pathy, > > Pls check if following SQL fits ur need, > > > CRE

Re: Request-Response flow for real-time analytics

Most of the aggregates can be added/removed/updated dynamically, it would be easier from an implementation point of view, if we could use SQL. On Thu, 24 Aug 2023 at 16:09, Kenan Kılıçtepe wrote: > I think Datastream fits your requirements better. Is there a specific > reason for using SQL ? > >

How to use pipeline.jobvertex-parallelism-overrides property.

Hi, have someone used pipeline.jobvertex-parallelism-overrides [1] property? I wonder what actually should be a key here? Operator name? What if my operators are chained and I want to override only one of its elements. For example Source -> (Map1 chained with Map2) -> Sink. Can I override Map2 on