Re: Multiple Kafka Source for a Data Pipeline

able to register JMX metrics. There are several > bugs reported about this, but I believe it should be fixed for consumers in > the newer Flink versions (1.14+). > > On Wed, Jul 5, 2023 at 9:32 PM Yogesh Rao wrote: > >> Hi, >> >> Wanted to know if multiple kafka

Multiple Kafka Source for a Data Pipeline

Hi, Wanted to know if multiple kafka sources are supported in a data pipeline within flink. I am looking at a scenario where data transformation and enrichment needs to be done when a message from both the sources is received based on a common identifier. I coded the logic and it looks to be wor

Building Dynamic SQL using contents of Map datastructure

Hi, Is there a way we can build a dynamic SQL in Flink from contents of Map ? Essentially trying to do achieve something like below StringBuilder builder = new StringBuilder("INSERT INTO sampleSink SELECT "); builder.append("getColumnsFromMap(dataMap), "); builder.append(" FROM Data").toString

Flink Stream processing with Dynamic Conditional Sinks

Hello, I am trying out flink for one stream processing scenario and was wondering if it can be achieved using Apache Flink. So any pointers regarding how it can be achieved will be of great help. Scenario :- A kafka topic has the input for stream processing, multiple applications lets say A & B