Re: KafkaSource metrics

Use below respectively flink_taskmanager_job_task_operator_KafkaConsumer_bytes_consumed_rate - Consumer rate flink_taskmanager_job_task_operator_KafkaConsumer_records_lag_max - Consumer lag flink_taskmanager_job_task_operator_KafkaConsumer_commit_latency_max - commit latency unsure if reactive mo

Re: Using Kafka as bounded source with DataStream API in batch mode (Flink 1.12)

Interesting use case. Can you please elaborate more on this. On what criteria do you want to batch? Time? Count? Or Size? On Thu, 14 Jan 2021 at 12:15 PM, sagar wrote: > Hi Team, > > I am getting the following error while running DataStream API in with > batch mode with kafka source. > I am usi

Re: Is Apache Flink suitable for an application where messages are routed to different services

Hi Thamidu, I have been working on flink for the past few months, below is some analysis based on your use case. Few questions 1. What is the volume of data in the context? 2. What is the TPS that you are looking for? 3. Is it fine if the same message gets forwarded to 3rd party service multiple

Re: How to use Flink IDE

Hi Piper, Welcome to Flink Community. Import flink project like any other project into IDE, only difference while running is you have click on "Include dependencies with "Provided" scope" in the main class run configurations. This bundles the Flink dependencies in the artifact, making it a fat j