Query regarding Kafka Source and Kafka Sink in 1.14.3

2022-01-23 Thread Mahima Agarwal
Hi Team, I am trying to set the following properties in Kafka Source API in flink 1.14.3 version. -> client.id.prefix -> partition.discovery.interval.ms But I am getting the below mentioned warning in taskmanager logs: 1. WARN org.apache.kafka.clients.consumer.ConsumerConfig [] - Th

Re: Question about MapState size

2022-01-23 Thread Yun Tang
Hi Abdul, What does "only count pertaining to the specific key of partition" mean? The counting size is for the map related to a specific selected key or the all the maps in the whole map state? You can leverage RocksDB's native metrics to monitor the rocksDB usage, such as total-sst-files-siz

Re: Apache Flink - Can AllWindowedStream be parallel ?

2022-01-23 Thread Yun Tang
Hi Singh, All the output operator transformed by AllWindowedStream would be SingleOutputStreamOperator, which cannot be parallel. [1] https://github.com/apache/flink/blob/master/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/AllWindowedStream.scala Best Yun Tang ___

Re: Flink Kinesis connector - EFO connection error with http proxy settings

2022-01-23 Thread Gnanamoorthy, Saravanan
Hi Danny, I should be able to make the contribution to add proxy support. Please let me know the contribution process. Thanks -Saravan From: Danny Cranmer Date: Wednesday, January 19, 2022 at 3:10 AM To: Gnanamoorthy, Saravanan Cc: user@flink.apache.org Subject: Re: Flink Kinesis connector -

Show plan in UI not working.

2022-01-23 Thread John Smith
Just I'm case but in 1.14.x regardless of the job manager is leader or not. Before submitting a job of you click on "Show Plan" it just shows a blank window. I'm assuming it's similar issue as the deserialozation ones.