Re: KakfaConsumer

Hi Vishal, Flink does checkpoint to Kafka(Offset commits) by default which could be disabled. Look here for more information. Regards, Nagarjun *Success is

Re: K8s and flink1.7.1

For 1. you need to setup high-availability.jobmanager.port as a predefined port in your flink-conf.yaml and expose the port via job-manager-deployment and job-manager-service resources as well. That should do the trick. For 2. I am not sure of the timelines, but there are a few decent/not hacky wo

Re: error while joining two datastream

Looks like you need to assign time stamps and emit watermarks to both the streams viz. formatStream1 and formatStream2 as described at https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/event_timestamp_extractors.html On Thu, Nov 22, 2018 at 10:55 PM Abhijeet Kumar wrote: > Hello Te

Re: backpressure metrics

Hi Steven, The metric 'Buffered During Alignment' you are talking about will always be zero when the job is run in ATLEAST_ONCE mode. Is that the case with your job? My understanding is, backpressure can only be monitored by sampling thread stacktraces and interpreting the situation based on the c