Flink on YARN

Hi, I have a YARN cluster(containing no Flink installation) that I want to run Flink application on that. I was wondering if it is needed to install Flink on every node of YARN cluster or not it suffices to install Flink on edge node (the node that I want to submit a job to remote YARN cluster)?

Re: Forcing consuming one stream completely prior to another starting

Hi Ron, I’m joining two streams - one is a “decoration” stream that we have in a > compacted Kafka topic, produced using a view on a MySQL table AND using > Kafka Connect; the other is the “event data” we want to decorate, coming in > over time via Kafka. These streams are keyed the same way - via

Re: Flink on YARN

Hi, You only need to install Flink on the node where you want to perform job submission. Regards, Kien On 1/20/2018 3:23 PM, Soheil Pourbafrani wrote: Hi, I have a YARN cluster(containing no Flink installation) that I want to run Flink application on that. I was wondering if it is needed

Re: Task Manager detached under load

Hi, You should enable and check your garbage collection log. We've encountered case where Task Manager disassociated due to long GC pause. Regards, Kien On 1/20/2018 1:27 AM, ashish pok wrote: Hi All, We have hit some load related issues and was wondering if any one has some suggestions

Network memory segments

Hi, We recently upgraded from flink 1.3 to 1.4 and in the task manager UI it shows there are 0 memory segments whereas in 1.3 I think it was default 32k. I have even tried adding the below config but still it shows 0. taskmanager.network.numberOfBuffers: 2048 [image: Inline image 1] Regards, Na

Timer & Window Memory Consumption

Hi, I'm facing issues with frequent young generation garbage collections in my task manager which happens approximately every few seconds. I have 3 task managers with 12GB heap allocated on each and I have set the config to use G1GC. My program ingests binary data from kafka source and the message

Unsubscribe

-- Narendra Joshi