In the Flink client node, you also need to have YARN configuration files
which tells where's YARN.
> Flink doc: the Client requires the YARN_CONF_DIR or HADOOP_CONF_DIR
environment variable to be set to read the YARN and HDFS configuration.
On Sat, Jan 20, 2018 at 3:54 AM, Kien Truong
wrote:
>
There have been a couple of instances where one of our TMs was quarantined
( the cause is irrelevant to this discussion ). And we had to bounce the
TM to bring back sanity to the cluster. There have been discussions around
and am trying to distill them. My questions are
* Based on https://issu
Hi,
Any suggestions would really help. Thanks.
On Mon, Jan 15, 2018 at 12:07 AM, Navneeth Krishnan <
reachnavnee...@gmail.com> wrote:
> Hi All,
>
> Has anyone tried scaling out flink cluster on EMR based on CPU usage/
> kafka lag/ back pressure monitoring? If so can you provide some insights on
Hi,
I am having few issues with event time windowing. Here is my scenario, data
is ingested from a kafka consumer and then keyed by user followed by a
Tumbling event window for 10 seconds. The max lag tolerance limit is 1
second.
I have the BoundedOutOfOrdernessGenerator that extends
AssignerWith
Have tested against the 1.5 SNAPShot ( I simply pulled the source code
into my distribution and compiled it into my job jar ). Both the test code
and the cluster seems to work ok. Have not tested the "savepoint and
resume" mode but restore from checkpoint works. I brought the JM down and
restarte
