Hi all,
when running a Flink batch job, from time to time a TaskManager dies
randomly, which makes the full job failing. All other nodes then throw
the following exception:
Error obtaining the sorted input: Thread 'SortMerger Reading Thread'
terminated due to an exception: Connection unexpectedly
Hi all,
I trying to run a Flink job on YARN via "$/bin/flink run -m yarn-cluster
-yn 2 ..." with two nodes. But only one JobManager seems to be connected.
Flinks hangs at this stage (look up message repeats every second):
017-01-11 15:12:13,653 DEBUG org.apache.flink.yarn.YarnClusterClient
Hi all,
does Flink currently support the integration into a Apache Oozie (
https://oozie.apache.org/ ) workflow? Is there a Flink custom action for
that? If not what would be the best approach to do that? Use a shell
action and execute the Flink binary?
Best regards,
Malte
Hi folks,
I tried to get the FlinkML SVM running - but it didn't really work. The
SVM.fit() method requires a DataSet parameter but there is no
such class/interface in Flink Java. Or am I mixing something up with
Scala? Also, I couldn't find a Flink ML example for Java (there is only
Scala).
Is
Hi Flavio,
you also can put each job in a single class and use the c parameter to
execute jobs separately:
/bin/flink run c com.myflinkjobs.JobA /path/to/jar/multiplejobs.jar
/bin/flink run c com.myflinkjobs.JobB /path/to/jar/multiplejobs.jar
Cheers
Malte
Von: Robert Metzger
Antworten an
Hi everyone,
I read that Flink is supposed to automatically optimize the degree of
parallelism. But I never saw any change of parallelism in the web interface
without defining dop manually (-p parameter).
Is there any of this optimization actually happening? Or how can I switch it
on?
Cheers
Ma
Hello,
is it possible to use some how Tuple objects (e.g. Tuple2)
in a ListValue? Even if Tuple is serializable, it does not implement the
Value interface. Therefore ListValue is it working.
Is there any work-around? I want to use something like "Tuple2>>³ as dataset.
Cheers
Malte
