Hi!
I have been searching a lot but I didn't found a solution for this.
Lets supose some of the steps on the streaming process must be executed
in just a subset of the available nodes/taskmanagers, while the rest of
the tasks are free to be computed anywhere.
**¿How can I assign a DataStream to
Dear all,
I have some questions regarding testing in Flink. The more general question is:
is there any guideline, template, or best practices that we can follow if we
want to test our flink code (more in scala)?
I know there is this page:
https://ci.apache.org/projects/flink/flink-docs-release
Thank you Fabian.
It is clear to me now. Thanks a lot for your help.
Regards,
Averell
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Hi Chang,
There are some harness tests which can be used to test your function. It is
also a common way to test function or operator in flink internal tests.
Currently, the harness classes mainly include:
- KeyedOneInputStreamOperatorTestHarness
- KeyedTwoInputStreamOperatorTestHarness
-
Hi Chang,
Regarding the return value type, Scala allows the method to not specify the
return value type, it can be inferred by the compiler, if you specify a
non-Unit type compiler will report an error, if you do not specify an
explicit type, the result of the method may be an error, test pass or
Hi Rafael,
For Standalone clusters, it seems that Flink does not provide such a
feature.
In general, at the execution level, we don't talk about DataStream, but we
talk about Job.
If your Flink is running on YARN, you can use YARN's Node Label feature to
assign a Label to some Nodes.
Earlier this
Hi all,
We are trying to build our flink cluster on k8s, but there seems to be not
enough materials about details.
Firstly, we learned how to build a standalone cluster on k8s and run all the
jobs inside it.
The question is like are we building a cluster for all the jobs or one job per
clust
Hi,
My key extraction logic requires a conversion from string to UUID. I want
to skip the event in case of exception. Is it doable?
Hi mingliang,
Yes, you are right, the information that Flink on Kubernetes' current
documentation can provide is not very detailed.
However, considering that Kubernetes is so popular, the Flink community is
currently refining it, this work is mainly done by Till, and you can follow
this issue [1]
