As shown in
https://ci.apache.org/projects/flink/flink-docs-master/dev/scala_api_extensions.html
,we can use scala partitial function by
import org.apache.flink.streaming.api.scala.extensions._
and replace .map by .mapWith. but the signature of def mapWith[R:
TypeInformation](fun: T => R): DataSt
I've just read the article
https://flink.apache.org/news/2015/05/11/Juggling-with-Bits-and-Bytes.html,
It seems that the MemorySegment mainly used for sort and join for batch
execute. But I mainly use Flink for streaming work, I do a lot of
map/flatMap and reduce in Flink. Is the MemorySegment stil
The zookeeper related logs are loged by user codes,I finally find the reason
why the taskmanger was lost,that was I gave the taskmanager a big amount of
memory, the jobmanager identify the taskmanager is down during the
taskmanager in Full GC.Thanks for your help.
--
View this message in context
some additional logs I found in jobManager.
2016-11-25 07:19:57,958 WARN akka.remote.RemoteWatcher
- Detected unreachable: [akka.tcp://flink@10.17.123.56:59247]
2016-11-25 07:19:57,962 INFO org.apache.flink.runtime.jobmanager.JobManager
- Task
I use the newest snapshot of Flink, all jobs failed since a TaskManager was
lost/killed.There is a sample of jobmanager and taskmanager logs
//job manager
java.lang.Exception: TaskManager was lost/killed:
ResourceID{resourceId='8f4b98897b1cbdbb576cbf298ac1339f'} @ 10.17.123.56
(dataPort=626
It seems that this config variant only effect local cluster and stand alone
cluster,not effect yarn.
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-set-a-custom-JAVA-HOME-when-run-flink-on-YARN-tp8676p8709.html
Sent from the Apache Fl
I think I solved myself,just add -yD yarn.taskmanager.env.JAVA_HOME=xx in
the command line, a little hard to find the solution though.
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-set-a-custom-JAVA-HOME-when-run-flink-on-YARN-tp867
Hi,all:
The YARN cluster of my company is default to use Java 7,and I want to use
java 8 form my Flink application, whant can I do to achieve it?
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-set-a-custom-JAVA-HOME-when-run-flink-o
