Multiple (non-consecutive) keyBy operators in a dataflow

2018-04-02 Thread au.fp2018
Hello Flink Community, I am relatively new to Flink. In the project I am currently working on I've a dataflow with a keyBy() operator, which I want to convert to dataflow with multiple keyBy() operators like this: Source --> KeyBy() --> Stateful process() function that generates a more gra

Re: Multiple (non-consecutive) keyBy operators in a dataflow

2018-04-03 Thread au.fp2018
336050.n4.nabble.com/Slow-flink-checkpoint-td18946.html >> >> LiYue >> http://tig.jd.com >> > liyue2008@ >> >> >> >>> 在 2018年4月3日,上午8:30,au.fp2018 < > au.fp2018@ > > >> <mailto: > au.fp2018@ > >>

Standalone HA Cluster using Shared Zookeeper

2018-05-06 Thread au.fp2018
Hello All, I am planning on setting up a Standalone HA Cluster using the same Zookeeper cluster I've that is managing a Kafka Cluster. The Zookeeper cluster for Kafka has a /kafka chroot specified and for flink the chroot would be /flink (so they are isolated). Are there any downsides to this app

Re: Standalone HA Cluster using Shared Zookeeper

2018-05-07 Thread au.fp2018
ing just one cluster, you could in principle keep the > default. > However, I'd change the configuration just in case. > Otherwise, you might get into trouble when you (accidentally) run another > Flink setup. > > Best, Fabian > > 2018-05-07 2:57 GMT+02:00 au.fp2018

Taskmanager with multiple slots vs running multiple taskmanagers with 1 slot each

2018-05-07 Thread au.fp2018
Hi All, As the subject indicates, what is the general consensus and best practices around running 1 taskmanger with multiple slots vs running multiple taskmanager each with 1 slot? What is your reason for you picking one over the other? Thanks, Andre -- Sent from: http://apache-flink-user-ma