Re: Should multiple apache flink task managers have strong identity? Also, should I point their state.checkpoints.dir to the same HDFS?

2018-01-24 Thread Felipe Cavalcanti
> taskmanagers. All members of the cluster need to be able to see all the > data, and Flink ensures that things are written to the correct subpath. > > -- > Patrick Lucas > > On Mon, Jan 22, 2018 at 7:23 PM, Felipe Cavalcanti > wrote: >> >> Hi, >> >>

Should multiple apache flink task managers have strong identity? Also, should I point their state.checkpoints.dir to the same HDFS?

2018-01-22 Thread Felipe Cavalcanti
Hi, I'm deploying flink to kubernetes and I've some doubts... First one is if the task managers should have strong identity (in which case I will use statefulsets for deploying them). Second one is if I should point rocksdb state.checkpoint.dir in all task managers to the same HDFS path or if eac