Kafka and parallelism

2018-02-03 Thread Christophe Jolif
Hi, If I'm sourcing from a KafkaConsumer do I have to explicitly set the Flink job parallelism to the number of partions or will it adjust automatically accordingly? In other word if I don't call setParallelism will get 1 or the number of partitions? The reason I'm asking is that I'm listening to

Re: RocksDB / checkpoint questions

2018-02-03 Thread Christophe Jolif
Thanks for sharing Kien. Sounds like the logical behavior but good to hear it is confirmed by your experience. -- Christophe On Sat, Feb 3, 2018 at 7:25 AM, Kien Truong wrote: > > > Sent from TypeApp > On Feb 3, 2018, at 10:48, Kien Truong wrote: >> >> Hi, >>

RE: Multiple Elasticsearch sinks not working in Flink

2018-02-03 Thread Teena Kappen // BPRISE
Hi Fabian, We tried the fix that was merged and the sinks are working correctly now. Thank you for resolving the issue. Regards, Teena From: Teena Kappen // BPRISE Sent: 01 February 2018 19:12 To: Fabian Hueske ; Stephan Ewen Cc: Timo Walther ; user@flink.apache.org Subject: RE: Multiple Elast