Is group.id required in Kafka connector for offsets to be stored in checkpoint?

2019-02-16 Thread David Corley
We've got a relatively simply job that reads in from Kafka, and writes to S3. We've had a couple of job failures where the consumer lag had built up, but after the restart, the lag was wiped out because our offset positions were lost and we consumed from latest offset. The job has checkpointing en

Re: [ANNOUNCE] New Flink PMC member Thomas Weise

2019-02-16 Thread Thomas Weise
Thanks everyone! It is exciting to be part of such an enthusiastic community that works on great tech. Looking forward to continue to help on the journey! Thomas On Tue, Feb 12, 2019 at 6:13 PM Kurt Young wrote: > Congrats Thomas! > > Best, > Kurt > > > On Wed, Feb 13, 2019 at 10:02 AM Shaoxu