Checkpoints for kafka source sometimes get 55 GB size (instead of 2 MB) and flink job fails during restoring from such checkpoint

2020-04-14 Thread Oleg Vysotsky
pretty much all default flink kafka concumer setting. We only specified: CommonClientConfigs.BOOTSTRAP_SERVERS_CONFIG, ConsumerConfig.GROUP_ID_CONFIG, CommonClientConfigs.SECURITY_PROTOCOL_CONFIG Thanks a lot in advance! Oleg

Aggregation for last n seconds for each event

2020-02-11 Thread oleg
be expressed either in time or in events count, not "last n seconds for each single event". Is there an idiomatic way to do this? Any examples or help are appreciated. Thanks in advance. Best regards, Oleg Bonar