GroupOffsetReset functionality

Hi , Currently I am using flink 1.13 . To configure kafka consumers start position i am using setStartFromGroupOffsets() method of FlinkKafkaConsumer. if Group offset is set, it should read committed, but if they are not found then how will it work ? Any help would be appreciated. Thanks.

Flink on Native Kubernetes S3 checkpointing error

Hi, I am using flink 1.13.1 to use checkpointing(RocksDB) on s3 with native kubernetes. Passing in this parameter to job - *-Dfs.s3a.aws.credentials.provider=com.amazonaws.auth.WebIdentityTokenCredentialsProvider* I am getting this error in job-manager logs - *Caused by: com.amazonaws.AmazonClie

Re: Flink S3 Presto Checkpointing Permission Forbidden

Hi Dennis, Were you able to use checkpointing on s3 with native kubernetes. I am using flink 1.13.1 and did tried your solution of passing the webidentitytokencredentialsprovider. *-Dfs.s3a.aws.credentials.provider=com.amazonaws.auth.WebIdentityTokenCredentialsProvider* I am getting this error in

Re: Deserialize generic kafka json message in pyflink. Single kafka topic, multiple message schemas (debezium).

Hi Kamil, Actually FlinkKafkaConsumer expects a DeserializationSchema instead of JsonRowDeserialization and so I guess you could try SimpleStringSchema. Regards, Dian On Sat, Nov 20, 2021 at 5:55 AM Kamil ty wrote: > Hello all, > > I'm working on a pyflink job that's supposed to consume json m