Re: Flink KafkaSource still referencing deleted topic

2022-10-12 Thread Hang Ruan
Hi, Robert, The configuration allowNonRestoredState should be used like this: ./bin/flink run --detached --allowNonRestoredState Best, Hang Robert Cullen 于2022年10月12日周三 23:13写道: > I don't see AllowNonRestoredState in the configuration documentation. How > would it be passed to a job? On the c

Re: Flink KafkaSource still referencing deleted topic

2022-10-12 Thread Robert Cullen
I don't see AllowNonRestoredState in the configuration documentation. How would it be passed to a job? On the command line like this: ./bin/flink run --detached -Dallownonrestoredstate=true ... On Tue, Oct 4, 2022 at 4:52 PM Martijn Visser wrote: > Hi Mason, > > Definitely! Feel free to open a

Re: Flink KafkaSource still referencing deleted topic

2022-10-04 Thread Martijn Visser
Hi Mason, Definitely! Feel free to open a PR and ping me for a review. Cheers, Martijn On Tue, Oct 4, 2022 at 3:51 PM Mason Chen wrote: > Hi Martjin, > > I notice that this question comes up quite often. Would this be a good > addition to the KafkaSource documentation? I'd be happy to contribu

Re: Flink KafkaSource still referencing deleted topic

2022-10-04 Thread Mason Chen
Hi Martjin, I notice that this question comes up quite often. Would this be a good addition to the KafkaSource documentation? I'd be happy to contribute to the documentation. Best, Mason On Tue, Oct 4, 2022 at 11:23 AM Martijn Visser wrote: > Hi Robert, > > Based on > https://stackoverflow.com

Re: Flink KafkaSource still referencing deleted topic

2022-10-04 Thread Martijn Visser
Hi Robert, Based on https://stackoverflow.com/questions/72870074/apache-flink-restoring-state-from-checkpoint-with-changes-kafka-topic I think you'll need to change the UID for your KafkaSource and restart your job with allowNonRestoredState enabled. Best regards, Martijn On Tue, Oct 4, 2022 at

Flink KafkaSource still referencing deleted topic

2022-10-04 Thread Robert Cullen
We've changed the KafkaSource to ingest from a new topic but the old name is still being referenced: 2022-10-04 07:03:41org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: Grokfailures' (operator feca28aff5a3958840bee985ee7de4d3).at org.apache.fli