Re: standalone mode support in the kubernetes operator (FLIP-25)

I think the standalone mode support is expected to be done in the version 1.2.0[1], which will be released on Oct 1 (ETA). [1]. https://cwiki.apache.org/confluence/display/FLINK/Release+Schedule+and+Planning Best, Yang Javier Vegas 于2022年7月14日周四 06:25写道： > Hello! The operator docs > https://n

Re: Flink running same task on different Task Manager

Hi Great, -> Is there a way to set the restart strategy so that only tasks in the same slot group will restart during failure? No. On task failover, all tasks in the same region will be restarted at the same time (to ensure the data consistency). You can get more details about failover strategy i

standalone mode support in the kubernetes operator (FLIP-25)

Hello! The operator docs https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/concepts/overview/ say "The Operator does not support Standalone Kubernetes deployme

Re: Unit test have Error "could not find implicit value for evidence parameter"

Hi, you don't have to do that. Next time you can try "Invalidate Caches..." under the File menu in Intellij Idea. Best regards, Jing On Wed, Jul 13, 2022 at 7:21 PM Min Tu via user wrote: > Thanks a lot !! I have removed the .idea folder and the unit test works. > > On Mon, Jul 11, 2022 at 2:4

Re: Unit test have Error "could not find implicit value for evidence parameter"

Thanks a lot !! I have removed the .idea folder and the unit test works. On Mon, Jul 11, 2022 at 2:44 PM Alexander Fedulov wrote: > Hi Min Tu, > > try clean install to make sure the build starts from scratch. Refresh > maven modules in IntelliJ after the build. If that doesn't work, try > invali

Did the semantics of Kafka's earliest offset change with the new source API?

Hello, I have a job running with Flink 1.15.0 that consumes from Kafka with the new KafkaSource API, setting a group ID explicitly and specifying OffsetsInitializer.earliest() as a starting offset. Today I restarted the job ignoring both savepoint and checkpoint, and the consumer started reading f

RE: Unaligned checkpoint waiting in 'start delay' with AsyncDataStream

Thank you! Created issue: https://issues.apache.org/jira/browse/FLINK-28540

Re: Flink running same task on different Task Manager

thanks for helping with some inputs actually, I have created task1 and task2 in separate slot groups, thought it would be good if they run in independent slots. Also now facing some issues during restarts. whenever task1 has any exception entire job is restarting. Is there a way to set the restar

Re: Kubernetes Operator - Logging

Hi Daniel, Some additional info on the current approach we have in the operator: Manipulating plain property files was relatively easy from the Helm chart, hence we went down this route first. We could try to document at least an example for logback then see if we can improve the setup further.

Re: Kubernetes Operator - Logging

Hi Daniel, I believe it is possible to use logback for jobs submitted by flink kubernetes operator but I have not found an out-of-box solution either. I tried following steps: * Create custom flink image following https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/advanced

Kubernetes Operator - Logging

Hi, I have a job running in Kubernetes that I'm looking to migrate to the new Kubernetes Operator https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/operations/metrics-logging/. My question is about logging. My job currently uses logback, but reading through the documentat

Re: Unaligned checkpoint waiting in 'start delay' with AsyncDataStream

Ah OK I could reproduce the problem. Seems to be tied to the capacity of the async operator; if you half that the start delay is doubled. It looks like classic back-pressure delaying checkpoints, which kinda makes sense, if you ignore that unaligned checkpoints are enabled which are supposed t