Re: Flink job manager conditional start of flink jobs

Hi The job in ns2 has the permission to stop the job in ns1? How about managing the relationship in your `Job Submission Service` if it exists. The service can check and stop the job in ns1 before it submitting the job to ns2, what do you think? Best, Shammon FY On Thu, Apr 13, 2023 at 10:50 AM

Re: Flink job manager conditional start of flink jobs

Hi, Thanks for your reply. It is slightly different, would be happy to have any suggestion for the scenario you mentioned. My scenario: I have 2 namespaces say ns1,ns2. I have to make sure only one of ns1 or ns2 should run my flink jobs. Say initially ns1 is running flink jobs, later planned to mo

Re: Table API function and expression vs SQL

Hi, Flink SQL follows the standard SQL, so I think SQL syntax will be richer and richer in higher versions, it will not be changed. Best, Ron liu ron 于2023年4月13日周四 10:24写道： > Hi, > Flink SQL follows the standard SQL, so I think SQL syntax will be richer > and richer in higher versions, it will

Re: Table API function and expression vs SQL

Hi Currently, Calcite supports standard SQL, so I think the main SQL syntax will remain unchanged or backward compatible even when Flink upgrades its calcite version. You can refer to it. Best, Shammon FY On Tue, Apr 11, 2023 at 12:00 PM ravi_suryavanshi.yahoo.com via user < user@flink.apache.o

Re: Requirements for POJO serialization

Hi Alexis Flink will recognize the POJO class and use PojoTypeInfo to serialize and deserialize it. For specific constraints on POJO classes, please refer to [1]. Users can also define serialization methods for their own classes, as you mentioned in the email [1] https://github.com/apache/flink

Re: Flink job manager conditional start of flink jobs

Hi naga Could you provide a specific description of your scene? It sounds like your requirement requires a uniqueness check to ensure that there are no multiple identical jobs running simultaneously, right? Best, Shammon FY On Wed, Apr 12, 2023 at 4:08 PM naga sudhakar wrote: > Thanks for your

Re: emitValueWithRetract issue

hi Adam As far as I know, there is currently no similar API available, but I believe that this feature was accidentally removed and we should add it back. I have created a Jira to track the progress of this feature. https://issues.apache.org/jira/browse/FLINK-31788 On Tue, Apr 11, 2023 at 12:10

Re: Flink Job across Data Centers

Hi, I asked a similar question in this thread , which might have some relevant info. On Wed, Apr 12, 2023 at 7:23 AM Chirag Dewan via user wrote: > Hi, > > Can anyone share any experience on running Flink jobs across data centers?

Flink Job across Data Centers

Hi, Can anyone share any experience on running Flink jobs across data centers? I am trying to create a Multi site/Geo Replicated Kafka cluster. I want that my Flink job to be closely colocated with my Kafka multi site cluster. If the Flink job is bound to a single data center, I believe we will o

Re: Task Failure Strategy for Adaptive Scheduler

Hi Talat, For most streaming pipelines, we have to restart the whole pipeline no matter the scheduler used because they're a single pipelined region. One limitation of AdaptiveScheduler is the lack of support for local recovery. This will be addressed in Flink 1.18 [1]. [1] https://issues.apache.

Re: Flink job manager conditional start of flink jobs

Thanks for your email. I am looking more in terms of running these flinkk jobs in multi names pace environment and make sure only one namespace flink jobs are running. So on the Job manager when i try to start a flink job, it has to check if it's allowed to run in this namespace or not and acco