Re: How to resume a job from checkpoint with the SQL gateway.

2023-07-18 Thread Xiaolong Wang
Thank you for the information. That solution works for me ! On Tue, Jul 18, 2023 at 3:00 PM Shammon FY wrote: > Hi Xiaolong, > > For new versions such as flink-1.17, flink sql-gateway supports job > management and user can stop/start jobs with savepoint. You can start a job > with a given savep

Flink 1.15.1 issue we need help on

2023-07-18 Thread Tucker Harvey via user
Hi, we are trying to determine how fix the following exception. This is an issue that is repeatedly happening for us. We have tried looking online for some solutions. One thread suggested setting idleTimeout but this doesn’t seem supported in Flink Source code. https://github.com/netty/netty/

Keying a data stream by tenant and performing ML on each sub-stream - help

2023-07-18 Thread Catalin Stavaru
Hello everyone, Here is my use case: I have an event data stream which I need to key by a certain field (tenant id) and then for each tenant's events I need to independently perform ML clustering using FlinkML's OnlineKMeans component. I am using Java. I tried different approaches but none of the

Re: Checkpoint size smaller than Savepoint size

2023-07-18 Thread Neha . via user
Hi Shammon, These configs exist in Flink WebUI. We have set exeEnv.setStreamTimeCharacteristic(TimeCharacteristic.IngestionTime); Do you think it can create some issues for the HOP(proctime, some interval, some interval) and not releasing the state for checkpoints? I am really confused about why s

Re: How to resume a job from checkpoint with the SQL gateway.

2023-07-18 Thread Shammon FY
Hi Xiaolong, For new versions such as flink-1.17, flink sql-gateway supports job management and user can stop/start jobs with savepoint. You can start a job with a given savepoint path as [1] and stop a job with or without savepoint as [2]. [1] https://nightlies.apache.org/flink/flink-docs-master