Hi Neha,
I noticed that the `Checkpointed Data Size` is always equals to `Full
Checkpoint Data Size`, I think the job is using full checkpoint instead of
incremental checkpoint, you can check it
Best,
Shammon FY
On Mon, Jul 17, 2023 at 10:25 AM Neha . wrote:
> Hello Shammon,
>
> Thank you for
Thanks a lot @yuxia for your time. We will
try to back port https://issues.apache.org/jira/browse/FLINK-27450 and see
if that works. Also will keep watching for your fix for the Default Dialect
fix.
Regards
Ram
On Mon, Jul 17, 2023 at 8:08 AM yuxia wrote:
> Hi, Ram.
> Thanks for reaching out.
Hi, Ram.
Thanks for reaching out.
1:
About Hive dialect issue, may be you're using JDK11?
There's a known issue in FLINK-27450[1]. The main reason that Hive dosen't
fully support JDK11. More specific to your case, it has been tracked in
HIVE-21584[2].
Flink has upgrade the Hive 2.x version t
Hello Shammon,
Thank you for your assistance.
I have already enabled the incremental checkpointing, Attaching the
screenshot. Can you please elaborate on what makes you think it is not
enabled, It might hint towards the issue. The problem is checkpoint size is
not going down and keeps on increasin
Hi Xiaolong,
When a streaming job is submitted via Sql-Gateway, its lifecycle is no
longer related to Sql Gateway.
Returning to the issue of job recovery, I think if your job cluster is
configured with HA, jobmanager will recover running streaming jobs from
their checkpoints after a failover occu
Unsubscribe --
>
Hi Eugenio,
I cannot catch it clearly, could you describe it in more detail?
Best,
Shammon FY
On Sat, Jul 15, 2023 at 5:14 PM Eugenio Marotti <
ing.eugenio.maro...@gmail.com> wrote:
> Hi everyone,
>
> is there a way to set Flink processing time in the past?
>
> Thanks
> Eugenio
>
Hi Neha,
I think it is normal for the data size of a savepoint to be smaller than
the full data of a checkpoint. Flink uses rocksdb to store checkpointed
data, which is an LSM structured storage where the same key will have
multiple version records, while savepoint will traverse all keys and store
