Hi,
Regarding CSV and AvroParquet stream formats doens't supporting splits, I
think some hints may be available from [1]. Personally, I think the main
consideration should be the question of how the row format can find a
reasonable split point, and how many Splits are appropriate to slice a file
m
Hi,
Maybe you need to check what changed on the Kafka side at that time.
Best,
Ron
Kenan Kılıçtepe 于2023年8月20日周日 08:51写道：
> Hi,
>
> I have 4 task manager working on 4 servers.
> They all crush at the same time without any useful error logs.
> Only log I can see is some disconnection from Kafka
Hi,
Nothing interesting on Kafka side.Just sone partition delete/create logs.
Also I can't understand why all task managers stop at the same time without
any error log.
Thanks
Kenan
On Sun, Aug 20, 2023 at 10:49 AM liu ron wrote:
> Hi,
>
> Maybe you need to check what changed on the Kafka si
Hello,
Thanks for your suggestion.
In JobManager, I've found things such like:
```
*2023-08-21 02:06:23,882 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator[] -
Triggering checkpoint 892 (type=Checkpoint
Hi,
We have encountered a state memory leak issue while working with the Flink CEP
(Complex Event Processing) in version 1.17. Based on code, it seems like the
issue is persistent across all versions of CEP library.
I've already raised a JIRA issue detailing the problem we've faced. You can
fi
Thanks Ron.
For HDFS, a reasonable level of parallelism is reading multiple blocks in
parallel. Ofcourse that could mean losing the ordering that a file usually
guarantees. Now if I understand correctly, this may become a problem in
watermarking. But with smaller files having bounded high water
Hi,
I seems that the node `tef-prod-flink-04/10.11.0.51:37505 [
tef-prod-flink-04:38835-e3ca4d ]` exits unexpected, you can check whether
there are some errors in the log of TM or K8S
Best,
Shammon FY
On Sun, Aug 20, 2023 at 5:42 PM Kenan Kılıçtepe
wrote:
> Hi,
>
> Nothing interesting on Kafk
