Re: Error while trigger checkpoint due to Kyro Exception

2018-08-19 Thread Stefan Richter
Hi, this problem is fixed in Flink >= 1.4.3, see https://issues.apache.org/jira/browse/FLINK-8836 . Best, Stefan > Am 18.08.2018 um 05:07 schrieb Bruce Qiu : > > Hi Community, > I am using Flink 1.4.2 to do streaming processing. I fetch data f

Error while trigger checkpoint due to Kyro Exception

2018-08-17 Thread Bruce Qiu
Hi Community, I am using Flink 1.4.2 to do streaming processing. I fetch data from Kafka and write the parquet file to HDFS. In the previous environment, the Kafka had 192 partitions and I set the source parallelism to 192, the application works fine. But recently we had increased the Kafka par