What is "Processed (persisted) in-flight data"

2021-01-30 Thread Rex Fenley
Hello, In the latest version I now see two byte measures on checkpoints. There's *Checkpointed Data Size* *9.05 GB* Which I'm assuming means 9.05 GB were written in this incremental checkpoint. But now there is also *Processed (persisted) in-flight data* *152 MB (0 B)* What is that? Thanks! --

Newbie question: Machine Learning Library of Apache Flink

2021-01-30 Thread Bilinmek Istemiyor
Hello I am a complete newbie and I need help. I am evaluating the usage of flink for my academic study and reading the documentation. I have a bit of experience in Apache Spark. I am asking this question, based on my experience in Apache Spark. In spark, there is a machine learning library embed

RE: Flink 1.11 job hit error "Job leader lost leadership" or "ResourceManager leader changed to new address null"

2021-01-30 Thread Colletta, Edward
“but I'm not aware of any similar issue reported since the upgrading” For the record, we experienced this same error on Flink 1.11.2 this past week. From: Xintong Song Sent: Friday, January 29, 2021 7:34 PM To: user Subject: Re: Flink 1.11 job hit error "Job leader lost leadership" or "Resource

Re: Flink SQL and checkpoints and savepoints

2021-01-30 Thread Maximilian Michels
It is true that there are no strict upgrade guarantees. However, looking at the code, it appears RowSerializer supports adding new fields to Row - as long as no fields are modified or deleted. Haven't tried this out but it looks like the code would only restore existing fields and incorporate

Flink Scala UDF Register fail:java.lang.ClassNotFoundException

2021-01-30 Thread Appleyuchi
Hi All, I posted a question here: https://stackoverflow.com/questions/65965893/scala-udf-complainsjava-lang-classnotfoundexceptionin-flink-sql-client It's about scala udf to be registered into flink sql client. Could you help me? Thanks~!