[Flink K8s Operator] flinkdep stays in DEPLOYED and never turns STABLE

2022-12-06 Thread Paul Lam
Hi all, I’m trying out Flink K8s operator 1.2 with K8s 1.25 and Flink 1.15. I found kubectl shows that flinkdeployments stay in DEPLOYED like forever (the Flink job status are RUNNING), but the operator logs shows that the flinkdeployments already turned into STABLE. Is that a known bug or

[ANNOUNCE] Apache flink-connector-cassandra 3.0.0 released

2022-12-06 Thread Chesnay Schepler
|The Apache Flink community is very happy to announce the release of Apache flink-connector-cassandra 3.0.0. | |Apache Flink® is an open-source stream processing framework ||for| |distributed, high-performing, always-available, and accurate data streaming applications.| |The release is availabl

Re: [Flink K8s Operator] flinkdep stays in DEPLOYED and never turns STABLE

2022-12-06 Thread Gyula Fóra
Hi! The stable state is not marked in the reconciliation state field but instead using the last stable spec field. Deployed simply means that something is running :) The structure of the status is a bit complex to avoid too much redundancy and limit the size and is mostly considered to be interna

Re: [Flink K8s Operator] flinkdep stays in DEPLOYED and never turns STABLE

2022-12-06 Thread Paul Lam
Thanks a lot for your input, Gyula! Best, Paul Lam > 2022年12月6日 18:38,Gyula Fóra 写道: > > Hi! > > The stable state is not marked in the reconciliation state field but instead > using the last stable spec field. Deployed simply means that something is > running :) > > The structure of the sta

Re: Cleanup for high-availability.storageDir

2022-12-06 Thread Alexis Sarda-Espinosa
One concrete question, under the HA folder I also see these sample entries: - job_name/blob/job_uuid/blob_... - job_name/submittedJobGraphX - job_name/submittedJobGraphY Is it safe to clean these up when the job is in a healthy state? Regards, Alexis. Am Mo., 5. Dez. 2022 um 20:09 Uhr schrieb A

ZLIB Vulnerability Exposure in Flink statebackend RocksDB

2022-12-06 Thread Vidya Sagar Mula
Hi, There is a ZLIB vulnerability reported by the official National Vulnerability Database. This vulnerability causes memory corruption while deflating with ZLIB version less than 1.2.12. Here is the link for details... https://nvd.nist.gov/vuln/detail/cve-2018-25032#vulnCurrentDescriptionTitle

Registering serializer for RowData

2022-12-06 Thread Ken Krugler
Hi there, I’m using the Hudi sink to write data, in bulk insert mode, and running into an issue where Hudi is unhappy because (I think) Flink is using the Kryo serializer for RowData records, instead of something that extends AbstractRowDataSerializer. It’s this bit of (Hudi) code in SortOpera

Re: Registering serializer for RowData

2022-12-06 Thread yuxia
Hi, what's the type of the input for the SortOperator? I mean what's the TypeInformation? For example, PojoTypeInfo or RowTypeInfo? Best regards, Yuxia 发件人: "Ken Krugler" 收件人: "User" 发送时间: 星期三, 2022年 12 月 07日 上午 9:11:17 主题: Registering serializer for RowData Hi there, I’m using the