How to set hdfs configuration in flink kubernetes operator?

Hi all, Recently, I have been testing the Flink Kubernetes Operator. In the official example, the checkpoint/savepoint path is configured with a file system: state.savepoints.dir: file:///flink-data/savepoints state.checkpoints.dir: file:///flink-data/checkpoints high-availability: org.apache.

Re: How to set hdfs configuration in flink kubernetes operator?

ct the namenode. My main question is how to load the hdfs-core.xml file in the Flink Kubernetes operator. If you know how to do that, please let me know. I hope to receive your response via email. Thank you! 发件人: Dongwoo Kim 发送时间: Wednesday, June 21, 2023 7:56:52

How to set hdfs configuration in flink kubernetes operator

Hi all, Recently, I have been testing the Flink Kubernetes Operator. In the official example, the checkpoint/savepoint path is configured with a file system: state.savepoints.dir: file:///flink-data/savepoints state.checkpoints.dir: file:///flink-data/checkpoints high-availability: org.apache

Socket timeout when report metrics to pushgateway

hello, we build flink report metrics to prometheus pushgateway, the program has been running for a period of time, with a amount of data reported to pushgateway, pushgateway response socket timeout exception, and much of metrics data reported failed. following is the exception: 2023-12-12 0

flink connector hive support collect metrics

Dear all, I am using the flink-connector-hive to sync records into hive table. However, the sink conector doesn't collect operator running metrics like numRecordsIn. so I couldn't collect these data. Is there a way to support the flink-connector-hive to collect flink metrics? Or is there some m

Re: Skip Restore Incompatibility of Key Serializer for Savepoint

insights would be of great help to me in resolving this issue. Thank you very much in advance. Best regards，Leilinee 获取 Outlook for iOS<https://aka.ms/o0ukef> 发件人: Gabor Somogyi 发送时间: Saturday, February 8, 2025 4:58:48 PM 收件人: 李 琳 抄送: user@flink.apache

Skip Restore Incompatibility of Key Serializer for Savepoint

Dear All, In a Flink job using statementSet, I have two DMLs for index calculation. I made a modification to one of the DMLs, changing the group keys from "distinct_id, $city, $province, window_start, window_end" to "distinct_id, window_start, window_end". When attempting to restore the job fro

回复: Skip Restore Incompatibility of Key Serializer for Savepoint

file, replacing the old one, the new Job can restor state and running well. Best regards, leilinee 发件人: Gabor Somogyi 发送时间: 2025年2月10日 16:48 收件人: 李 琳 抄送: user@flink.apache.org 主题: Re: Skip Restore Incompatibility of Key Serializer for Savepoint Seems like I wa

Issue with Special Characters in userProgramArguments When Submitting Flink Application to YARN

Hi all, I used the following code to create an applicationConfiguration for submitting a Flink job to a YARN cluster in application mode: ApplicationConfiguration applicationConfiguration = new ApplicationConfiguration(userProgramArguments, userMainClass); However, I encounte