Re: Question about Flink metrics

2023-05-04 Thread Mason Chen
Hi Neha, For the jobs you care about, you can attach additional labels using `scope-variables-additional` [1]. The example located in the same page showcases how you can configure KV pairs in its map configuration. Be sure to replace the reporter name with the name of your prometheus reporter! [1

Question about Flink metrics

2023-05-04 Thread neha goyal
Hello, I have a question about the Prometheus metrics. I am able to fetch the metrics from the following expression. sum(flink_jobmanager_job_numRestarts{job_name="$job_name"}) by (job_name) Now I am interested in only a few jobs and I want to give them a label. How to achieve this? How to give an

Re: Issue when Running the flink-kuberenetes-operator sql-runner (The file STDOUT does not exist on the TaskExecutor)

2023-05-04 Thread Hang Ruan
Hi, Nathan, I think the previous discussion[1] is helpful for you. Best, Hang [1] https://lists.apache.org/thread/cgwsr6f1l3202ktwcvtyxtdsgj2vyms1 Nathan Moderwell 于2023年5月5日周五 03:54写道: > Hi, > > I'm running the sql-runner example in the flink-kuberenetes-operator repo > and hitting an error.

Re: 退订

2023-05-04 Thread Shammon FY
如果需要取消订阅 user@flink.apache.org 和 d...@flink.apache.org 邮件组,请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 和 dev-unsubscr...@flink.apache.org ,参考[1] [1] https://flink.apache.org/zh/community/ On Fri, May 5, 2023 at 10:43 AM 谢浩天 wrote: > 您好: >退订! > > > 谢浩天 > >

退订

2023-05-04 Thread 谢浩天
您好: 退订! 谢浩天

Re: MSI Auth to Azure Storage Account with Flink Apache Operator not working

2023-05-04 Thread Shammon FY
Hi DEROCCO, I think you need to check whether there is a hadoop-azure jar file in the classpath of your flink job. From an error message '*Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azurebfs.oauth2.MsiTokenProvider not found.*', your flink job may be missing this packa

Re: Table API behaves differently in STREAMING mode v.s. BATCH mode

2023-05-04 Thread Shammon FY
Hi Luke, This issue has been fixed in FLINK-25645 [1]. You can try 1.16 and later versions of flink. [1] https://issues.apache.org/jira/browse/FLINK-25645 Best, Shammon FY On Tue, May 2, 2023 at 12:18 PM Luke Xiong wrote: > Many thanks if anybody could help. I ran into this in version 1.15. >

MSI Auth to Azure Storage Account with Flink Apache Operator not working

2023-05-04 Thread DEROCCO, CHRISTOPHER
I receive the error: Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azurebfs.oauth2.MsiTokenProvider not found. I'm using flink 1.16 running in Azure Kubernetes using the Flink Apache Kubernetes Operator. I have the following specified in the spec.flinkConfiguration: as

Issue when Running the flink-kuberenetes-operator sql-runner (The file STDOUT does not exist on the TaskExecutor)

2023-05-04 Thread Nathan Moderwell
Hi, I'm running the sql-runner example in the flink-kuberenetes-operator repo and hitting an error. I've tried building the image from different releases of the repo and that does not help. The pods run (status stays at Running) and it is able to build the execution graph successfully, however I s