Promethus - custom metrics at job level

Hi everyone, I am trying to publish some counters and meters from my Flink job, to be scraped by a Prometheus server. It seems to me that all the metrics that I am publishing are done at the task level, so that my Prometheus server needs to be configured to scrape from many targets (the number equ

?????? flink use hdfs DistributedCache

Rong,thanks for your reply! This is what i need! -- -- ??: "Rong Rong"; : 2018??9??3??(??) 0:02 ??: "??"<244272...@qq.com>; : "user"; : Re: flink use hdfs DistributedCache I am not sure if this suits your use c

Re: FoldFunction accumulator checkpointing

Hi Marzieh, Have you ever imported `org.apache.flink.api.java.tuple.Tuple2`? It seems that you imported the wrong class. You can copy the code from here[1]. Best, Hequn [1] https://ci.apache.org/projects/flink/flink-docs-master/tutorials/datastream_api.html On Sun, Sep 2, 2018 at 1:56 PM Mar_z

KafkaTopicPartition internal class treated as generic type serialization

I disabled generic type serialization via env.getConfig.disableGenericTypes() and got the following exception when running my job on a standalone cluster. Caused by: java.lang.UnsupportedOperationException: Generic types have been disabled in the ExecutionConfig and type org.apache.flink.stream

Re: flink use hdfs DistributedCache

I am not sure if this suits your use case, but Flink YARN cli does support transferring local resource to all YARN nodes. Simply use[1]: bin/flink run -m yarn-cluster -yt or bin/flink run -m yarn-cluster --yarnship should do the trick. It might have not been using the HDFS DistributedCache API t

Re: Cannot compile Wikipedia Edit Stream example

Hi Can you elaborate more on how to reproduce the error? What's the maven archetype you use to generate the job, what's the flink version you used? what java version you used in Intellij? I am suspecting either there's a mixed up on Scala / Java scaffold. Since your Tuple should be org.apache.fli

Re: Does Flink plan to support JDK 9 recently?

I'm currently working on ensuring that Flink compiles with jdk 9, see the parent issue of the linked PR. I cannot provide an estimate as to when this will be finished. On 01.09.2018 04:50, 陈梓立 wrote: Hi, Recently I see a PR mentions "for jdk9 compa

flink use hdfs DistributedCache

hi everyone! can flink submit job which read some custom file distributed by hdfs DistributedCache. like spark can do that with the follow command: bin/spark-submit --master yarn --deploy-mode cluster --files /opt/its007-datacollection-conf.properties#its007-datacollection-conf.properties