Re: flink submit job rest api classpath jar

Maybe you could consider to put your udf jar to flink/lib before job submission. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Each yarn container only use 1 vcore even if taskmanager.numberOfTaskSlots is set

Hi Henry, If I understand you correctly, you want YARN to allocate 4 vcores per TM container. You can achieve this by enabling the FairScheduler in YARN [1][2]. Best, Gary [1] https://ci.apache.org/projects/flink/flink-docs-release-1.7/ops/config.html#yarn-containers-vcores [2] https://hadoop.ap

Re: [ANNOUNCE] Apache Flink 1.7.2 released

Great job. It's great to have a more stable 1.7 release available. Thanks @Gordon for making it happen. Regards, Dian > 在 2019年2月18日，下午2:26，vino yang 写道： > > Great job! Thanks for being the release manager @Gordon. > > Best, > Vino > > Hequn Cheng mailto:chenghe...@gmail.com>> > 于2019年2月18

Confusion in Heartbeat configurations

Hi, In https://ci.apache.org/projects/flink/flink-docs-release-1.7/ops/config.html link there are two heartbeat config are mentioned . akka.watch.heartbeat.interval akka.watch.heartbeat.pause Vs heartbeat.interval heartbeat.timeout Can u guys pls explain what exactly is difference between t

Re: [ANNOUNCE] Apache Flink 1.7.2 released

Great job! Thanks for being the release manager @Gordon. Best, Vino Hequn Cheng 于2019年2月18日周一 下午2:16写道： > Thanks a lot for the great release @Gordon. > Also thanks for the work by the whole community. :-) > > Best, Hequn > > > On Mon, Feb 18, 2019 at 2:12 PM jincheng sun > wrote: > > > Thanks

Re: [ANNOUNCE] Apache Flink 1.7.2 released

Thanks a lot for the great release @Gordon. Also thanks for the work by the whole community. :-) Best, Hequn On Mon, Feb 18, 2019 at 2:12 PM jincheng sun wrote: > Thanks a lot for being our release manager Gordon , > Great job! > And also a big thanks to the community for making this release

Re: [ANNOUNCE] Apache Flink 1.7.2 released

Thanks a lot for being our release manager Gordon , Great job! And also a big thanks to the community for making this release possible. Cheers, Jincheng Tzu-Li (Gordon) Tai 于2019年2月18日周一 上午10:29写道： > Hi, > > The Apache Flink community is very happy to announce the release of > Apache Flink 1.

Re: Is group.id required in Kafka connector for offsets to be stored in checkpoint?

Hi David, We are also running streaming jobs over Kafka source . Yes : Consumer Group Id needs to be set for Kafka source explicitly t . We are also using checkpointing and save points for persisting state . Any time we change group id it starts from latest offset(default Kafka connector behav

Each yarn container only use 1 vcore even if taskmanager.numberOfTaskSlots is set

Hi Experts, I am running Flink 1.7.1 program on Yarn 2.7, the taskmanager.numberOfTaskSlots is set to 4. The parallelism.default is set to 8. When the program is running, 3 yarn containers is launched, but each of them only use 1 vcore, I think by default the number of vcores is set to t

Re: StreamingFileSink causing AmazonS3Exception

Hi Addison, Kostas, Steffan, I am also encountering this exact issue. I cannot find a JIRA ticket on this, is there some planned work on implementing a fix? @Addison - Did you manage to find a fix that you could apply without modifying the Flink codebase? If possible it would be better not patch

[ANNOUNCE] Apache Flink 1.7.2 released

Hi, The Apache Flink community is very happy to announce the release of Apache Flink 1.7.2, which is the second bugfix release for the Apache Flink 1.7 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streami

Starting Flink cluster and running a job

Following https://github.com/apache/flink/tree/release-1.7/flink-container/docker I have created an entry point, which looks like follows: #!/bin/sh #

Jira issue Flink-11127

I was looking at this issue https://issues.apache.org/jira/browse/FLINK-11127 Apparently there is a workaround for it. Is it possible provide the complete helm chart for it. Bits and pieces are in the ticket, but it would be nice to see the full

Re: Flink 1.6 Yarn Session behavior

Hi Jins George, Every TM brings additional overhead, e.g., more heartbeat messages. However, a cluster with 28 TMs would not be considered big as there are users that are running Flink applications on thousands of cores [1][2]. Best, Gary [1] https://flink.apache.org/flink-architecture.html#run-

Reading messages from start - new job submission

I'm updating a job without savepoint. The consumer properties is set to * prop.setProperty("auto.offset.reset", "earliest")* The start strategy is not explicitly set (using the default setStartFromGroupOffsets). In this case I expect that the consumer will read the messages from the beginning sinc

flink submit job rest api classpath jar

hi submit job through rest api /jars/:jarid/run my job is sql and udf , but the rest api only run one jar , udf can't run simultaneously, View JarRunHandler code , not support classpath so Do I have other methods to achieve? Two jar packs together? -- Sent from: http://apache-flink-user-ma