Re: Broadcast state

2019-10-19 Thread Congxian Qiu
By using Redis, you can store all data in one job in one single Redis, no need one slot one Redis, what do you think? Best, Congxian Navneeth Krishnan 于2019年10月18日周五 上午4:47写道: > Ya, there will not be a problem of duplicates. But what I'm trying to > achieve is if there a large static state whi

Re: [ANNOUNCE] Apache Flink 1.9.1 released

2019-10-19 Thread Hequn Cheng
Thanks a lot to Jark, Jincheng, and everyone that make this release possible. Best, Hequn On Sat, Oct 19, 2019 at 10:29 PM Zili Chen wrote: > Thanks a lot for being release manager Jark. Great work! > > Best, > tison. > > > Till Rohrmann 于2019年10月19日周六 下午10:15写道: > >> Thanks a lot for being ou

Submitting jobs via REST

2019-10-19 Thread Timothy Victor
I have a flink docker image with my job's JAR already contained within. I would like to run a job with this jar via the REST api. Is that possible? I know I can run a job via REST using JarID (ID assigned by flink when a jar is uploaded). However I don't have such an ID since this jar is alrea

Re: [ANNOUNCE] Apache Flink 1.9.1 released

2019-10-19 Thread Zili Chen
Thanks a lot for being release manager Jark. Great work! Best, tison. Till Rohrmann 于2019年10月19日周六 下午10:15写道: > Thanks a lot for being our release manager Jark and thanks to everyone who > has helped to make this release possible. > > Cheers, > Till > > On Sat, Oct 19, 2019 at 3:26 PM Jark Wu

Re: [ANNOUNCE] Apache Flink 1.9.1 released

2019-10-19 Thread Till Rohrmann
Thanks a lot for being our release manager Jark and thanks to everyone who has helped to make this release possible. Cheers, Till On Sat, Oct 19, 2019 at 3:26 PM Jark Wu wrote: > Hi, > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.9.1, which is the firs

Re: [ANNOUNCE] Apache Flink 1.9.1 released

2019-10-19 Thread Yong Hua
On 2019/10/19 9:07 下午, Jark Wu wrote: The Apache Flink community is very happy to announce the release of Apache Flink 1.9.1, which is the first bugfix release for the Apache Flink 1.9 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always

[ANNOUNCE] Apache Flink 1.9.1 released

2019-10-19 Thread Jark Wu
Hi, The Apache Flink community is very happy to announce the release of Apache Flink 1.9.1, which is the first bugfix release for the Apache Flink 1.9 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streami

Re: Customize Part file naming (Flink 1.9.0)

2019-10-19 Thread Taher Koitawala
Beware when using Bucketing sink as it does not follow exactly once semantics. Also it has issues with s3 consistency. On Sat, Oct 19, 2019, 1:42 PM Ravi Bhushan Ratnakar < ravibhushanratna...@gmail.com> wrote: > Hi, > > As an alternative, you may use BucketingSink which provides you the > prov

Re: Customize Part file naming (Flink 1.9.0)

2019-10-19 Thread Ravi Bhushan Ratnakar
Hi, As an alternative, you may use BucketingSink which provides you the provision to customize suffix/prefix. https://ci.apache.org/projects/flink/flink-docs-release-1.9/api/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.html Regards, Ravi On Sat, Oct 19, 2019 at 3:54 AM a