Re: [ANNOUNCE] Apache Flink 1.9.0 released

Congratulations and thanks for the hard work! Qi > On Aug 22, 2019, at 8:03 PM, Tzu-Li (Gordon) Tai wrote: > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.9.0, which is the latest major release. > > Apache Flink® is an open-source stream processing fra

Re: [ANNOUNCE] Apache Flink 1.9.0 released

It is great news for the community. Thanks to everyone who contributed to the release management. Congratulations! On Thu, Aug 22, 2019 at 9:14 PM Haibo Sun wrote: > Great news! Thanks Gordon and Kurt! > > Best, > Haibo > > > At 2019-08-22 20:03:26, "Tzu-Li (Gordon) Tai" wrote: > >The Apache Fl

Re:[ANNOUNCE] Apache Flink 1.9.0 released

Great news! Thanks Gordon and Kurt!Best, Haibo At 2019-08-22 20:03:26, "Tzu-Li (Gordon) Tai" wrote: >The Apache Flink community is very happy to announce the release of Apache >Flink 1.9.0, which is the latest major release. > >Apache Flink® is an open-source stream processing framework for >dist

FLINK TABLE API UDAF QUESTION, For heap backends, the new state serializer must not be incompatible

Hello everyone: I defined a UDAF function when I am using the FLINK TABLE API to achieve the aggregation operation. There is no problem with the task running from beginning in cluster. But it throws an exception when it is restart task from checkpoint,How can I resolve it ? java.lang.Runtime

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Great news! Thanks Gordon and Kurt for pushing this forward and everybody who contributed to this release. Regards, Dian > 在 2019年8月23日，上午9:41，Guowei Ma 写道： > > Congratulations!! > Best, > Guowei > > > Congxian Qiu mailto:qcx978132...@gmail.com>> > 于2019年8月23日周五 上午9:32写道： > Congratulations,

Re: Externalized checkpoints

Hi, Vishwas As Zhu Zhu said, you can set "state.checkpoints.num-retained"[1] to specify the maximum number of completed checkpoints to retain. maybe you can also ref the external checkpoint cleanup type[2] config for how to clean up the retained checkpoint[2] [1] https://ci.apache.org/projects/fl

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Congratulations!! Best, Guowei Congxian Qiu 于2019年8月23日周五 上午9:32写道： > Congratulations, and thanks for everyone who make this release possible. > Best, > Congxian > > > Kurt Young 于2019年8月23日周五 上午8:13写道： > >> Great to hear! Thanks Gordon for driving the release, and it's been a >> great pleasu

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Congratulations, and thanks for everyone who make this release possible. Best, Congxian Kurt Young 于2019年8月23日周五 上午8:13写道： > Great to hear! Thanks Gordon for driving the release, and it's been a > great pleasure to work with you as release managers for the last couple of > weeks. And thanks ev

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Great to hear! Thanks Gordon for driving the release, and it's been a great pleasure to work with you as release managers for the last couple of weeks. And thanks everyone who contributed to this version, you're making Flink an even better project! Best, Kurt Yun Tang 于2019年8月23日 周五02:17写道： > G

Exception when trying to change StreamingFileSink S3 bucket

Hi, We are trying to change our StreamingFileSink S3 bucket, say from s3:// *eu1/output_old* to s3://*eu2/output_new*. When we do so we get an exception and the taskmanger goes into a restart loop. We suspect that it tries to restore state and gets the bucketid from saved state [* final BucketID

Re: TaskManager not connecting to ResourceManager in HA mode

Nice to hear :-) Best, tison. Aleksandar Mastilovic 于2019年8月23日周五 上午2:22写道： > Thanks for all the help, people - you made me go through my code once > again and discover that I switched argument positions for job manager and > resource manager addresses :-) > > The docker ensemble now starts fi

Re: TaskManager not connecting to ResourceManager in HA mode

Thanks for all the help, people - you made me go through my code once again and discover that I switched argument positions for job manager and resource manager addresses :-) The docker ensemble now starts fine, I’m working on ironing out the bugs now. I’ll participate in the survey too! > On

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Glad to hear this and really appreciate Gordon and Kurt's drive on this release, and thanks for everyone who ever contributed to this release. Best Yun Tang From: Becket Qin Sent: Friday, August 23, 2019 0:19 To: 不常用邮箱 Cc: Yang Wang ; user Subject: Re: [ANNOUNC

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Cheers!! Thanks Gordon and Kurt for driving the release! On Thu, Aug 22, 2019 at 5:36 PM 不常用邮箱 wrote: > Good news! > > Best. > -- > Louis > Email： xu_soft39211...@163.com > > On Aug 22, 2019, at 22:10, Yang Wang wrote: > > Glad to hear that. > Thanks Gordon, Kurt and everyone who had made cont

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Good news! Best. -- Louis Email： xu_soft39211...@163.com > On Aug 22, 2019, at 22:10, Yang Wang wrote: > > Glad to hear that. > Thanks Gordon, Kurt and everyone who had made contributions to the great > version. > > > Best, > Yang > > > Biao Liu mailto:mmyy1...@gmail.com>> 于2019年8月22日周四

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Glad to hear that. Thanks Gordon, Kurt and everyone who had made contributions to the great version. Best, Yang Biao Liu 于2019年8月22日周四 下午9:33写道： > Great news! > > Thank your Gordon & Kurt for being the release managers! > Thanks all contributors worked on this release! > > Thanks, > Biao /'bɪ

Re: Can I use watermarkers to have a global trigger of different ProcessFunction's?

thanks for the detail explanation! I removed my implementation of the watermark which is not necessary in my case. I will only use Watermarkers if I am dealing with out of order events. *--* *-- Felipe Gutierrez* *-- skype: felipe.o.gutierrez* *--* *https://felipeogutierrez.blogspot.com

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Great news! Thank your Gordon & Kurt for being the release managers! Thanks all contributors worked on this release! Thanks, Biao /'bɪ.aʊ/ On Thu, 22 Aug 2019 at 21:14, Paul Lam wrote: > Well done! Thanks to everyone who contributed to the release! > > Best, > Paul Lam > > Yu Li 于2019年8月22日

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Well done! Thanks to everyone who contributed to the release! Best, Paul Lam Yu Li 于2019年8月22日周四 下午9:03写道： > Thanks for the update Gordon, and congratulations! > > Great thanks to all for making this release possible, especially to our > release managers! > > Best Regards, > Yu > > > On Thu, 22

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Thanks for the update Gordon, and congratulations! Great thanks to all for making this release possible, especially to our release managers! Best Regards, Yu On Thu, 22 Aug 2019 at 14:55, Xintong Song wrote: > Congratulations! > Thanks Gordon and Kurt for being the release managers, and thank

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Congratulations! Thanks Gordon and Kurt for being the release managers, and thanks all the contributors. Thank you~ Xintong Song On Thu, Aug 22, 2019 at 2:39 PM Yun Gao wrote: > Congratulations ! > > Very thanks for Gordon and Kurt for managing the release and very > thanks for eve

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Congratulations ! Very thanks for Gordon and Kurt for managing the release and very thanks for everyone for the contributions ! Best, Yun -- From:Zhu Zhu Send Time:2019 Aug. 22 (Thu.) 20:18 To:Eliza Cc:user Su

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Thanks Gordon for the update. Congratulations that we have Flink 1.9.0 released! Thanks to all the contributors. Thanks, Zhu Zhu Eliza 于2019年8月22日周四 下午8:10写道： > > > On 2019/8/22 星期四 下午 8:03, Tzu-Li (Gordon) Tai wrote: > > The Apache Flink community is very happy to announce the release of > >

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Congratulations! Thanks Gordon and Kurt for being the release manager. Thanks all the contributors who have made this release possible. Best, tison. Jark Wu 于2019年8月22日周四 下午8:11写道： > Congratulations! > > Thanks Gordon and Kurt for being the release manager and thanks a lot to > all the contr

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Congratulations~~~ Thanks gordon and everyone~ Best, Jingsong Lee -- From:Oytun Tez Send Time:2019年8月22日(星期四) 14:06 To:Tzu-Li (Gordon) Tai Cc:dev ; user ; announce Subject:Re: [ANNOUNCE] Apache Flink 1.9.0 released Congratulati

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Ah, I was worried State Processor API would work only on savepoints, but this confirmed the opposite: The new State Processor API covers all variations of snapshots: savepoints, full checkpoints and incremental checkpoints. Now this is a good day for me. I can imagine creating some abstractions a

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Congratulations! Thanks Gordon and Kurt for being the release manager and thanks a lot to all the contributors. Cheers, Jark On Thu, 22 Aug 2019 at 20:06, Oytun Tez wrote: > Congratulations team; thanks for the update, Gordon. > > --- > Oytun Tez > > *M O T A W O R D* > The World's Fastest Hu

Re: [ANNOUNCE] Apache Flink 1.9.0 released

On 2019/8/22 星期四 下午 8:03, Tzu-Li (Gordon) Tai wrote: The Apache Flink community is very happy to announce the release of Apache Flink 1.9.0, which is the latest major release. Congratulations and thanks~ regards.

Re: [ANNOUNCE] Apache Flink 1.9.0 released

Congratulations team; thanks for the update, Gordon. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Aug 22, 2019 at 8:03 AM Tzu-Li (Gordon) Tai wrote: > The Apache Flink community is very happy to announce the rele

[ANNOUNCE] Apache Flink 1.9.0 released

The Apache Flink community is very happy to announce the release of Apache Flink 1.9.0, which is the latest major release. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is avail

Re: timeout error while connecting to Kafka

Can you try to remove this from your pom file . org.apache.flink flink-connector-kafka_2.11 1.7.0 Is their any reason why you are using flink 1.5 and not latest release. Best, Miki On Thu, Aug 22, 2019 at 2:19 PM Eyal Pe'er wrote: > Hi

RE: timeout error while connecting to Kafka

Hi Miki, First, I would like to thank you for the fast response. I recheck Kafka and it is up and running fine. I’m still getting the same error (Timeout expired while fetching topic metadata). Maybe my Flink version is wrong (Kafka version is 0.9)? org.apache.flink flink

Re: Multiple trigger events on keyed window

If you still need help diagnosing the cause of the misbehavior, please share more of the code with us. On Wed, Aug 21, 2019 at 6:24 PM Eric Isling wrote: > > I should add that the behaviour persists, even when I force parallelism to 1. > > On Wed, Aug 21, 2019 at 5:19 PM Eric Isling wrote: >> >>

Re: timeout error while connecting to Kafka

The code itself is fine. Turning the app’s log level to DEBUG will give you more information. BTW, please make sure that the addresses of Kafka brokers are properly resolved. > On Aug 22, 2019, at 15:45, Eyal Pe'er wrote: > > Hi, > > I'm trying to consume events using Apache Flink. > > The

Re: combineGroup get false results

Hi, If all key fields are primitive types (long) or String, their hash values should be deterministic. There are two things that can go wrong: 1) Records are assigned to the wrong group. 2) The computation of a group is buggy. I'd first check that 1) is correct. Can you replace the sum function

Re: combineGroup get false results

Hi Fabian, My GroupReduce function sum one column of input rows of each group. My key fields is array of multiple type, in this case is string and long. The result that i'm posting is just represents sampling of output dataset. Thank you in advance ! Anissa Le jeu. 22 août 2019 à 11:24, Fabian

Re: combineGroup get false results

Hi Anissa, This looks strange. If I understand your code correctly, your GroupReduce function is summing up a field. Looking at the results that you posted, it seems as if there is some data missing (the total sum does not seem to match). For groupReduce it is important that the grouping keys are

Re: Multiple trigger events on keyed window

The role of the watermarks in your job will be to trigger the closing of the sliding event time windows. In order to play that role properly, they should be based on the timestamps in the events, rather than some arbitrary constant (L). The reason why the same object is responsible for extracti

Re: Maximal watermark when two streams are connected

Hi Sung, There is no switch to configure the WM to be the max of both streams and it would also in fact violate the core principles of the mechanism. Watermarks are used to track the progress of event time in streams. The implementations of operators rely on the fact that (almost) all records tha

Re: combineGroup get false results

Thanks for your feedback! Sorry, effectively I used reductionGroup, but that gives different results when I change the parallelism to 8 (more than 1) and the true results are with Parallelism 1 and I want to set it to 8. I do not know how do to have the same result by modifying the parallelism us

Re: How to shorten MATCH_RECOGNIZE's DEFINE clause

Hi Dongwon, I'm not super familiar with Flink's MATCH_RECOGNIZE support, but Dawid (in CC) might have some ideas about it. Best, Fabian Am Mi., 21. Aug. 2019 um 07:23 Uhr schrieb Dongwon Kim < eastcirc...@gmail.com>: > Hi, > > Flink relational apis with MATCH_RECOGNITION looks very attractive a

Re: Error while sinking results to Cassandra using Flink Cassandra Connector

Hi Manvi, A NoSuchMethodError typically indicates a version mismatch. I would check if the Flink versions of your program, the client, and the cluster are the same. Best, Fabian Am Di., 20. Aug. 2019 um 21:09 Uhr schrieb manvmali : > Hi, I am facing the issue of writing the data stream result i

Re: combineGroup get false results

Hi Anissa, Are you using combineGroup or reduceGroup? Your question refers to combineGroup, but the code only shows reduceGroup. combineGroup is non-deterministic by design to enable efficient partial results without network and disk IO. reduceGroup is deterministic given a deterministic key extr

Re: timeout error while connecting to Kafka

Can you double check that the kafka instance is up ? The code looks fine. Best, Miki On Thu, Aug 22, 2019 at 10:45 AM Eyal Pe'er wrote: > Hi, > > I'm trying to consume events using Apache Flink. > > The code is very basic, trying to connect the topic split words by space > and print it to the

timeout error while connecting to Kafka

Hi, I'm trying to consume events using Apache Flink. The code is very basic, trying to connect the topic split words by space and print it to the console. Kafka version is 0.9. import org.apache.flink.api.common.functions.FlatMapFunction; import org.apache.flink.api.common.serialization.SimpleStri

Re: Maximal watermark when two streams are connected

I use assignerTimestampsAndWatermarks after connecting two streams and it works well. Thank you. > On 22 Aug 2019, at 3:26 PM, Jark Wu wrote: > > Hi Sung, > > Watermark will be advanced only when records come in if you are using > ".assignTimestampsAndWatermarks()". > One way to solve this