Cannot restore from savepoint after adding a sink operator

2017-08-03 Thread Sam Huang
Hi all! I added a S3 bucketing sink operator to my flink job and tried to start it from a savepoint using --allowNonRestoreState option, and it's showing me this error: I found on Flink official

Re: window function not working when control stream broadcast

2017-03-09 Thread Sam Huang
oadcast() function? On Thu, Mar 9, 2017 at 2:26 AM, Aljoscha Krettek wrote: > Hi Sam, > could you please also send the code for the DataFilterFunImpl and your > timestamps/watermark assigner. That could help in figuring out the problem. > > Best, > Aljoscha > > >

Re: window function not working when control stream broadcast

2017-03-08 Thread Sam Huang
Is it not triggered or what is the content? What is the result if > you don't use a window function? > > Timo > > > Am 08/03/17 um 02:59 schrieb Sam Huang: > > btw, the reduce function works well, I've printed out the data, and they >> are >> all corre

Re: Event-time tumbling window doesn't fire- Flink 1.2.0, Kafka-0.8_2.10

2017-03-07 Thread Sam Huang
So sorry I forgot to reply. I've solved the problem, turns out I didn't input data which generates a watermark greater than my first window end time, so no window was triggered. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Event-time-tumbl

Re: window function not working when control stream broadcast

2017-03-07 Thread Sam Huang
btw, the reduce function works well, I've printed out the data, and they are all correct. So are the timestamps and watermarks. And if I remove ".broadcast()", the data is successfully sinked. Any help? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.n

window function not working when control stream broadcast

2017-03-07 Thread Sam Huang
Hi all, I connected my data stream with my control stream and create event time tumbling window, everything works fine. But when I add .broadcast() function to the control stream, the window function doesn't work anymore. I'm running that on my local, the code is here: public static void main(St

Event-time tumbling window doesn't fire- Flink 1.2.0, Kafka-0.8_2.10

2017-02-28 Thread Sam Huang
Hi, I'm using *Flink* *1.2.0* to read from *Kafka*-0.8.1.1_2.10. I have written a *flink* streaming job that creates (event) time based window and then computes some stats. However, the window function is never called. I used the debug watermark code and noticed that no watermark is generated. If

Event-time tumbling window doesn't fire- Flink 1.2.0, Kafka-0.8_2.10

2017-02-28 Thread Sam Huang
HiI'm using Flink 1.2.0 to read from Kafka-0.8.1.1_2.10I have written a flink streaming job that creates (event) time based window and then computes some stats. However, the window function is never called. I used the debug watermark code and noticed that no watermark is generated. If I read from f