Flink Kubernetes Operator Artifact Hub

2024-08-12 Thread Sam Barker
I was looking to test the latest version of the kubernetes operator on my OpenShiftLocal install and noticed the current version published to OperatorHub/ArtifactHub is 1.6.0. Is there a reason it has stopped being updated?

Re: Checkpoint Timeout Troubleshooting

2022-05-05 Thread Sam Ch
Thank you for the help. To follow up, the issue went away when we reverted back to flink 1.13. May be related to flink-27481. Before reverting, we tested unaligned checkpoints with a timeout of 10 minutes, which timed out. Thanks. On Thu, Apr 28, 2022, 5:38 PM Guowei Ma wrote: > Hi Sam &g

Checkpoint Timeout Troubleshooting

2022-04-28 Thread Sam Ch
Hello, I am running into checkpoint timeouts and am looking for guidance on troubleshooting. What should I be looking at? What configuration parameters would affect this? I am afraid I am a Flink newbie so I am still picking up the concepts. Additional notes are below, anything else I can provide?

Re: Session Windows - not working as expected

2021-05-05 Thread Sam
Adding the code for CustomWatermarkGenerator . @Override public void onEvent(Customer customer, long l, WatermarkOutput watermarkOutput) { currentMaxTimestamp = Math.max(currentMaxTimestamp, customer.getEventTime() ); } @Override public void onPeriodicEmit(WatermarkOutput watermarkOutput

Re: Hadoop 运行 mr 程序 报错

2019-03-04 Thread sam peng
Thanks for your reply, I fix the problem by adding a new user. Root is not avaliable . > 在 2019年3月4日,上午11:47,sam peng <624645...@qq.com> 写道: > > > 请教大家一个Hadoop 运行MR问题。 > > 之前我们配置过一个单点Hadoop,能正常运行。 > > 目前我们把hadoop 移到生产环境中,将hadoop目录挂载在磁盘中,用flum

Cannot restore from savepoint after adding a sink operator

2017-08-03 Thread Sam Huang
Hi all! I added a S3 bucketing sink operator to my flink job and tried to start it from a savepoint using --allowNonRestoreState option, and it's showing me this error: I found on Flink official

Re: window function not working when control stream broadcast

2017-03-09 Thread Sam Huang
oadcast() function? On Thu, Mar 9, 2017 at 2:26 AM, Aljoscha Krettek wrote: > Hi Sam, > could you please also send the code for the DataFilterFunImpl and your > timestamps/watermark assigner. That could help in figuring out the problem. > > Best, > Aljoscha > > >

Re: window function not working when control stream broadcast

2017-03-08 Thread Sam Huang
.tag(TAG_KEY, kvTypeTuple.f3) .addField(FIELD, kvTypeTuple.f4); collector.collect(builder.build()); } } On Wed, Mar 8, 2017 at 1:10 AM, Timo Walther wrote: > Hi Sam, > > could you explain the behavior a bit more? How does the window function > behave?

Re: Event-time tumbling window doesn't fire- Flink 1.2.0, Kafka-0.8_2.10

2017-03-07 Thread Sam Huang
So sorry I forgot to reply. I've solved the problem, turns out I didn't input data which generates a watermark greater than my first window end time, so no window was triggered. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Event-time-tumbl

Re: window function not working when control stream broadcast

2017-03-07 Thread Sam Huang
btw, the reduce function works well, I've printed out the data, and they are all correct. So are the timestamps and watermarks. And if I remove ".broadcast()", the data is successfully sinked. Any help? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.n

window function not working when control stream broadcast

2017-03-07 Thread Sam Huang
Hi all, I connected my data stream with my control stream and create event time tumbling window, everything works fine. But when I add .broadcast() function to the control stream, the window function doesn't work anymore. I'm running that on my local, the code is here: public static void main(St

Event-time tumbling window doesn't fire- Flink 1.2.0, Kafka-0.8_2.10

2017-02-28 Thread Sam Huang
v.getConfig().setGlobalJobParameters(params); //env.getConfig().setAutoWatermarkInterval(1000); env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime); return env; } Any help will be appreciated. Thank you, Sam

Event-time tumbling window doesn't fire- Flink 1.2.0, Kafka-0.8_2.10

2017-02-28 Thread Sam Huang
HiI'm using Flink 1.2.0 to read from Kafka-0.8.1.1_2.10I have written a flink streaming job that creates (event) time based window and then computes some stats. However, the window function is never called. I used the debug watermark code and noticed that no watermark is generated. If I read from f

Regarding Flink as a web service

2017-01-29 Thread Sam Hawk
charts and graphs. Any helpful link to the tutorial will be appreciated. Thanks, Sam