Timezone offset on daily time window grouping using SQL

2018-03-18 Thread LiYue
Hello team, In DataStream API , a time offset can be specified like this: input .keyBy() .window(TumblingEventTimeWindows.of(Time.days(1), Time.hours(-8))) Is their any way to specify a time offset on SQL? My sql looks like: SELECT * from table GROUP BY TUMBLE(`timestamp`,INTERVAL '1’ DA

cannot see monitor metrics

2018-03-18 Thread ??????????
I run flink on yarn , Im sure my program is OK, but I just cannot see the monitor metrics, my ENV: flink-1.4,kafka-0.10,cdh-5.11.1

Re: Restart hook and checkpoint

2018-03-18 Thread Ashish Pokharel
Thanks Fabian! Yes, that is exactly what we are looking to achieve. I looked at fine grained recovery FLIP but not sure if that will do the trick. Like Fabian mentioned, we haven’t been enabling checkpointing (reasons below). I do understand it might not always be possible to actually take a ch

Re: flink on mesos

2018-03-18 Thread miki haiat
I think that you can use the catalog option only if you install dc/os ? > iv installed mesos and marathon On Sun, Mar 18, 2018 at 5:59 PM, Lasse Nedergaard wrote: > Hi. > Go to Catalog, Search for Flink and click deploy > > Med venlig hilsen / Best regards > Lasse Nedergaard > > > Den 1

Re: flink on mesos

2018-03-18 Thread Lasse Nedergaard
Hi. Go to Catalog, Search for Flink and click deploy Med venlig hilsen / Best regards Lasse Nedergaard > Den 18. mar. 2018 kl. 16.18 skrev miki haiat : > > > Hi , > > Im trying to run flink on mesos iv installed mesos and marathon > successfully but im unable to create flink job/task man

Re: Queryable State

2018-03-18 Thread Vishal Santoshi
To be more precise, is anything thing similar to https://engineering.linkedin.com/blog/2018/03/air-traffic-controller--member-first-notifications-at-linkedin . done in Samza, can be replicated with production level guarantees with Flink Queryable state ( as it stands currently version 1.5 ) ? On

flink on mesos

2018-03-18 Thread miki haiat
Hi , Im trying to run flink on mesos iv installed mesos and marathon successfully but im unable to create flink job/task manager im running this command but mesos wont start any task ./mesos-appmaster-flip6-session.sh -n 1 i cant figure out the proper way to run flink on mesos