Re: [DataStream API] Best practice to handle custom session window - time gap based but handles event for ending session

2019-08-06 Thread Jungtaek Lim
uess I just couldn't find proper use cases on this. Btw, I'd like to thank, I'm learning Flink with the new book "Stream Processing with Apache Flink". :) Thanks for your amazing efforts on publishing nice book! Thanks, Jungtaek Lim (HeartSaVioR) On Mon, Aug 5, 2019 at 10

Re: [DataStream API] Best practice to handle custom session window - time gap based but handles event for ending session

2019-08-04 Thread Jungtaek Lim
session end", but it will provide same effect in point of "outputs". Nice approach! I'll play with this approach too. Thanks again, Jungtaek Lim (HeartSaVioR) On Mon, Aug 5, 2019 at 12:01 AM Dongwon Kim wrote: > Hi Jungtaek, > > I've faced a similar problem

[DataStream API] Best practice to handle custom session window - time gap based but handles event for ending session

2019-08-04 Thread Jungtaek Lim
de? That would be really nice if there's something I could contribute in this case. Thanks, Jungtaek Lim (HeartSaVioR) ps. This is an implementation based on Spark Structured Streaming (no custom window API, so had to put everything in state function of flatMapGroupsWi

Re: [Table API/SQL] Finding missing spots to resolve why 'no watermark' is presented in Flink UI

2018-07-04 Thread Jungtaek Lim
ache.flink.table.api.scala.package$.table2RowDataStream // though we are calling toRetractStream //outTable.toRetractStream[Row](outTable.dataType).print() implicit val typeInfo = Types.ROW(outTable.getSchema.getColumnNames, outTable.getSchema.getTypes) tableEnv.toRetractStream[Row](outTable)

Re: [Table API/SQL] Finding missing spots to resolve why 'no watermark' is presented in Flink UI

2018-07-04 Thread Jungtaek Lim
roperties(prop) .withRowtimeAttribute( "eventTime", new IsoDateStringAwareExistingField("eventTime"), new BoundedOutOfOrderTimestamps(Time.minutes(1).toMilliseconds) ) .build() Thanks again! Jungtaek Lim (HeartSaVioR) 2018년 7월 4일 (수) 오후 8:18, Fabian Hueske 님이 작성: > Hi Jungt

Re: [Table API/SQL] Finding missing spots to resolve why 'no watermark' is presented in Flink UI

2018-07-04 Thread Jungtaek Lim
ng-a-rowtime-attribute > > 2018-07-04 10:39 GMT+02:00 Chesnay Schepler : > >> The watermark display in the UI is bugged in 1.5.0. >> >> It is fixed on master and the release-1.5 branch, and will be included in >> 1.5.1 that is slated to be released next week. >

Re: [Table API/SQL] Finding missing spots to resolve why 'no watermark' is presented in Flink UI

2018-07-04 Thread Jungtaek Lim
Sorry I forgot to mention the version: Flink 1.5.0, and I ran the app in IntelliJ, not tried from cluster. 2018년 7월 4일 (수) 오후 5:15, Jungtaek Lim 님이 작성: > Hi Flink users, > > I'm new to Flink and trying to evaluate couple of streaming frameworks via > implementing sam

[Table API/SQL] Finding missing spots to resolve why 'no watermark' is presented in Flink UI

2018-07-04 Thread Jungtaek Lim
edStream. Thanks in advance! Best Regards, Jungtaek Lim (HeartSaVioR)