Anomaly in handling late arriving data

2019-09-25 Thread Indraneel R
Hi Everyone, I am trying to execute this simple sessionization pipeline, with the allowed lateness shown below: def main(args: Array[String]): Unit = { val env = StreamExecutionEnvironment.getExecutionEnvironment env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime) env.setPa

Re: Property based testing

2019-09-18 Thread Indraneel R
; > Possible to wrap all that in a single method in Scala. LMK if you have any > more questions or any of this was not clear! > > (note: not sure how to do this in Java). > > Best, > > Aaron Levin > > On Wed, Sep 18, 2019 at 8:36 AM Indraneel R > wrote: >

Property based testing

2019-09-18 Thread Indraneel R
Hi All, Is there any property based testing framework for flink like 'SparkTestingBase' for spark? Would also be useful to know what are some of the standard testing practices for data testing for flink pipelines. regards -Indraneel