Hi all,
It took me some time to reply. I am focusing on testing my job, not on unit tests and the SourceFunction as in WindowFunctionITCase.scala <https://github.com/apache/flink/blob/master/flink-streaming-scala/src/test/scala/org/apache/flink/streaming/api/scala/WindowFunctionITCase.scala> has helped me a lot :) Is there any test with keyed windows? I am writing in java with POJOs instead of tuples. On Fri, Aug 31, 2018 at 3:43 PM David Anderson <da...@data-artisans.com> wrote: > The flink training exercises have a simpler example of using a > TwoInputStreamOperatorTestHarness from outside of the Flink code base that > you can refer to. The two input test harness is more or less the same as > the one input test harness. > > > https://github.com/dataArtisans/flink-training-exercises/blob/master/src/test/java/com/dataartisans/flinktraining/exercises/datastream_java/process/EventTimeJoinTest.java > > You'll need these dependencies: > > <dependency> > <groupId>org.apache.flink</groupId> > <artifactId>flink-test-utils-junit</artifactId> > <version>${flink.version}</version> > </dependency> > > <dependency> > <groupId>org.apache.flink</groupId> > <artifactId>flink-streaming-java_2.11</artifactId> > <version>${flink.version}</version> > <scope>test</scope> > <type>test-jar</type> > </dependency> > > <dependency> > <groupId>org.mockito</groupId> > <artifactId>mockito-all</artifactId> > <version>1.10.19</version> > <type>jar</type> > <scope>test</scope> > </dependency> > > <dependency> > <groupId>org.apache.flink</groupId> > <artifactId>flink-runtime_2.11</artifactId> > <version>${flink.version}</version> > <scope>test</scope> > <type>test-jar</type> > </dependency> > > On Thu, Aug 30, 2018 at 3:04 PM Nicos Maris <nicos.ma...@gmail.com> wrote: > > > > Can the OneInputStreamOperatorTestHarness be used to test pipelines with > time windows? > > > > Can someone explain this test harness preferably with a tiny example? > > > > I see here that "it is currently not a part of public API and can be > subject to change", but I assume it is the only thing I can get from flink > as regards automated testing of pipelines with time windows. > > > > On Tue, Aug 28, 2018 at 3:12 PM Nicos Maris <nicos.ma...@gmail.com> > wrote: > >> > >> Hi Zhengwen, > >> > >> > >> I have tested my job manually (both by submitting a job and through > execute()) and I am trying to write a test. > >> > >> The following project states that it has the feature "Test stream > windowing with timestamped input" but I do not want to rely on a project > other than flink. > >> > >> https://github.com/ottogroup/flink-spector > >> > >> The following folder doesn't seam to demonstrate such capability for > testing. > >> > >> > https://github.com/apache/flink/tree/master/flink-examples/flink-examples-streaming/src/test/java/org/apache/flink/streaming/test > >> > >> > >> > >> On Tue, Aug 28, 2018 at 2:55 PM ZhengWen ZHU <ahua...@gmail.com> wrote: > >>> > >>> Hi Nicos, > >>> Under the flink-example module, there are many examples, including > batch and streaming. You could build the project from the source, this way > you could found many jars under the target directory. You can submit these > jars to the Flink cluster. Also, you could run these examples directly from > your IDE by standalone mode. > >>> > >>> best, > >>> Zhengwen > >>> > >>> On Tue, Aug 28, 2018 at 7:35 PM Nicos Maris <nicos.ma...@gmail.com> > wrote: > >>>> > >>>> Hi all, > >>>> > >>>> > >>>> How can I test in Java any streaming job that has a time window? > >>>> > >>>> > >>>> best, > >>>> Nicos > >>> > >>> > >>> > >>> -- > >>> _________________________________________ > >>> > >>> Zhu Zhengwen > >>> State Key Laboratory For Novel Software Technology > >>> Dept. of Computer Sci. & Tech., Nanjing University > >>> 9, Hankou Road, Nanjing, China. > > > > -- > David Anderson | Training Coordinator | data Artisans > -- > Join Flink Forward - The Apache Flink Conference > Stream Processing | Event Driven | Real Time >
