Hi, I'm planning to add an end-to-end test for the Kinesis consumer. We have done something similar at Lyft, using Kinesalite, which can be run as Docker container.
I see that some tests already make use of Docker, so we can assume it to be present in the target environment(s)? I also found the following ticket: https://issues.apache.org/jira/browse/FLINK-9007 It suggest to also cover the producer, which may be a good way to create the input data as well. The stream itself can be created with the Kinesis Java SDK. Following the existing layout, there would be a new module flink-end-to-end-tests/flink-kinesis-test Are there any suggestions or comments regarding this? Thanks, Thomas
