If you are interested in portable python pipeline validation, I think
fn_api_runner_test would also help.
Just to note, Ankur mentioned flinkCompatibilityMatrix, that one uses
fn_api_runner_test with some tooling on top to bring up the test cluster.
On 23.04.19 19:23, Boyuan Zhang wrote:
Hi Daniel,
If you are interested in portable python pipeline validation, I think
fn_api_runner_test
<https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/portability/fn_api_runner_test.py>
would also help.
On Tue, Apr 23, 2019 at 10:19 AM Pablo Estrada <pabl...@google.com
<mailto:pabl...@google.com>> wrote:
This is cool, Daniel : ) Glad to see the Samza runner moving forward.
Best
-P.
On Tue, Apr 23, 2019 at 2:52 AM Maximilian Michels <m...@apache.org
<mailto:m...@apache.org>> wrote:
Hi Daniel,
Note that there is also Portable Validates Runner which runs Java
portability tests. I don't know if you have integrated with that
one
already.
Thanks,
Max
On 23.04.19 02:28, Ankur Goenka wrote:
> Hi Daniel,
>
> We use flinkCompatibilityMatrix [1] to check the Flink
compatibility
> with python. This is python equivalent to validatesRunner
tests in java
> for portable runners.
> I think we can reuse it for Samza Portable runner with minor
refactoring.
>
> [1]
>
https://github.com/apache/beam/blob/bdb1a713a120a887e71e85c77879dc4446a58541/sdks/python/build.gradle#L305
>
> On Mon, Apr 22, 2019 at 3:21 PM Daniel Chen
<danx...@gmail.com <mailto:danx...@gmail.com>
> <mailto:danx...@gmail.com <mailto:danx...@gmail.com>>> wrote:
>
> Hi everyone,
>
> I'm working on improving the validation of the Python
portable Samza
> runner. For java, we have the gradle task (
:validatesRunner) that
> runs the runner validation tests.
> I am looking for pointers on how to similarly
integrate/enable the
> portability and Python tests for the Samza runner.
>
> Any help will be greatly appreciated.
>
> Thanks,
> Daniel
>
