Re: Monitor number of dropped elements due to lateness in Samza/Flink runner

2022-12-04 Thread Sören Henning
Hi community, I'd like to expand my previous question to also cover the Flink runner. Is there any way to track the number of elements dropped due to lateness? Either using the native Samza/Flink metrics or with Beam metrics? Thanks Sören Am 02.12.22 um 16:45 schrieb Sören Henning: Hey comm

beam/flink cluster with podman

2022-12-04 Thread Matthis Leicht
Hello everybody, does anyone have experience with setting up a flink-cluster to execute beam pipelines over the python sdk? Because rootfull containers are not allowed where I want to run the cluster, I try to do this in podman/podman-compose. I try to make a test pipeline work: https://github.c