Dataflow runner and IntrinsicMapTaskExecutor instanciation

2022-05-20 Thread Michel Davit
Hi there 👋 I have a question regarding dataflow runner, more precisely on its behavior for instantiating IntrinsicMapTaskExecutor. I've noticed that running the same job with different versions, and analyzing the heap dump, there are some differences: beam java SDK 2.29.0: *11* instances beam jav

Re: Example of Beam Go job that uses Flink Kubernetes operator

2022-05-20 Thread Red Daly
I created an example project with my attempts to get something working: https://github.com/gonzojive/beam-go-k8s The good news is I got something working with Beam, Go, Bazel, Flink, and Kubernetes (minikube). The working version doesn't use the operator and only runs in a single pod. I would st