Python pipeline: unable to read from Kafka in a Flink cluster with the expansion service

2023-01-05 Thread Florentin Hennecker
Hello, I’ve been trying to write a pipeline in Python with apache-beam==2.38.0, which starts with a ReadFromKafka step. I have a flink cluster running in docker-compose, as well as the Flink job service image, which should serve the expansion service on port 8097, according to the docs: https

Re: Python pipeline: unable to read from Kafka in a Flink cluster with the expansion service

2023-01-06 Thread Florentin Hennecker
doesn't support the Splitable DoFn very well, and when > I test, the newer version will crash in about a day, but it would be totally > working well if I add this use_deprecated_read. > > Sincerely, > Lydian Lee > > > > On Thu, Jan 5, 2023 at 2:37 AM Florentin H