On Thu, May 6, 2021 at 9:53 AM Nir Gazit <nir....@gmail.com> wrote: > Hey, > I'm trying to run a pipeline with the Python SDK that reads from Kafka. > I've started with a simple one that just reads messages and prints them to > the console. When running on Flink, I get the following error: > File "kafka_print.py", line 36, in run_kafka_pipeline > | 'Print to console' >> beam.Map(print)) > File > "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/pipeline.py", > line 581, in __exit__ > self.result.wait_until_finish() > File > "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/runners/portability/portable_runner.py", > line 608, in wait_until_finish > raise self._runtime_exception > > Any idea why is that? Printing seems to work fine when the source is some > static PCollection. >
Probably you are running into https://issues.apache.org/jira/browse/BEAM-11998. Please see here for a previous thread on this: https://lists.apache.org/thread.html/r9c74a8a7efa4b14f2f1d5f77ce8f12128cf1071861c1627f00702415%40%3Cuser.beam.apache.org%3E Thanks, Cham > > Thanks! > Nir >
