Hello there!
I'm learning Beam and Flink. I made Flink is running on my PC, I installed Beam module (pip install apache-beam).
My first step is to execute simple script:
def run():
import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
options = Pip
I try again maybe someone can help me with this?
How to run Beam on Flink?
I have code:
def run():
import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
options = PipelineOptions([
"--runner=FlinkRunner",
"--flink_version=1.1
Hi Sam,
thanks for your help.
"When the Flink taskmanager executes the WriteToText transform, it spins up a beam python SDK docker container"
Hmmm... that's weird. I though Beam create pipeline in Flink language so once sent do Flink there's no relation with Beam anymore. This is what they sa
Thank you Robert - I really appreciate.
I'm not happy that reading or writing to file is actually done on Beam side. This means it's not exactly true that pipelines are executed by Flink - this is just some part of the job done by Flink (and the other by Beam).
I did imagine that Beam just com
Has anyone managed to install apache-flink [Python]? Whatever I do, fail.
Visual studio installed, yes all tools and SDK are included. All numpy, scipy ... whatever installed.
Even apache-beam as they say [question why install it if it's supposed to be Flink not Beam ... fake - this is sa
