Re: Java + Python Xlang pipeline

2022-10-12 Thread Xiao Ma
Thank you very much for the option provided. Just checked the stackoverflow settings and tried at our end. It can be an option for us. Thank you. Best, *Xiao Ma* On Tue, Oct 11, 2022 at 7:41 PM Lydian wrote: > You should be able to provide extra_args to the expansion service: > ``` > > --defaul

Re: Java + Python Xlang pipeline

2022-10-11 Thread Lydian
You should be able to provide extra_args to the expansion service: ``` --defaultEnvironmentType=PROCESS --defaultEnvironmentConfig={"command":"/opt/apache/beam_java/boot"} ``` I am also running the Xlang pipeline in flink k8s cluster. After setting the defaultEnvironmentType to PROCESS, I don't

Re: Java + Python Xlang pipeline

2022-10-11 Thread Xiao Ma
The worker pool means `starting a java or python sdk`, to accept the java or python pipeline running. For example, to execute python pipeline, we have to start a python worker pool with `--worker_pool` arguments. For the Java code, besides the docker mode (default one), do we have other better ways

Re: Java + Python Xlang pipeline

2022-10-11 Thread Alexey Romanenko
I’m not sure that I get it correctly. What do you mean by “worker pool” in your case? — Alexey > On 8 Oct 2022, at 03:24, Xiao Ma wrote: > > Hello, > > I would like to run a pipeline with Java as the main language and python > transformation embedded. The beam pipeline is running on the fli

Java + Python Xlang pipeline

2022-10-07 Thread Xiao Ma
Hello, I would like to run a pipeline with Java as the main language and python transformation embedded. The beam pipeline is running on the flink cluster. Currently, I can run it with a taskmanager + java worker pool and a python worker pool. Could I ask if there is a way to run the java code on