Thank you for the clarification. This was very helpful! Kind regards Kamil
On Wed, 10 Nov 2021, 02:26 Dian Fu, <dian0511...@gmail.com> wrote: > Hi Kamil, > > You are right that it comes with JAR packages of scala 2.11 in the PyFlink > package as it has to select one version of JARs to bundle, either 2.11 or > 2.12. Whether it works with scala 2.12 depends on how you submit your job. > - If you execute the job locally, then it will use the JARs bundled in the > PyFlink installation by default, that's scala 2.11. However, you could set > the environment variable 'FLINK_HOME' [1] to the directory of a custom > Flink distribution of 2.12 if you want to work with scala 2.12. > - If you execute the job remotely, e.g using `flink run` to submit the job > to a remote session cluster, YARN cluster, etc. Then it depends on the > Flink distribution from which the `flink run` command refers to. If you > want to work with scala 2.12, it should refer to a custom Flink > distribution of 2.12. > > Regards, > Dian > > [1] > https://github.com/apache/flink/blob/master/flink-python/pyflink/find_flink_home.py#L46 > > On Wed, Nov 10, 2021 at 3:12 AM Kamil ty <kamilt...@gmail.com> wrote: > >> Hello, >> >> Just wanted to verify if the default build of pyflink available from PyPi >> is compatible with flink - scala version 2.12. I have noticed that the PyPi >> pyflink version comes with apache-flink-libraries targeted for scala 2.11 >> only and I was wondering if this might be the cause of some issues that I'm >> running into. >> >> Kind regards >> Kamil >> >
