Great, thanks!
Kind regards,
Levan Huyen
On Fri, 21 Oct 2022 at 00:53, Biao Geng wrote:
> You are right.
> It contains the python package `pyflink` and some dependencies like py4j
> and cloudpickle but does not contain all relevant dependencies(e.g.
> `google.protobuf` as the error log shows, w
You are right.
It contains the python package `pyflink` and some dependencies like py4j
and cloudpickle but does not contain all relevant dependencies(e.g.
`google.protobuf` as the error log shows, which I also reproduce in my own
machine).
Best,
Biao Geng
Levan Huyen 于2022年10月20日周四 19:53写道:
>
Thanks Biao.
May I ask one more question: does the binary package on Apache site (e.g:
https://archive.apache.org/dist/flink/flink-1.15.2) contain the python
package `pyflink` and its dependencies? I guess the answer is no.
Thanks and regards,
Levan Huyen
On Thu, 20 Oct 2022 at 18:13, Biao Geng
Hi Levan,
Great to hear that your issue is resolved!
For the follow-up question, I am not quite familiar with AWS EMR's
configuration for flink but due to the error you attached, it looks like
that pyflink may not ship some 'Google' dependencies in the Flink binary
zip file and as a result, it will
Hi Biao,
Thanks for your help. That solved my issue. It turned out that in setup1
(in EMR), I got apache-flink installed, but the package (and its
dependencies) are not in the directory `/usr/lib/python3.7/site-packages`
(corresponding to the python binary in `/usr/bin/python3`). For some
reason,
Hi Levan,
For your setup1 & 2, it looks like the python environment is not ready.
Have you tried python -m pip install apache-flink for the first 2 setups?
For your setup3, as you are trying to use `flink run ...` command, it will
try to connect to a launched flink cluster but I guess you did not
Hi,
I'm new to PyFlink, and I couldn't run a basic example that shipped with
Flink.
This is the command I tried:
./bin/flink run -py examples/python/datastream/word_count.py
Here below are the results I got with different setups:
1. On AWS EMR 6.8.0 (Flink 1.15.1):
*Error: No module named 'goog