Hi all,
I'm trying to run a PyFlink unit test to test some PyFlink SQL and where my
code uses a Python UDF. I can't share my code but the test case is similar to
the code here:
https://github.com/apache/flink/blob/f8172cdbbc27344896d961be4b0b9cdbf000b5cd/flink-python/pyflink/testing/test_case_utils.py
When I have some simple SQL everything is fine. When I add a more complex
query I get an error, which looks like it's memory related.
java.lang.IllegalArgumentException: The configured managed memory fraction
for Python worker process must be within (0, 1], was: %s. It may be because
the consumer type "Python" was missing or set to 0 for the config option
"taskmanager.memory.managed.consumer-weights".0.0
In my test case setUp(), I try to set that value like this, but it seems to
have no effect:
self.t_env.get_config().get_configuration().set_string("taskmanager.memory.managed.consumer-weights",
"PYTHON:30")
Am I not setting it correctly, or is there something else I need to do to fix
this error?
Many thanks,
John
