Not exactly, the flink distribution just doesn't include the scala api by
default.
For using scala, you can pack in your job jar both flink-table-api-scala and
flink-table-api-scala-bridge and keep the flink distribution structure, which
mean flink-table-planner_2.12-1.15.0.jar is under opt fo
Hi,
It throws this exception because the memory segment provided by Flink is
depleted.
How do you implement your writing logic? It seems that you are using apache
beam. What is the version of Flink engine? Can you provide more logs so we can
know why the memory segment depletion happened.
I
One more question: Are you changing the parallelism when resuming from
savepoint?
On Sun, May 8, 2022 at 4:05 PM Thomas Weise wrote:
>
> Hi Kevin,
>
> Unfortunately I did not find a way to test the savepoint scenario with
> the MiniCluster. Savepoints are not supported in the embedded mode.
> The
Hi Kevin,
Unfortunately I did not find a way to test the savepoint scenario with
the MiniCluster. Savepoints are not supported in the embedded mode.
There is a way to hack around that, but then the state of the
enumerator won't be handled.
As for your original issue, is it reproducible consistent
Hi Flink User Group,
I am a data engineer from Thoughtworks and faced an issue recently when
running some flink code . the same code ran fine when run with smaller file
but on increasing the file size it gave this error
Caused by: java.io.EOFException
at
org.apache.flink.runtime.io.disk.
Thanks Yuxia, that works. Does that mean for one flink distribution, I can
either use java or use scala ? If so, it seems not user friendly.
On Sun, May 8, 2022 at 10:40 AM yuxia wrote:
> Hi, you can move the flink-table-planner-loader to the /opt. See more in
> https://issues.apache.org/jir
Hi !
Eventually, I came up with a solution following the instructions here
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/python/dependency_management/
module_home =
os.path.dirname(find_spec("python_lib_internally_containing_java_lib").origin)
jar_file = 'file:///' + module_ho
