Hi Flink Community,
I'm in the process of upgrading a Flink application to 1.17.1, and I'm
running into the following exception in my integration test:
java.lang.SecurityException: setContextClassLoader
at
java.base/java.util.concurrent.ForkJoinWorkerThread$InnocuousForkJoinWorkerThread.setContextClassLoader(ForkJoinWorkerThread.java:240)
at
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:536)
at
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:522)
at
org.apache.flink.util.InstantiationUtil.clone(InstantiationUtil.java:620)
at
org.apache.flink.util.InstantiationUtil.clone(InstantiationUtil.java:598)
at
org.apache.flink.runtime.minicluster.MiniCluster.cloneJobGraph(MiniCluster.java:1334)
at
org.apache.flink.runtime.minicluster.MiniCluster.submitJob(MiniCluster.java:1011)
at
org.apache.flink.test.util.MiniClusterPipelineExecutorServiceLoader$MiniClusterExecutor.execute(MiniClusterPipelineExecutorServiceLoader.java:167)
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2197)
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:2084)
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:2058)
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:2036)
at
com.robinhood.shareholderx.StreamUserAccountSyncRealTime.run(StreamUserAccountSyncRealTime.java:95)
at
com.robinhood.shareholderx.StreamUserAccountSyncRealTimeTest.lambda$integrationTest$0(StreamUserAccountSyncRealTimeTest.java:107)
at
java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1736)
at
java.base/java.util.concurrent.CompletableFuture$AsyncRun.exec(CompletableFuture.java:1728)
at
java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
at
java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
at
java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
at
java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
at
java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
Before this exception, I see the following log lines that were not observed
in my previous Flink version:
[main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - Field
Value#account_number will be processed as GenericType. Please read the
Flink documentation on "Data Types & Serialization" for details of the
effect on performance and schema evolution.
[main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - Field
Value#type will be processed as GenericType. Please read the Flink
documentation on "Data Types & Serialization" for details of the
effect on performance and schema evolution.
[main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - Field
Value#updated_at will be processed as GenericType. Please read the
Flink documentation on "Data Types & Serialization" for details of the
effect on performance and schema evolution.
[main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - Field
Value#created_at will be processed as GenericType. Please read the
Flink documentation on "Data Types & Serialization" for details of the
effect on performance and schema evolution.
I tried to create a security policy to allow setContextClassLoader, but
that didn't work. Any idea on how to fix this will be greatly appreciated.
Thanks,
--
<http://www.robinhood.com/>
Tony Chen
Software Engineer
New York, New York
Brokerage services may be provided by Robinhood Financial LLC or Robinhood
Securities, LLC, members FINRA <http://finra.org/> / SIPC <http://sipc.org/>.
Don't copy, share, or use this email without permission. If you received it
by accident, please let us know and then delete it right away.
