回复:dataStream can not use multiple classloaders

2021-10-19 Thread 百岁
: dataStream can not use multiple classloaders You also must ensure that your SourceFunction is serializable, so it's not enough to just refer to some classloader, you must ensure that you have access to it also after deserialization on the task managers. On Mon, Oct 18, 2021 at 4:24 AM Caizhi

Re: dataStream can not use multiple classloaders

2021-10-18 Thread Arvid Heise
You also must ensure that your SourceFunction is serializable, so it's not enough to just refer to some classloader, you must ensure that you have access to it also after deserialization on the task managers. On Mon, Oct 18, 2021 at 4:24 AM Caizhi Weng wrote: > Hi! > > There is only one classloa

Re: dataStream can not use multiple classloaders

2021-10-17 Thread Caizhi Weng
Hi! There is only one classloader for user code by default in runtime. The main method of your code is only executed on the client side. It generates a job graph and sends it to the cluster. To avoid class loading conflict it is recommended to shade the dependencies of your source and sink functi

dataStream can not use multiple classloaders

2021-10-16 Thread 百岁
TO: everyone I have create a dataStream demo as below,in the demo,create a very simple example, read stream data from sourceFunction,and send it to sinkFunction without any processing. The point is,by creating the instance of SourceFunction and SinkFunction has used two separately URLClassLoader

[jira] [Created] (FLINK-24558) dataStream can not use multiple classloaders

2021-10-14 Thread bai sui (Jira)
bai sui created FLINK-24558: --- Summary: dataStream can not use multiple classloaders Key: FLINK-24558 URL: https://issues.apache.org/jira/browse/FLINK-24558 Project: Flink Issue Type: Improvement