Re: dataStream can not use multiple classloaders

2021-10-18 Thread Arvid Heise
You also must ensure that your SourceFunction is serializable, so it's not enough to just refer to some classloader, you must ensure that you have access to it also after deserialization on the task managers. On Mon, Oct 18, 2021 at 4:24 AM Caizhi Weng wrote: > Hi! > > There is only one classloa

Re: dataStream can not use multiple classloaders

2021-10-17 Thread Caizhi Weng
Hi! There is only one classloader for user code by default in runtime. The main method of your code is only executed on the client side. It generates a job graph and sends it to the cluster. To avoid class loading conflict it is recommended to shade the dependencies of your source and sink functi