Re: Java SPI jar reload in Spark

2017-06-07 Thread Ryan
dea to do something like > this, I just want to provide a approach to enable users can customize for > their business logic. > > Regards > 李忠双 / Jonnas > > 发件人: Zhongshuang Li > 日期: 2017年6月6日 星期二 下午6:30 > 至: Alonso Isidoro Roman > > 抄送: Jörn Franke

Re: Java SPI jar reload in Spark

2017-06-07 Thread Jonnas Li(Contractor)
nfra...@gmail.com>>, "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> 主题: Re: Java SPI jar reload in Spark I used java.util.ServiceLoader<https://docs.oracle.com/javase/7/docs/api/java/util/ServiceLoader.html> , as the javadoc

Re: Java SPI jar reload in Spark

2017-06-06 Thread Jonnas Li(Contractor)
6月6日 星期二 下午6:21 至: Zhongshuang Li mailto:zhongshuang...@envisioncn.com>> 抄送: Jörn Franke mailto:jornfra...@gmail.com>>, "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> 主题: Re: Java SPI jar reload in Spark Hi, a quick search o

Re: Java SPI jar reload in Spark

2017-06-06 Thread Alonso Isidoro Roman
6日 星期二 下午5:55 > 至: Zhongshuang Li > 抄送: "user@spark.apache.org" > 主题: Re: Java SPI jar reload in Spark > > Why do you need jar reloading? What functionality is executed during jar > reloading. Maybe there is another way to achieve the same without jar > reloading.

Re: Java SPI jar reload in Spark

2017-06-06 Thread Jonnas Li(Contractor)
ser@spark.apache.org>" mailto:user@spark.apache.org>> 主题: Re: Java SPI jar reload in Spark Why do you need jar reloading? What functionality is executed during jar reloading. Maybe there is another way to achieve the same without jar reloading. In fact, it might be dangero

Re: Java SPI jar reload in Spark

2017-06-06 Thread Jörn Franke
Why do you need jar reloading? What functionality is executed during jar reloading. Maybe there is another way to achieve the same without jar reloading. In fact, it might be dangerous from a functional point of view- functionality in jar changed and all your computation is wrong. > On 6. Jun 2

Java SPI jar reload in Spark

2017-06-06 Thread Jonnas Li(Contractor)
I have a Spark Streaming application, which dynamically calling a jar (Java SPI), and the jar is called in a mapWithState() function, it was working fine for a long time. Recently, I got a requirement which required to reload the jar during runtime. But when the reloading is completed, the spark