Hello. I have an issue with CustomKryoRegistrator, which causes ClassNotFound on Worker. The issue is resolved if call SparkConf.setJar with path to the same jar I run.
It is a workaround, but it requires to specify the same jar file twice. The first time I use it to actually run the job, and second time in properties file, which looks weird and unclear to as why I should do that. What is the reason for it? I thought the jar file has to be copied into all Worker nodes (or else it’s not possible to run the job on Wokrers). Can anyone shed some light on this? Thanks -- Eugene Morozov fathers...@list.ru
