Hi Chanh, I had the sdame issue with oracle jdbc driver. So I have this in spark-submit
--jars /home/hduser/jars/ojdbc6.jar,/home/hduser/jars/jconn4.jar still getting errors. it happened after 1.6.1 upgrade. So I had to add these to conf/spark-defaults.conf spark.driver.extraClassPath /home/hduser/jars/ojdbc6.jar:/home/hduser/jars/jconn4.jar spark.executor.extraClassPath /home/hduser/jars/ojdbc6.jar:/home/hduser/jars/jconn4.jar and t works HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On 5 October 2016 at 11:32, Chanh Le <giaosu...@gmail.com> wrote: > Hi everyone, > I just wondering why when I run my program I need to add* jdbc.jar* into > *—driver-class-path* instead treat it like a dependency by* —jars.* > > My program works with these config > .*/bin/spark-submit --packages > org.apache.spark:spark-streaming-kafka_2.10:1.6.1 --master "local[4]" > --class com.ants.util.kafka.PersistenceData --driver-class-path > /Users/giaosudau/Downloads/postgresql-9.3-1102.jdbc41.jar > /Users/giaosudau/workspace/KafkaJobs/target/scala-2.10/kafkajobs-prod.jar* > > According by http://stackoverflow.com/a/30947090/523075 and > http://stackoverflow.com/a/31012955/523075 > > This is a bug related the the classloader > > > I checked this https://github.com/apache/spark/pull/6900 was merged. > > *I am using Spark 1.6.1 and by issue tell that already fixed in 1.4.1 and > 1.5* > > > Regards, > Chanh >
