RE: Driver crash at the end with InvocationTargetException when running SparkPi

2015-06-08 Thread Dong Lei
Thanks Akhil so such! It turns out to be HADOOP_HOME not set. Dong Lei From: Akhil Das [mailto:ak...@sigmoidanalytics.com] Sent: Monday, June 8, 2015 3:12 PM To: Dong Lei Cc: user@spark.apache.org Subject: Re: Driver crash at the end with InvocationTargetException when running SparkPi Can you

Re: Driver crash at the end with InvocationTargetException when running SparkPi

2015-06-08 Thread Akhil Das
Can you look in your worker logs for more detailed stack-trace? If its about winutils.exe you can look at these links to get it resolved. - http://qnalist.com/questions/4994960/run-spark-unit-test-on-windows-7 - https://issues.apache.org/jira/browse/SPARK-2356 Thanks Best Regards On Mon, Jun 8,

Driver crash at the end with InvocationTargetException when running SparkPi

2015-06-07 Thread Dong Lei
Hi spark users: After I submitted a SparkPi job to spark, the driver crashed at the end of the job with the following log: WARN EventLoggingListener: Event log dir file:/d:/data/SparkWorker/work/driver-20150607200517-0002/logs/event does not exists, will newly create one. Exception in thread "