is it working now?
On 1 May 2015 at 13:43, James King wrote:
> Oops! well spotted. Many thanks Shixiong.
>
> On Fri, May 1, 2015 at 1:25 AM, Shixiong Zhu wrote:
>
>> "spark.history.fs.logDirectory" is for the history server. For Spark
>> applications, they should use "spark.eventLog.dir". Since
Oops! well spotted. Many thanks Shixiong.
On Fri, May 1, 2015 at 1:25 AM, Shixiong Zhu wrote:
> "spark.history.fs.logDirectory" is for the history server. For Spark
> applications, they should use "spark.eventLog.dir". Since you commented out
> "spark.eventLog.dir", it will be "/tmp/spark-events
"spark.history.fs.logDirectory" is for the history server. For Spark
applications, they should use "spark.eventLog.dir". Since you commented out
"spark.eventLog.dir", it will be "/tmp/spark-events". And this folder does
not exits.
Best Regards,
Shixiong Zhu
2015-04-29 23:22 GMT-07:00 James King :
I'm unclear why I'm getting this exception.
It seems to have realized that I want to enable Event Logging but ignoring
where I want it to log to i.e. file:/opt/cb/tmp/spark-events which does
exist.
spark-default.conf
# Example:
spark.master spark://master1:7077,master2:7077
