-does-not-exist-error-while-it-does-with-all-the-req-rights-tp22308p25917.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands
FYI I wrote a small test to try to reproduce this, and filed
SPARK-6688 to track the fix.
On Tue, Mar 31, 2015 at 1:15 PM, Marcelo Vanzin wrote:
> Hmmm... could you try to set the log dir to
> "file:/home/hduser/spark/spark-events"?
>
> I checked the code and it might be the case that the behavio
Hmmm... could you try to set the log dir to
"file:/home/hduser/spark/spark-events"?
I checked the code and it might be the case that the behaviour changed
between 1.2 and 1.3...
On Mon, Mar 30, 2015 at 6:44 PM, Tom Hubregtsen wrote:
> The stack trace for the first scenario and your suggested imp
The stack trace for the first scenario and your suggested improvement is
similar, with as only difference the first line (Sorry for not including
this):
"Log directory /home/hduser/spark/spark-events does not exist."
To verify your premises, I cd'ed into the directory by copy pasting the
path list
So, the error below is still showing the invalid configuration.
You mentioned in the other e-mails that you also changed the
configuration, and that the directory really, really exists. Given the
exception below, the only ways you'd get the error with a valid
configuration would be if (i) the dire
ons:
> Set(hduser)"). I
> >> > am
> >> > able to cd into this directory. I can also create, view and delete
> files
> >> > in
> >> > this directory, logged in as hduser. I checked the folder, it is owned
> >> > by
> >> >
ry. I can also create, view and delete files
>> > in
>> > this directory, logged in as hduser. I checked the folder, it is owned
>> > by
>> > hduser. I even performed chmod 777, but Spark keeps on crashing when I
>> > run
>> > with spark.eventLog.e
ed in as hduser. I checked the folder, it is owned by
> > hduser. I even performed chmod 777, but Spark keeps on crashing when I
> run
> > with spark.eventLog.enabled. It works without. Any hints?
> >
> > Thanks,
> >
> > Tom
> >
> >
> >
folder, it is owned by
> hduser. I even performed chmod 777, but Spark keeps on crashing when I run
> with spark.eventLog.enabled. It works without. Any hints?
>
> Thanks,
>
> Tom
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n
n as hduser. I checked the folder, it is owned by
hduser. I even performed chmod 777, but Spark keeps on crashing when I run
with spark.eventLog.enabled. It works without. Any hints?
Thanks,
Tom
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-events-doe
10 matches
Mail list logo