In that case, can you use the configurations to specify the folders? I'm
wondering if this actually Hive in play here and somehow the
/tmp/spark-events is being specified for the logs for Hive?
On Mon, Mar 23, 2015 at 2:00 PM Anubhav Agarwal wrote:
> When I start spark-shell (for example) it do
When I start spark-shell (for example) it does not write to the
/tmp/spark-events folder. It remains empty. I have even tried it after
giving that folder rwx permission for user, group and others.
Neil's colleague,
Anu
On Mon, Mar 23, 2015 at 4:50 PM, Denny Lee wrote:
> When you say the job has
When you say the job has access, do you mean that when you run spark-submit
or spark-shell (for example), it is able to write to the /tmp/spark-events
folder?
On Mon, Mar 23, 2015 at 1:02 PM Neil Dev wrote:
> we are running this right now as root user and the folder /tmp/spark-events
> was manu
we are running this right now as root user and the folder /tmp/spark-events
was manually created and the Job has access to this folder
On Mon, Mar 23, 2015 at 3:38 PM, Denny Lee wrote:
> It appears that you are running the thrift-server using the spark-events
> account but the /tmp/spark-events
It appears that you are running the thrift-server using the spark-events
account but the /tmp/spark-events folder doesn't exist or the user running
thrift-server does not have access to it. Have you been able to run Hive
using the spark-events user so that way the /tmp/spark-events folder has
been
