Thanks Josh, created https://issues.apache.org/jira/browse/SPARK-12166



On Mon, Dec 7, 2015 at 4:32 AM, Josh Rosen <joshro...@databricks.com> wrote:

> I agree that we should unset this in our tests. Want to file a JIRA and
> submit a PR to do this?
>
> On Thu, Dec 3, 2015 at 6:40 PM Jeff Zhang <zjf...@gmail.com> wrote:
>
>> I try to do test on HiveSparkSubmitSuite on local box, but fails. The
>> cause is that spark is still using my local single node cluster hadoop when
>> doing the unit test. I don't think it make sense to do that. These
>> environment variable should be unset before the testing. And I suspect
>> dev/run-tests also
>> didn't do that either.
>>
>> Here's the error message:
>>
>> Cause: java.lang.RuntimeException: java.lang.RuntimeException: The root
>> scratch dir: /tmp/hive on HDFS should be writable. Current permissions are:
>> rwxr-xr-x
>> [info]   at
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
>> [info]   at
>> org.apache.spark.sql.hive.client.ClientWrapper.<init>(ClientWrapper.scala:171)
>> [info]   at
>> org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveContext.scala:162)
>> [info]   at
>> org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:160)
>>
>>
>>
>> --
>> Best Regards
>>
>> Jeff Zhang
>>
>


-- 
Best Regards

Jeff Zhang

Reply via email to