[
https://issues.apache.org/jira/browse/HIVE-8503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Friedrich updated HIVE-8503:
-----------------------------------
Description:
The tests
empty_dir_in_table
temp_table_external
load_hdfs_file_with_space_in_the_name
external_table_with_space_in_location_path
schemeAuthority2
create directories in HDFS, but TestSparkCliDriver is not using HDFS.
That's why the tests fail when creating a dir, for example mkdir -p
hdfs:///tmp/temp_table_external
In the non-spark case, these tests are executed with the TestMinimrCliDriver
which initializes Hadoop and created a mini-cluster
(see configuration in itests/qtest/pom.xml).
We may need to configure a TestSparkMinimrCliDriver in
itests/qtest-spark/pom.xml if we want to run these test cases.
was:
The 3 tests
temp_table_external
load_hdfs_file_with_space_in_the_name
external_table_with_space_in_location_path
create directories in HDFS, but TestSparkCliDriver is not using HDFS.
That's why the tests fail when creating a dir, for example mkdir -p
hdfs:///tmp/temp_table_external
In the non-spark case, these tests are executed with the TestMinimrCliDriver
which initializes Hadoop and created a mini-cluster
(see configuration in itests/qtest/pom.xml).
We may need to configure a TestSparkMinimrCliDriver in
itests/qtest-spark/pom.xml if we want to run these test cases.
> UT: add TestSparkMinimrCliDriver to run UTs that use HDFS
> ---------------------------------------------------------
>
> Key: HIVE-8503
> URL: https://issues.apache.org/jira/browse/HIVE-8503
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Thomas Friedrich
> Assignee: Thomas Friedrich
> Priority: Minor
>
> The tests
> empty_dir_in_table
> temp_table_external
> load_hdfs_file_with_space_in_the_name
> external_table_with_space_in_location_path
> schemeAuthority2
> create directories in HDFS, but TestSparkCliDriver is not using HDFS.
> That's why the tests fail when creating a dir, for example mkdir -p
> hdfs:///tmp/temp_table_external
> In the non-spark case, these tests are executed with the TestMinimrCliDriver
> which initializes Hadoop and created a mini-cluster
> (see configuration in itests/qtest/pom.xml).
> We may need to configure a TestSparkMinimrCliDriver in
> itests/qtest-spark/pom.xml if we want to run these test cases.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
