[
https://issues.apache.org/jira/browse/SPARK-18941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772224#comment-15772224
]
luat commented on SPARK-18941:
------------------------------
Hi [~dongjoon],
It is ok.
But I think that this difference should be documented.
For some historical reasons, we're using 'create table ... location' for all
our ETL jobs to create Hive table (not External table). I saw that, it still
works well on Spark 1.6.3 (the directory associated with the hive table will be
deleted when we drop table).
We'll consider changing our ETL jobs to work correctly on Spark 2.0, too.
Thank for your support.
> Spark thrift server, Spark 2.0.2, The "drop table" command doesn't delete the
> directory associated with the Hive table (not EXTERNAL table) from the HDFS
> file system
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-18941
> URL: https://issues.apache.org/jira/browse/SPARK-18941
> Project: Spark
> Issue Type: Bug
> Components: Java API
> Affects Versions: 2.0.2
> Reporter: luat
>
> Spark thrift server, Spark 2.0.2, The "drop table" command doesn't delete the
> directory associated with the Hive table (not EXTERNAL table) from the HDFS
> file system.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
