Re: Drop table and Hive warehouse

2015-08-24 Thread Kevin Jung
files in HDFS2. So I can not reproduce a table with same location and same name. If I update DBS table in metastoredb to set default database URI to HDFS1, it works perfectly. Kevin --- Original Message --- Sender : Michael Armbrust Date : 2015-08-25 00:43 (GMT+09:00) Title : Re: Drop

Re: Drop table and Hive warehouse

2015-08-24 Thread Michael Armbrust
Thats not the expected behavior. What version of Spark? On Mon, Aug 24, 2015 at 1:32 AM, Kevin Jung wrote: > When I store DataFrame as table with command "saveAsTable" and then > execute "DROP TABLE" in SparkSQL, it doesn't actually delete files in hive > warehouse. > The table disappears from

Drop table and Hive warehouse

2015-08-24 Thread Kevin Jung
When I store DataFrame as table with command "saveAsTable" and then execute "DROP TABLE" in SparkSQL, it doesn't actually delete files in hive warehouse. The table disappears from a table list but the data files are still alive. Because of this, I can't saveAsTable with a same name before dropping