Re: ALTER TABLE DROP PARTITION not working on S3

2018-04-05 Thread Furcy Pin
oop.hive.ql.io .orc.OrcSerde > InputFormat: org.apache.hadoop.hive.ql.io .orc.OrcInputFormat > OutputFormat: org.apache.hadoop.hive.ql.io .orc.OrcOutputFormat > Compressed: No > Num Buckets: 61 > Bucket Columns: [crs_id] > Sort Columns: [] > Storage Desc Params: > serializat

Re: ALTER TABLE DROP PARTITION not working on S3

2018-04-05 Thread Richard A. Bross
I can't duplicate the issue now. Works like it always has . . - Original Message - From: "Furcy Pin" To: user@hive.apache.org Sent: Thursday, April 5, 2018 9:57:39 AM Subject: Re: ALTER TABLE DROP PARTITION not working on S3 Indeed. If I remember correctly, s3 does

Re: ALTER TABLE DROP PARTITION not working on S3

2018-04-05 Thread Furcy Pin
61 > Bucket Columns: [crs_id] > Sort Columns: [] > Storage Desc Params: > serialization.format1 > Time taken: 0.467 seconds, Fetched: 98 row(s) > > > - Original Message - > From: "Furcy Pin" > To: user@hive.apache.org &

Re: ALTER TABLE DROP PARTITION not working on S3

2018-04-05 Thread Richard A. Bross
Storage Desc Params: serialization.format1 Time taken: 0.467 seconds, Fetched: 98 row(s) - Original Message - From: "Furcy Pin" To: user@hive.apache.org Sent: Thursday, April 5, 2018 9:21:06 AM Subject: Re: ALTER TABLE DROP PARTITION not working on

Re: ALTER TABLE DROP PARTITION not working on S3

2018-04-05 Thread Richard A. Bross
No definitely internal. It's loaded from an external table. - Original Message - From: "Furcy Pin" To: user@hive.apache.org Sent: Thursday, April 5, 2018 9:21:06 AM Subject: Re: ALTER TABLE DROP PARTITION not working on S3 Hi Richard, could you please check i

Re: ALTER TABLE DROP PARTITION not working on S3

2018-04-05 Thread Furcy Pin
Hi Richard, could you please check if your table is EXTERNAL? You can see it with a "DESCRIBE FORMATTED table_name ;" That's what external tables are for, they don't delete underlying data when you drop them. On 5 April 2018 at 15:18, Richard A. Bross wrote: > I think that someone put a file

Re: ALTER TABLE DROP PARTITION not working on S3

2018-04-05 Thread Richard A. Bross
I think that someone put a file in there manually. Would that prevent Hive from dropping the partition. I also did a "drop table" and the s3 object keys persisted. - Original Message - From: "Richard A. Bross" To: user@hive.apache.org Sent: Thursday, April 5, 2018 9:14:52 AM Subject: