Re: Delete hive partition while executing query.

2016-06-09 Thread Igor Kuzmenko
Wednesday, June 8, 2016 at 7:30 AM > To: "user@hive.apache.org" > Subject: Re: Delete hive partition while executing query. > > Hi, thanks for reply, Alan. > Here's one more test. > > Wed Jun 08 16:36:02 MSK 2016 Start thread 1 > Wed Jun 08 16:36:05 MSK 2016 St

Re: Delete hive partition while executing query.

2016-06-08 Thread Eugene Koifman
quot; mailto:user@hive.apache.org>> Subject: Re: Delete hive partition while executing query. Hi, thanks for reply, Alan. Here's one more test. Wed Jun 08 16:36:02 MSK 2016 Start thread 1 Wed Jun 08 16:36:05 MSK 2016 Start thread 2 Wed Jun 08 16:36:08 MSK 2016 Start thread 3 Wed Jun 08 1

Re: Delete hive partition while executing query.

2016-06-08 Thread Igor Kuzmenko
Hi, thanks for reply, Alan. Here's one more test. Wed Jun 08 16:36:02 MSK 2016 Start thread 1 Wed Jun 08 16:36:05 MSK 2016 Start thread 2 Wed Jun 08 16:36:08 MSK 2016 Start thread 3 Wed Jun 08 16:36:11 MSK 2016 Start thread 4 Wed Jun 08 16:36:17 MSK 2016 Finish thread 1 Wed Jun 08 16:36:17 MSK 201

Re: Delete hive partition while executing query.

2016-06-07 Thread Alan Gates
Eugene Koifman pointed out to me that there is one other possibility. If we ignore query 3 for a minute, I can explain this with the following timeline: 1) Query one requests and gets a read lock, starts its select. 2) Query two (alter table…) requests an exclusive lock, and then blocks until q

Re: Delete hive partition while executing query.

2016-06-07 Thread Igor Kuzmenko
- hive.support.concurrency – true - hive.enforce.bucketing

Re: Delete hive partition while executing query.

2016-06-06 Thread Alan Gates
Do you have the system configured to use the DbTxnManager? See https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration for details on how to set this up. The transaction manager is what manages locking and makes sure that your queries don’t stomp each

Delete hive partition while executing query.

2016-06-06 Thread Igor Kuzmenko
Hello, I'm trying to find a safe way to delete partition with all data it includes. I'm using Hive 1.2.1, Hive JDBC driver 1.2.1 and perform simple test on transactional table: asyncExecute("Select count(distinct in_info_msisdn) from mobile_connections where dt=20151124 and msisdn_last_digit=2",