Re: Re: [Questio]Which record does Hive give the bigger number when I use row_number

2017-10-12 Thread 孙志禹
#yiv2801412653 body {line-height:1.5;}#yiv2801412653 blockquote {margin-top:0px;margin-bottom:0px;margin-left:0.5em;}#yiv2801412653 body {font-size:11pt;color:rgb(0, 0, 0);line-height:1.5;}#yiv2801412653 body {font-size:11pt;color:rgb(0, 0, 0);line-height:1.5;}Thanks a lot! It helps me so much.

Re: Hive locking mechanism on read partition.

2017-10-12 Thread Eugene Koifman
Which lock manager are you using? Do you have acid enabled and if so are these tables transactional? Eugene From: Igor Kuzmenko Reply-To: "user@hive.apache.org" Date: Thursday, October 12, 2017 at 3:58 AM To: "user@hive.apache.org" Subject: Hive locking mechanism on read partition. Hello, I'

Re: How to measure the execution time of query on Hive on Tez

2017-10-12 Thread Prasanth Jayachandran
Hi There are couple of tables that you are seeing, the top one is Query Execution Summary and next one is Task Execution Summary. At the end of your query execution, you should see something like "Time taken: xx.xx seconds” in hive CLI or beeline. This represents the overall time the query too

RE: How to measure the execution time of query on Hive on Tez

2017-10-12 Thread Zhang, Liyun
Hi all: Maybe in last mail the attached picture is not shown. I re-described my question here. I saw following statistics about the runtime when running query. The Run DAG is 318s. But it is not the sum of DURATION of all VERTICES((59549+4069+3055+3055+1004+1006+132736+34248+11077+1003+439+

Hive and Schema Registry

2017-10-12 Thread Stephen Durfey
Recently my team has opened a discussion with Confluent [1] in regards to the schema registry being used to serve up avro schemas for the Hive AvroSerDe to make use of through 'avro.schema.url' config. Originally we were hoping to just get a REST endpoint that returns just the schema to avoid makin

Re: Hive locking mechanism on read partition.

2017-10-12 Thread Furcy Pin
According to the documentation link you gave: "A 'S' lock on table and relevant partition is acquired when a read is being performed. For all other operations, an 'X' lock is taken on the partition. However, if the change is only applicable to the newer partitions, a 'S' lock is acquired on the ta

Hive locking mechanism on read partition.

2017-10-12 Thread Igor Kuzmenko
Hello, I'm using HDP 2.5.0.0 with included hive 1.2.1. And I have problem with locking mechanism. Most of my queries to hive looks like this. *(1)insert into table results_table partition(task_id=${task_id})* *select * from data_table where ;* results_table partitioned by task_