hive authorization problem

2017-06-21 Thread Namas Amitabha
Hi all, I met a problem with Hive Default Authorization - Legacy Mode, I tried to enable the authorization on hiveserver2, and this is my hive-site.xml in hiveserver2 conf: hive.security.authorization.

Controlling Number of small files while inserting into Hive table

2017-06-21 Thread Arpan Rajani
Hello everyone, I am sure many of you might have faced similar issue. We do "insert into 'target_table' select a,b,c from x where .." kind of queries for a nightly load. This insert goes in a new partition of the target_table. Now the concern is : *this inserts load hardly any data* ( I would s

Re: Hive query on ORC table is really slow compared to Presto

2017-06-21 Thread Mich Talebzadeh
With ORC tables have you tried set hive.vectorized.execution.enabled = true; set hive.vectorized.execution.reduce.enabled = true; SET hive.exec.parallel=true; -- set hive.optimize.ppd=true; HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcP

Re: Hive query on ORC table is really slow compared to Presto

2017-06-21 Thread Premal Shah
Gopal, Thanx for the debugging steps. Here's the output *hive> select count(1) as collisions, hash(ip) from table group by hash(ip) order by collisions desc limit 10;* 4 -1432955330 4 -317748560 4 -1460629578 4 1486313154 4 -320519155 4 1875999753 4 -141

Re: wrong result with CTAS(create table as select)

2017-06-21 Thread Barna Zsombor Klara
Hi Xiaomeng, this definitely seems like a bug, but I can't reproduce it on the master branch. Can you tell me which version of Hive you are using? On Wed, Jun 21, 2017 at 10:26 AM, Xiaomeng Huang wrote: > Hi, I missed a bug when use CTAS. > > 1. > hive> select 'test' as did from abc_test_old >

wrong result with CTAS(create table as select)

2017-06-21 Thread Xiaomeng Huang
Hi, I missed a bug when use CTAS. 1. hive> select 'test' as did from abc_test_old > where did = '5FCAFD34-C124-4E13-AF65-27B675C945CC' limit 1; OK test 2. hive> create table abc_test_12345 as > select 'test' as did from abc_test_old > where did = '5FCAFD34-C124-4E13-AF65-27B675C945CC