Re: Help with 'alter is not possible' in metastore

2016-09-13 Thread Gopal Vijayaraghavan
> java.sql.SQLException: Error while processing statement: FAILED: Execution > Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Unable to > alter partition. alter is not possible > Altering works fine in a test table in our dev env. The logs here aren't too > helpful. The hi

Help with 'alter is not possible' in metastore

2016-09-13 Thread Thomas Sun
Hi, We have an external table where we need to manually fix a corrupted location path for a few of its partitions. After successfully disabling security, I run into the following error when doing an alter table: Error: Error while processing statement: FAILED: Execution Error, return code 1 from

What's the best way to find the nearest neighbor in Hive? Any windowing function?

2016-09-13 Thread Mobius ReX
Given a table > $cat data.csv > > ID,State,City,Price,Number,Flag > 1,CA,A,100,1000,0 > 2,CA,A,96,1010,1 > 3,CA,A,195,1010,1 > 4,NY,B,124,2000,0 > 5,NY,B,128,2001,1 > 6,NY,C,24,3,0 > 7,NY,C,27,30100,1 > 8,NY,C,29,30200,0 > 9,NY,C,39,33000,1 Expecte

Re: HiveServer2 thrift service thread pool error

2016-09-13 Thread Vihang Karajgaonkar
It means that TThreadpoolServer in the HS2 does not have enough worker threads to execute the client request. I see that pool size = 1 in the error message below. What is the value of configuration variables hive.server2.thrift.min.worker.threads and hive.server2.thrift.max.worker.threads in yo

Re: Working of HiveServer2

2016-09-13 Thread Mich Talebzadeh
Hi, Hive server 2 requests Hive to execute the code and Hive uses whatever engine set (MR, Spark, etc) in hive-site.xml to execute the code and returns the result set. Hive Thrift server running on a given port is the gateway but the work done is performed by Hive optimizer and Hive execution eng

Working of HiveServer2

2016-09-13 Thread Srinivasan Hariharan02
Hi, I am I process of analyzing hiveserver2 code to identify how the hiveserver 2 executes the query and returns back the result. There are two classes CliService.java nad SQLOperation.Java which has executeStatement, executeStatementSync and runQuery respectively. From one of these methods hi

HiveServer2 thrift service thread pool error

2016-09-13 Thread Andrew Sears
Hi everyone,We have Hive 1.2.1.2.3 Thrift service installed with Atlas Plugin, Ranger Plugin. After some days, we exhaust the running threads, receive an error such as below in the logs and the service stops responding, requiring a restart.org.apache.hive.service.cli.HiveSQLException: Error while