[ 
https://issues.apache.org/jira/browse/HIVE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835709#comment-16835709
 ] 

Igor Bezuglyi commented on HIVE-21702:
--------------------------------------

>From the metastore log:

 

2019-05-08T15:58:49,663 DEBUG [pool-6-thread-6] pool.PoolBase: HikariPool-1 - 
Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1c8323b9
2019-05-08T15:58:49,664 ERROR [pool-6-thread-6] metastore.RetryingHMSHandler: 
MetaException(message:java.lang.UnsupportedOperationException)
 at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newMetaException(HiveMetaStore.java:7230)
 at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.rethrowException(HiveMetaStore.java:6256)
 at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:6240)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498)
 at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
 at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
 at com.sun.proxy.$Proxy33.get_partitions_by_expr(Unknown Source)
 at 
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(ThriftHiveMetastore.java:16801)
 at 
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(ThriftHiveMetastore.java:16785)
 at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
 at 
org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:111)
 at 
org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:107)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:422)
 at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682)
 at 
org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119)
 at 
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.UnsupportedOperationException
 at 
org.apache.hadoop.hive.metastore.DefaultPartitionExpressionProxy.convertExprToFilter(DefaultPartitionExpressionProxy.java:34)
 at 
org.apache.hadoop.hive.metastore.PartFilterExprUtil.makeExpressionTree(PartFilterExprUtil.java:50)
 at 
org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExprInternal(ObjectStore.java:3414)
 at 
org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExpr(ObjectStore.java:3405)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498)
 at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
 at com.sun.proxy.$Proxy32.getPartitionsByExpr(Unknown Source)
 at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:6235)
 ... 20 more

 

> Queries with filter on a partition column fail when using standalone metastore
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-21702
>                 URL: https://issues.apache.org/jira/browse/HIVE-21702
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2, Standalone Metastore
>    Affects Versions: 3.1.0
>         Environment: HDP 3.1 on AWS (Hive 3.1.0)
> Standalone metastore on an EC2 instance (using 
> hive-standalone-metastore-3.1.0.3.1.0.0-78.jar)
>            Reporter: Igor Bezuglyi
>            Priority: Major
>         Attachments: hiveserver_ex.log, metastore.log, table_data_a.csv
>
>
> Queries with filter on a partition column fail when using standalone metastore
> Example (Hiveserver2 is pointing to a standalone metastore instance)
>  {{create table test_a_src (id integer, value varchar(255), run_id 
> varchar(14)) }}{{row format delimited fields terminated by ','}}{{stored as 
> textfile;}}
> {{create table test_a (id integer, value varchar(255)) }}{{partitioned by 
> (run_id varchar(14))}}{{row format delimited fields terminated by 
> ','}}{{stored as textfile;}}
> {{<Upload a csv file to test_a_src data directory - test file is 
> }}{{attached>}}
> {{insert into test_a select * from test_a_src;}}
> {{select id from test_a where run_id = '20190502123500';}}
>  {{Error: Error while compiling statement: FAILED: SemanticException 
> MetaException(message:java.lang.UnsupportedOperationException) 
> (state=42000,code=40000)}}
> The same queries work fine when using the embedded metastore. Filters on any 
> other column work fine as well. The problem is with partition columns.
> An excerpt from hiveserver2.log is attached.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to