Mykhailo Kysliuk created HIVE-19911:
---------------------------------------
Summary: Hive delete queries fail with Invalid table alias or
column reference
Key: HIVE-19911
URL: https://issues.apache.org/jira/browse/HIVE-19911
Project: Hive
Issue Type: Bug
Affects Versions: 2.3.3
Reporter: Mykhailo Kysliuk
Env:
hadoop-2.7.0
hive-2.3.3
OS:
centos-release-7-5.1804.el7.centos.x86_64
Steps to reproduce (at hive cli):
{code}
set hive.support.concurrency=true;
set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
DROP TABLE IF EXISTS detaillineitem_all;
DROP TABLE IF EXISTS detaillineitem_all_delete_1526330755128;
CREATE TABLE `detaillineitem_all`(
`detailid` decimal(20,0),
`branchnumber` varchar(3)
) PARTITIONED BY (
`branchnumber_p` varchar(3))
CLUSTERED BY (
detailid)
INTO 25 BUCKETS
STORED AS ORC
TBLPROPERTIES (
'orc.compress'='NONE',
'transactional'='true');
CREATE TABLE `detaillineitem_all_delete_1526330755128`(
`detailid` decimal(20,0),
`branchnumber` varchar(3),
`branchnumber_p` varchar(3));
DELETE from detaillineitem_all WHERE EXISTS (
SELECT
1
FROM
detaillineitem_all_delete_1526330755128 AS t1
WHERE
(detaillineitem_all.detailid = t1.detailid)
AND
(detaillineitem_all.branchnumber = CAST(t1.branchnumber AS STRING)));
{code}
Exception:
{code}
2018-06-15T16:51:48,625 ERROR [f6bd86a7-04e5-4284-9031-3b9a0ccc80f3 main]
ql.Driver: FAILED: SemanticException Line 0:-1 Invalid table alias or column
reference 'sq_1': (possible column names are: mber)) sq_corr_1)) (tok_where (=
1 1), (. (tok_table_or_col sq_1) sq_corr_1))
org.apache.hadoop.hive.ql.parse.SemanticException: Line 0:-1 Invalid table
alias or column reference 'sq_1': (possible column names are: mber))
sq_corr_1)) (tok_where (= 1 1), (. (tok_table_or_col sq_1) sq_corr_1))
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genAllExprNodeDesc(SemanticAnalyzer.java:11620)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:11568)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:11536)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:11514)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genMapGroupByForSemijoin(SemanticAnalyzer.java:8416)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genJoinOperator(SemanticAnalyzer.java:8305)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genFilterPlan(SemanticAnalyzer.java:3278)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:9592)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:10549)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:10427)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genOPTree(SemanticAnalyzer.java:11125)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:11138)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10807)
at
org.apache.hadoop.hive.ql.parse.UpdateDeleteSemanticAnalyzer.analyzeInternal(UpdateDeleteSemanticAnalyzer.java:73)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258)
at
org.apache.hadoop.hive.ql.parse.UpdateDeleteSemanticAnalyzer.reparseAndSuperAnalyze(UpdateDeleteSemanticAnalyzer.java:462)
at
org.apache.hadoop.hive.ql.parse.UpdateDeleteSemanticAnalyzer.analyzeDelete(UpdateDeleteSemanticAnalyzer.java:111)
at
org.apache.hadoop.hive.ql.parse.UpdateDeleteSemanticAnalyzer.analyzeInternal(UpdateDeleteSemanticAnalyzer.java:81)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:512)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1457)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:686)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
{code}
After some debugging, I investigated that start and end indexes of ASTNode to
retrieve string is incorrect. It happens at genFilterPlan after rewriting the
where expression. When ASTNode tries to retrieve string representation of
current node it returns incorrect string because of incorrect indexes and
therefore the query crashes.
If we rewrite the astStr inside debugging, then all query string becomes
correct and query runs fine.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
