[
https://issues.apache.org/jira/browse/IMPALA-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
woosuk.ro updated IMPALA-14551:
-------------------------------
Description:
* Summary
** When a complex expression that contains Unicode Letters is selected without
an alias, an error during alias mapping causes the query to hang before the
planning phase. CANCEL QUERY is ineffective.
* Environment
** Impala 4.4.0
** Apache Hive 3.1.3 (without HIVE-19064)
*** *Note on HIVE-19064*
CDP Hive (3.1.3000.x) includes
[HIVE-19064|https://github.com/apache/hive/commit/c3007d497ca58c595da8bd78455538a1ce0e3485]
which fixes {{allowQuotedId()}} to return a valid quotation style when hiveConf
is null. *So,* *This issue does NOT occur with CDP Hive.*
However, Apache Hive 3.1.3 does not include this patch.
** ANTLR runtime 3.3
* Steps to Reproduce
** In the SELECT list, use an expression containing Unicode Letters without an
alias.
** Example : `select 누적합 - lag (누적합) over (partition by day order by day) from
base`
* Actual Behavior
** During alias mapping, invoking HiveLexer triggers repeated retries without
consuming input, and the query hangs. Threads remain RUNNABLE and cannot be
canceled
* Call Stack (Thread RUNNABLE state)
{code:java}
"Thread-3474785" Id=3484730 RUNNABLE
...
at
org.antlr.runtime.RecognitionException.<init>(RecognitionException.java:102)
at
org.antlr.runtime.FailedPredicateException.<init>(FailedPredicateException.java:46)
at
org.apache.hadoop.hive.ql.parse.HiveLexer.mIdentifier(HiveLexer.java:9623)
at
org.apache.hadoop.hive.ql.parse.HiveLexer.mTokens(HiveLexer.java:12524)
at org.antlr.runtime.Lexer.nextToken(Lexer.java:89)
at
org.apache.impala.analysis.ToSqlUtils.hiveNeedsQuotes(ToSqlUtils.java:181)
...
at
org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:175)
{code}
was:
* Summary
** When a complex expression that contains Unicode Letters is selected without
an alias, an error during alias mapping causes the query to hang before the
planning phase. CANCEL QUERY is ineffective.
* Environment
** Impala 4.4.0
** Apache Hive 3.1.3 (without HIVE-19064)
*** *Note on HIVE-19064*
CDP Hive (3.1.3000.x) includes
[HIVE-19064|https://github.com/apache/hive/commit/c3007d497ca58c595da8bd78455538a1ce0e3485]
which fixes \{{allowQuotedId()}} to return a valid quotation style when
hiveConf is null.
However, Apache Hive 3.1.3 does not include this patch.
** ANTLR runtime 3.3
* Steps to Reproduce
** In the SELECT list, use an expression containing Unicode Letters without an
alias.
** Example : `select 누적합 - lag (누적합) over (partition by day order by day) from
base`
* Actual Behavior
** During alias mapping, invoking HiveLexer triggers repeated retries without
consuming input, and the query hangs. Threads remain RUNNABLE and cannot be
canceled
* Call Stack (Thread RUNNABLE state)
{code:java}
"Thread-3474785" Id=3484730 RUNNABLE
...
at
org.antlr.runtime.RecognitionException.<init>(RecognitionException.java:102)
at
org.antlr.runtime.FailedPredicateException.<init>(FailedPredicateException.java:46)
at
org.apache.hadoop.hive.ql.parse.HiveLexer.mIdentifier(HiveLexer.java:9623)
at
org.apache.hadoop.hive.ql.parse.HiveLexer.mTokens(HiveLexer.java:12524)
at org.antlr.runtime.Lexer.nextToken(Lexer.java:89)
at
org.apache.impala.analysis.ToSqlUtils.hiveNeedsQuotes(ToSqlUtils.java:181)
...
at
org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:175)
{code}
> Query hangs when selecting an expression that contains Unicode Letters
> -----------------------------------------------------------------------
>
> Key: IMPALA-14551
> URL: https://issues.apache.org/jira/browse/IMPALA-14551
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: woosuk.ro
> Assignee: woosuk.ro
> Priority: Major
> Fix For: Impala 4.4.0
>
>
> * Summary
> ** When a complex expression that contains Unicode Letters is selected
> without an alias, an error during alias mapping causes the query to hang
> before the planning phase. CANCEL QUERY is ineffective.
> * Environment
> ** Impala 4.4.0
> ** Apache Hive 3.1.3 (without HIVE-19064)
> *** *Note on HIVE-19064*
> CDP Hive (3.1.3000.x) includes
> [HIVE-19064|https://github.com/apache/hive/commit/c3007d497ca58c595da8bd78455538a1ce0e3485]
> which fixes {{allowQuotedId()}} to return a valid quotation style when
> hiveConf is null. *So,* *This issue does NOT occur with CDP Hive.*
> However, Apache Hive 3.1.3 does not include this patch.
> ** ANTLR runtime 3.3
> * Steps to Reproduce
> ** In the SELECT list, use an expression containing Unicode Letters without
> an alias.
> ** Example : `select 누적합 - lag (누적합) over (partition by day order by day)
> from base`
> * Actual Behavior
> ** During alias mapping, invoking HiveLexer triggers repeated retries
> without consuming input, and the query hangs. Threads remain RUNNABLE and
> cannot be canceled
> * Call Stack (Thread RUNNABLE state)
> {code:java}
> "Thread-3474785" Id=3484730 RUNNABLE
> ...
> at
> org.antlr.runtime.RecognitionException.<init>(RecognitionException.java:102)
> at
> org.antlr.runtime.FailedPredicateException.<init>(FailedPredicateException.java:46)
> at
> org.apache.hadoop.hive.ql.parse.HiveLexer.mIdentifier(HiveLexer.java:9623)
> at
> org.apache.hadoop.hive.ql.parse.HiveLexer.mTokens(HiveLexer.java:12524)
> at org.antlr.runtime.Lexer.nextToken(Lexer.java:89)
> at
> org.apache.impala.analysis.ToSqlUtils.hiveNeedsQuotes(ToSqlUtils.java:181)
> ...
> at
> org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:175)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
