Michael Haeusler created HIVE-10988:
---------------------------------------

             Summary: Table bucketing should work fields within structs
                 Key: HIVE-10988
                 URL: https://issues.apache.org/jira/browse/HIVE-10988
             Project: Hive
          Issue Type: Improvement
    Affects Versions: 1.2.0
         Environment: HDP-2.3-TP
            Reporter: Michael Haeusler


Hive should support bucketing on fields within structs.

It is not supported in version up to 1.2.0. Trying to do so causes a 
ParseException:
{code}
hive> CREATE TABLE foo (bar struct<a:string,b:string>)
    > CLUSTERED BY (bar.a) INTO 32 buckets;
MismatchedTokenException(17!=307)
        at 
org.antlr.runtime.BaseRecognizer.recoverFromMismatchedToken(BaseRecognizer.java:617)
        at org.antlr.runtime.BaseRecognizer.match(BaseRecognizer.java:115)
        at 
org.apache.hadoop.hive.ql.parse.HiveParser.tableBuckets(HiveParser.java:32552)
        at 
org.apache.hadoop.hive.ql.parse.HiveParser.createTableStatement(HiveParser.java:5299)
        at 
org.apache.hadoop.hive.ql.parse.HiveParser.ddlStatement(HiveParser.java:2640)
        at 
org.apache.hadoop.hive.ql.parse.HiveParser.execStatement(HiveParser.java:1650)
        at 
org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:1109)
        at 
org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:202)
        at 
org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:166)
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:396)
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)
        at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122)
        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)
        at 
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213)
        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165)
        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
        at 
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
FAILED: ParseException line 2:17 mismatched input '.' expecting ) near 'bar' in 
table buckets specification
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to