[ 
https://issues.apache.org/jira/browse/HIVE-5405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784449#comment-13784449
 ] 

Thejas M Nair commented on HIVE-5405:
-------------------------------------

Sorry, that patch does not work with 0.12 . Looks like CommonToken is not used 
in 0.12 .  Do we need this patch for 0.12 ?

{code}
compile:
     [echo] Project: ql
    [javac] Compiling 922 source files to 
/home/hortonth/hive_apache/build/ql/classes
    [javac] 
/home/hortonth/hive_apache/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java:464:
 cannot find symbol
    [javac] symbol  : class CommonToken
    [javac] location: class 
org.apache.hadoop.hive.ql.exec.Utilities.CommonTokenDelegate
    [javac]       CommonToken ct = (CommonToken)oldInstance;
    [javac]       ^
    [javac] 
/home/hortonth/hive_apache/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java:464:
 cannot find symbol
    [javac] symbol  : class CommonToken
    [javac] location: class 
org.apache.hadoop.hive.ql.exec.Utilities.CommonTokenDelegate
    [javac]       CommonToken ct = (CommonToken)oldInstance;
    [javac]                         ^
    [javac] 
/home/hortonth/hive_apache/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java:466:
 internal error; cannot instantiate java.beans.Expression.<init> at 
java.beans.Expression to ()
    [javac]       return new Expression(ct, ct.getClass(), "new", args);
    [javac]              ^
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] 3 errors

{code}

> Need to implement PersistenceDelegate for org.antlr.runtime.CommonToken
> -----------------------------------------------------------------------
>
>                 Key: HIVE-5405
>                 URL: https://issues.apache.org/jira/browse/HIVE-5405
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.12.0
>            Reporter: shanyu zhao
>            Assignee: shanyu zhao
>             Fix For: 0.13.0
>
>         Attachments: HIVE-5405-branch-0.12.patch, HIVE-5405.patch
>
>
> Prior to HIVE-1511, running hive join operation results in the following 
> exception:
> java.lang.RuntimeException: Cannot serialize object
>         at 
> org.apache.hadoop.hive.ql.exec.Utilities$1.exceptionThrown(Utilities.
> java:639)
>         at java.beans.XMLEncoder.writeStatement(XMLEncoder.java:426)
> ...
> Caused by: java.lang.InstantiationException: org.antlr.runtime.CommonToken
>         at java.lang.Class.newInstance0(Class.java:357)
>         at java.lang.Class.newInstance(Class.java:325)
>         at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
>         at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:43)
> HIVE-1511 introduced a new (and set to default) hive plan serialization 
> format Kryo, which fixed this problem by implementing the Kryo serializer for 
> CommonToken. However, if we set the following in configuration file:
> <property>
> <name>hive.plan.serialization.format</name>
> <value>javaXML</value>
> </property>
> We'll see the same failure as before. We need to implement a 
> PersistenceDelegate for the situation when "javaXML" is set to serialization 
> format.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to