Build Spark 1.2.0-rc1 encounter exceptions when running HiveContext - Caused by: java.lang.ClassNotFoundException: com.esotericsoftware.shaded.org.objenesis.strategy.InstantiatorStrategy

Hi All, I tried to include necessary libraries in SPARK_CLASSPATH in spark-env.sh to include auxiliaries JARs and datanucleus*.jars from Hive, however, when I run HiveContext, it gives me the following error: Caused by: java.lang.ClassNotFoundException: com.esotericsoftware.shaded.org.objenesis.

RE: Build Spark 1.2.0-rc1 encounter exceptions when running HiveContext - Caused by: java.lang.ClassNotFoundException: com.esotericsoftware.shaded.org.objenesis.strategy.InstantiatorStrategy

Apologize for the format, somehow it got messed up and linefeed were removed. Here's a reformatted version. Hi All, I tried to include necessary libraries in SPARK_CLASSPATH in spark-env.sh to include auxiliaries JARs and datanucleus*.jars from Hive, however, when I run HiveContext, it gives me

RE: Build Spark 1.2.0-rc1 encounter exceptions when running HiveContext - Caused by: java.lang.ClassNotFoundException: com.esotericsoftware.shaded.org.objenesis.strategy.InstantiatorStrategy

hrough the actual classpath and make sure you aren't > including your own hive-exec jar somehow. > > - Patrick > > On Wed, Dec 10, 2014 at 9:48 AM, Andrew Lee wrote: > > Apologize for the format, somehow it got messed up and linefeed were > > removed. Here'

Spark ThriftServer encounter java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

When Kerberos is enabled, I get the following exceptions. (Spark 1.2.1 git commit b6eaf77d4332bfb0a698849b1f5f917d20d70e97, Hive 0.13.1, Apache Hadoop 2.4.1) when starting Spark ThriftServer. Command to start thriftserver ./start-thriftserver.sh --hiveconf hive.server2.thrift.port=2

RE: Spark ThriftServer encounter java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

ntegration test suites, and it's possible that > HiveThriftServer2 somehow breaks Hive's KRB feature. > > Cheng > > On 3/14/15 3:43 AM, Andrew Lee wrote: > > When Kerberos is enabled, I get the following exceptions. (Spark 1.2.1 git > > commit > > > &g

Spark 1.4.2 release and votes conversation?

Hi All, I'm wondering if Spark 1.4.2 had been voted by any chance or if I have overlooked and we are targeting 1.4.3? By looking at the JIRA https://issues.apache.org/jira/browse/SPARK/fixforversion/12332833/?selectedTab=com.atlassian.jira.jira-projects-plugin:version-summary-panel All issu

Re: Spark 1.4.2 release and votes conversation?

I did, and it passes all of our test case, so I'm wondering what did I miss. I know there is the memory leak spill JIRA SPARK-11293, but not sure if that will go in 1.4.2 or 1.4.3, etc. From: Reynold Xin Sent: Friday, November 13, 2015 1:31 PM To: Andre

Spark 1.6: Why Including hive-jdbc in assembly when -Phive-provided is set?

Hi All, I have a question regarding the hive-jdbc library that is being included in the assembly JAR. Build command. mvn -U -X -Phadoop-2.6 -Phadoop-provided -Phive-provided -Pyarn -Phive-thriftserver -Psparkr -DskipTests install In the pom.xml file, the scope for hive JARs are set to 'com

RE: Working Formula for Hive 0.13?

>From my perspective, there're few benefits regarding Hive 0.13.1+. The >following are the 4 major ones that I can see why people are asking to upgrade >to Hive 0.13.1 recently. 1. Performance and bug fix, patches. (Usual case) 2. Native support for Parquet format, no need to provide custom JARs