Re: NullPointerException when connecting from Spark to a Hive table backed by HBase

gt;> But, do you know how I am supposed to set that table name on the jobConf? >> I >> don't have access to that object from my client driver? >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.

Re: NullPointerException when connecting from Spark to a Hive table backed by HBase

that object from my client driver? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/NullPointerException-when-connecting-from-Spark-to-a-Hive-table-backed-by-HBase-tp12284p12331.html > Sent from the Apache Spark User L

Re: NullPointerException when connecting from Spark to a Hive table backed by HBase

-from-Spark-to-a-Hive-table-backed-by-HBase-tp12284p12331.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: u

Re: NullPointerException when connecting from Spark to a Hive table backed by HBase

Looks like hbaseTableName is null, probably caused by incorrect configuration. String hbaseTableName = jobConf.get(HBaseSerDe.HBASE_TABLE_NAME); setHTable(new HTable(HBaseConfiguration.create(jobConf), Bytes.toBytes(hbaseTableName))); Here is the definition. public static final Strin

Re: NullPointerException when connecting from Spark to a Hive table backed by HBase

I removed the JAR that you suggested but now I get another error when I try to create the HiveContext. Here is the error: scala> val hiveContext = new HiveContext(sc) error: bad symbolic reference. A signature in HiveContext.class refers to term ql in package org.apache.hadoop.hive which is not av

Re: NullPointerException when connecting from Spark to a Hive table backed by HBase

Then definitely its a jar conflict. Can you try removing this jar from the class path /opt/spark-poc/lib_managed/jars/org.spark-project.hive/hive-exec/ hive-exec-0.12.0.jar Thanks Best Regards On Mon, Aug 18, 2014 at 12:45 PM, Cesar Arevalo wrote: > Nope, it is NOT null. Check this out: > > sc

Re: NullPointerException when connecting from Spark to a Hive table backed by HBase

Nope, it is NOT null. Check this out: scala> hiveContext == null res2: Boolean = false And thanks for sending that link, but I had already looked at it. Any other ideas? I looked through some of the relevant Spark Hive code and I'm starting to think this may be a bug. -Cesar On Mon, Aug 18,

Re: NullPointerException when connecting from Spark to a Hive table backed by HBase

Looks like your hiveContext is null. Have a look at this documentation. Thanks Best Regards On Mon, Aug 18, 2014 at 12:09 PM, Cesar Arevalo wrote: > Hello: > > I am trying to setup Spark to connect to a Hive table wh

NullPointerException when connecting from Spark to a Hive table backed by HBase

Hello: I am trying to setup Spark to connect to a Hive table which is backed by HBase, but I am running into the following NullPointerException: scala> val hiveCount = hiveContext.sql("select count(*) from dataset_records").collect().head.getLong(0) 14/08/18 06:34:29 INFO ParseDriver: Parsing com