Re: [External] Re: Spark 1.6.0 HiveContext NPE

2016-02-08 Thread Shipper, Jay [USA]
mailto:user@spark.apache.org>> Subject: [External] Re: Spark 1.6.0 HiveContext NPE Was there any other exception(s) in the client log ? Just want to find the cause for this NPE. Thanks On Wed, Feb 3, 2016 at 8:33 AM, Shipper, Jay [USA] mailto:shipper_...@bah.com>> wrote: I’m upgr

Re: Spark 1.6.0 HiveContext NPE

2016-02-05 Thread Ted Yu
Was there any other exception(s) in the client log ? Just want to find the cause for this NPE. Thanks On Wed, Feb 3, 2016 at 8:33 AM, Shipper, Jay [USA] wrote: > I’m upgrading an application from Spark 1.4.1 to Spark 1.6.0, and I’m > getting a NullPointerException from HiveContext. It’s happe

Re: [External] Re: Spark 1.6.0 HiveContext NPE

2016-02-04 Thread Ted Yu
gt; wrote: >> >>> One quick update on this: The NPE is not happening with Spark 1.5.2, so >>> this problem seems specific to Spark 1.6.0. >>> >>> From: Jay Shipper >>> Date: Wednesday, February 3, 2016 at 12:06 PM >>> To: "user@spark

Re: [External] Re: Spark 1.6.0 HiveContext NPE

2016-02-03 Thread Ted Yu
h the > bug. > > From: Ted Yu > Date: Wednesday, February 3, 2016 at 3:57 PM > To: Jay Shipper > Cc: "user@spark.apache.org" > Subject: Re: [External] Re: Spark 1.6.0 HiveContext NPE > > In ClientWrapper.scala, the SessionState.get().getConf call might have

Re: [External] Re: Spark 1.6.0 HiveContext NPE

2016-02-03 Thread Shipper, Jay [USA]
t; Cc: "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Subject: Re: [External] Re: Spark 1.6.0 HiveContext NPE In ClientWrapper.scala, the SessionState.get().getConf call might have been executed ahead of SessionState.start(state) at line 194.

Re: [External] Re: Spark 1.6.0 HiveContext NPE

2016-02-03 Thread Ted Yu
e: Wednesday, February 3, 2016 at 12:04 PM > To: Jay Shipper > Cc: "user@spark.apache.org" > Subject: [External] Re: Spark 1.6.0 HiveContext NPE > > Looks like the NPE came from this line: > def conf: HiveConf = SessionState.get().getConf > > Meaning SessionStat

Re: [External] Re: Spark 1.6.0 HiveContext NPE

2016-02-03 Thread Shipper, Jay [USA]
:user@spark.apache.org>> Subject: Re: [External] Re: Spark 1.6.0 HiveContext NPE Right, I could already tell that from the stack trace and looking at Spark’s code. What I’m trying to determine is why that’s coming back as null now, just from upgrading Spark to 1.6.0. From: Ted Yu mailt

Re: [External] Re: Spark 1.6.0 HiveContext NPE

2016-02-03 Thread Shipper, Jay [USA]
hipper mailto:shipper_...@bah.com>> Cc: "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Subject: [External] Re: Spark 1.6.0 HiveContext NPE Looks like the NPE came from this line: def conf: HiveConf = SessionState.get().getConf Meanin

Re: Spark 1.6.0 HiveContext NPE

2016-02-03 Thread Ted Yu
Looks like the NPE came from this line: def conf: HiveConf = SessionState.get().getConf Meaning SessionState.get() returned null. On Wed, Feb 3, 2016 at 8:33 AM, Shipper, Jay [USA] wrote: > I’m upgrading an application from Spark 1.4.1 to Spark 1.6.0, and I’m > getting a NullPointerException