Re: problem with HiveContext inside Actor

2014-09-17 Thread Michael Armbrust
; Cheng Hao > > > > *From:* Du Li [mailto:l...@yahoo-inc.com.INVALID] > *Sent:* Thursday, September 18, 2014 7:51 AM > *To:* u...@spark.apache.org; dev@spark.apache.org > *Subject:* problem with HiveContext inside Actor > > > > Hi, > > > > Wonder anybo

RE: problem with HiveContext inside Actor

2014-09-17 Thread Cheng, Hao
the HiveDriver will always get the null value when retrieving HiveConf. Cheng Hao From: Du Li [mailto:l...@yahoo-inc.com.INVALID] Sent: Thursday, September 18, 2014 7:51 AM To: u...@spark.apache.org; dev@spark.apache.org Subject: problem with HiveContext inside Actor Hi, Wonder anybody had simila

problem with HiveContext inside Actor

2014-09-17 Thread Du Li
Hi, Wonder anybody had similar experience or any suggestion here. I have an akka Actor that processes database requests in high-level messages. Inside this Actor, it creates a HiveContext object that does the actual db work. The main thread creates the needed SparkContext and passes in to the