Hi Reynold,
So far we've been able to transition everything to `SparkSession`. I was just
following up on behalf of Maciej.
Michael
> On Jul 19, 2016, at 11:02 AM, Reynold Xin wrote:
>
> dropping user list
>
> Yup I just took a look -- you are right.
>
> What's the reason you'd need a HiveC
dropping user list
Yup I just took a look -- you are right.
What's the reason you'd need a HiveContext? The only method that
HiveContext has and SQLContext does not have is refreshTable. Given this is
meant for helping code transition, it might be easier to just use
SQLContext and change the plac
Sorry Reynold, I want to triple check this with you. I'm looking at the
`SparkSession.sqlContext` field in the latest 2.0 branch, and it appears that
that val is set specifically to an instance of the `SQLContext` class. A cast
to `HiveContext` will fail. Maybe there's a misunderstanding here. T
Yes. But in order to access methods available only in HiveContext a user
cast is required.
On Tuesday, July 19, 2016, Maciej Bryński wrote:
> @Reynold Xin,
> How this will work with Hive Support ?
> SparkSession.sqlContext return HiveContext ?
>
> 2016-07-19 0:26 GMT+02:00 Reynold Xin
> >:
> >
@Reynold Xin,
How this will work with Hive Support ?
SparkSession.sqlContext return HiveContext ?
2016-07-19 0:26 GMT+02:00 Reynold Xin :
> Good idea.
>
> https://github.com/apache/spark/pull/14252
>
>
>
> On Mon, Jul 18, 2016 at 12:16 PM, Michael Armbrust
> wrote:
>>
>> + dev, reynold
>>
>> Yeah
Good idea.
https://github.com/apache/spark/pull/14252
On Mon, Jul 18, 2016 at 12:16 PM, Michael Armbrust
wrote:
> + dev, reynold
>
> Yeah, thats a good point. I wonder if SparkSession.sqlContext should be
> public/deprecated?
>
> On Mon, Jul 18, 2016 at 8:37 AM, Koert Kuipers wrote:
>
>> in
+ dev, reynold
Yeah, thats a good point. I wonder if SparkSession.sqlContext should be
public/deprecated?
On Mon, Jul 18, 2016 at 8:37 AM, Koert Kuipers wrote:
> in my codebase i would like to gradually transition to SparkSession, so
> while i start using SparkSession i also want a SQLContext
