Re: access spark thrift server from another spark session

2016-10-04 Thread Herman Yu
Yes, I did set spark.sql.hive.thriftServer.singleSession to true in spark-defaults.conf of both spark sessions. after starting the 2nd spark session, I manually set hive.server2.thrift.port to the spark thrift port started within the 1st spark session, the temporary table is still not visible.

Re: access spark thrift server from another spark session

2016-10-03 Thread ayan guha
I do not think you can see temp tables from other application, like thrift. You need save the tables in hive and then they will be visible through thrift. Thrift uses hive metastore. However temp tables do not make to central metastore until saved. On 4 Oct 2016 11:44, "Takeshi Yamamuro" wrote: >

Re: access spark thrift server from another spark session

2016-10-03 Thread Takeshi Yamamuro
-dev +user Hi, Have you try to share a session by `spark.sql.hive.thriftServer.singleSession`? // maropu On Tue, Oct 4, 2016 at 6:10 AM, Herman Yu wrote: > > I built spark data frame/dataset on top of several hive tables, and then > registered dataframe/dataset as temporary tables, as well as