Yes, I did set spark.sql.hive.thriftServer.singleSession to true in
spark-defaults.conf of both spark sessions. after starting the 2nd spark
session, I manually set hive.server2.thrift.port to the spark thrift port
started within the 1st spark session, the temporary table is still not visible.
I do not think you can see temp tables from other application, like thrift.
You need save the tables in hive and then they will be visible through
thrift. Thrift uses hive metastore. However temp tables do not make to
central metastore until saved.
On 4 Oct 2016 11:44, "Takeshi Yamamuro" wrote:
>
-dev +user
Hi,
Have you try to share a session by
`spark.sql.hive.thriftServer.singleSession`?
// maropu
On Tue, Oct 4, 2016 at 6:10 AM, Herman Yu wrote:
>
> I built spark data frame/dataset on top of several hive tables, and then
> registered dataframe/dataset as temporary tables, as well as