Re: store hive metastore on persistent store

2015-05-16 Thread Tamas Jambor
machine: >>>>>> >>>>>> scala> val hc= new org.apache.spark.sql.hive.HiveContext(sc) >>>>>> hc: org.apache.spark.sql.hive.HiveContext = >>>>>> org.apache.spark.sql.hive.HiveContext@6e9f8f26 >>>>>> >>>>

Re: store hive metastore on persistent store

2015-05-16 Thread Yana Kadiyska
> org.apache.spark.sql.hive.HiveContext@6e9f8f26 >>>>> >>>>> scala> hc.sql("show tables").collect >>>>> 15/05/15 09:34:17 INFO metastore: Trying to connect to metastore with URI >>>>> thrift://hostname.com:9083

Re: store hive metastore on persistent store

2015-05-16 Thread Tamas Jambor
:34:17 INFO metastore: Waiting 1 seconds before next connection >>>> attempt. >>>> 15/05/15 09:34:18 INFO metastore: Connected to metastore. >>>> res0: Array[org.apache.spark.sql.Row] = Array([table1,false], >>>> >>>> scala> hc.getConf(&

Re: store hive metastore on persistent store

2015-05-16 Thread Tamas Jambor
t; >>> The first line tells you which metastore it's trying to connect to -- >>> this should be the string specified under hive.metastore.uris property in >>> your hive-site.xml file. I have not mucked with warehouse.dir too much but &g

Re: store hive metastore on persistent store

2015-05-15 Thread Yana Kadiyska
ave tried to put the hive-site.xml file in the conf/ directory with, >>> seems it is not picking up from there. >>> >>> >>> On Thu, May 14, 2015 at 6:50 PM, Michael Armbrust < >>> mich...@databricks.com> wrote: >>> >>>> You can con

Re: store hive metastore on persistent store

2015-05-15 Thread Tamas Jambor
te.xml >>> file in the conf/ directory. >>> >>> On Thu, May 14, 2015 at 10:24 AM, jamborta wrote: >>> >>>> Hi all, >>>> >>>> is it possible to set hive.metastore.warehouse.dir, that is internally >>>> create by spark,

Re: store hive metastore on persistent store

2015-05-15 Thread Yana Kadiyska
rta wrote: >> >>> Hi all, >>> >>> is it possible to set hive.metastore.warehouse.dir, that is internally >>> create by spark, to be stored externally (e.g. s3 on aws or wasb on >>> azure)? >>> >>> thanks, >>> >>> >

Re: store hive metastore on persistent store

2015-05-14 Thread Tamas Jambor
>> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/store-hive-metastore-on-persistent-store-tp22891.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> --

Re: store hive metastore on persistent store

2015-05-14 Thread Michael Armbrust
g. s3 on aws or wasb on azure)? > > thanks, > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/store-hive-metastore-on-persistent-store-tp22891.html > Sent from the Apache Spark User

store hive metastore on persistent store

2015-05-14 Thread jamborta
Hi all, is it possible to set hive.metastore.warehouse.dir, that is internally create by spark, to be stored externally (e.g. s3 on aws or wasb on azure)? thanks, -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/store-hive-metastore-on-persistent-store