Re: Hive on Spark - Hadoop 2 - Installation - Ubuntu

2015-11-23 Thread Dasun Hegoda
Hey floks, Any updates? On Mon, Nov 23, 2015 at 5:15 PM, Dasun Hegoda wrote: > Do you have any clue how to get his fixed? > > On Mon, Nov 23, 2015 at 4:27 PM, Dasun Hegoda > wrote: > >> I get this now. It's different than what you get >> >> hduser@master:~/spark-1.5.1-bin-hadoop2.6/bin$ ./spar

Unable to connect to beeline after kerberos is installed

2015-11-23 Thread Kumar Jayapal
Unable to connect to beeline after kerberos is installed I am getting this error. Let me know if an one has resolution for it. *Error: Could not open client transport with JDBC Uri: jdbc:hive2://hiven001.np.mmc.com:1/ : Peer indicated failure: Unsupported mec

Re: Hive on Spark - Hadoop 2 - Installation - Ubuntu

2015-11-23 Thread Dasun Hegoda
Do you have any clue how to get his fixed? On Mon, Nov 23, 2015 at 4:27 PM, Dasun Hegoda wrote: > I get this now. It's different than what you get > > hduser@master:~/spark-1.5.1-bin-hadoop2.6/bin$ ./spark-shell > 15/11/23 05:56:13 INFO spark.SecurityManager: Changing view acls to: hduser > 15/1

Re: Hive on Spark - Hadoop 2 - Installation - Ubuntu

2015-11-23 Thread Dasun Hegoda
I get this now. It's different than what you get hduser@master:~/spark-1.5.1-bin-hadoop2.6/bin$ ./spark-shell 15/11/23 05:56:13 INFO spark.SecurityManager: Changing view acls to: hduser 15/11/23 05:56:13 INFO spark.SecurityManager: Changing modify acls to: hduser 15/11/23 05:56:13 INFO spark.Secur

RE: Hive on Spark - Hadoop 2 - Installation - Ubuntu

2015-11-23 Thread Mich Talebzadeh
As example shows all set in hive-core.xml hive.execution.engine spark Expects one of [mr, tez, spark]. Chooses execution engine. Options are: mr (Map reduce, default) or tez (hadoop 2 only) spark.eventLog.enabled true S

Re: Hive on Spark - Hadoop 2 - Installation - Ubuntu

2015-11-23 Thread Dasun Hegoda
Thank you very much. This is very informative. Do you know how to set these in hive-site.xml? hive> set spark.master= hive> set spark.eventLog.enabled=true; hive> set spark.eventLog.dir= hive> set spark.executor.memory=512m; hive> set spark.serializer=org.apache.spark.serializer.KryoSerializer; I

RE: Hive on Spark - Hadoop 2 - Installation - Ubuntu

2015-11-23 Thread Mich Talebzadeh
Hi, I am looking at the set up here https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started. First this is about configuration of Hive to work with Spark. These are my understanding 1.Hive uses Yarn as its resource manager regardless 2.Hive uses M