RE: Maximum number of concurrent hive connections

2016-01-11 Thread Singh, Abhijeet
MySQL can support 4K connections but that might be it. The machine should be used only for this purpose. From: Kashif Hussain [mailto:kash.t...@gmail.com] Sent: Tuesday, January 12, 2016 12:54 PM To: user@hive.apache.org Subject: Re: Maximum number of concurrent hive connections It's on MySQL. I

Re: Maximum number of concurrent hive connections

2016-01-11 Thread Kashif Hussain
It's on MySQL. I am making connections through hiveserver2. On Tue, Jan 12, 2016 at 12:50 PM, Mich Talebzadeh wrote: > Depends on metastore settings. What is your metastore on? Oracle, SAP etc > > > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEWh2gBx

RE: Maximum number of concurrent hive connections

2016-01-11 Thread Mich Talebzadeh
Depends on metastore settings. What is your metastore on? Oracle, SAP etc Dr Mich Talebzadeh LinkedIn https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw Sybase ASE 15 Go

Maximum number of concurrent hive connections

2016-01-11 Thread Kashif Hussain
Hi, I need 3000-4000 concurrent connections to hive.The hive metastore is running on a 256 GB Ram machine. Can anyone tell me what's the maximum number of connections a hive metstaore can support ? Regards, Kashif

Re: Hive UDF accessing https request

2016-01-11 Thread Prabhu Joseph
Sergey, Yes there may be some difference between Hive Task and the separate program and so Hive Task could not able to access https request. Gopal, We have ca-certificates installed and there is no java subdirectory in /etc/ssl/certs folder. ls -ltr /etc/ssl/certs/java/ ---

Re: Column data mismatch after join !!!

2016-01-11 Thread @Sanjiv Singh
My case is very opposite to below JIRAs as in my case , using subquery giving correct result ...but using original table giving mismatched column value. https://issues.apache.org/jira/browse/HIVE-9613 https://issues.apache.org/jira/browse/HIVE-9327 Regards Sanjiv Singh Mob : +091 9990-447-339

Re:Re: Unable to start container using hive on spark

2016-01-11 Thread Todd
Hi Sofia, Thank you for the detailed guide. I confirmed that there are compatibility issues between Hive 1.2.1 and Spark 1.5.X. Hive 1.2.1 is by default built against spark 1.3.1 and compatible with spark 1.4.1,but doesn't work with 1.5.X. Basically,I am using somewhat the same configuration a

Apache-Hive Installation on pseduo/multi node distribution mode

2016-01-11 Thread sri sowj
Hi All, I have installed hadoop on multi node environment in my host PC as below 1: 4 virtual box instances loaded with ubuntu(14.04) 2: 1-master node , 2-slave node and remaining vm instance works as client Note: All 4 VM'S are running in my PC itself I was able to complete apace-2.6 hadoop s

Re: Hive UDF accessing https request

2016-01-11 Thread Sergey Shelukhin
Hmm, I’ve no idea off the top of my head what this exception means. My guess is something is different about the environment in which the Hive task vs the separate program is running. Different machine, different user, different Java args, path, not sure. It probably cannot find some Java SSL th

Re: Unable to start container using hive on spark

2016-01-11 Thread Sofia
From what I have seen you need to use a Spark version that does not contain the Hive jars. (maybe build one as described at the page). Maybe someone can respond to the compatibility issue better than me. However, this is how I managed to make hive work with Spark I had similar issues with the d

Re: Hive on Spark task running time is too long

2016-01-11 Thread Xuefu Zhang
You should check executor log to find out why it failed. There might have more explanation. --Xuefu On Sun, Jan 10, 2016 at 11:21 PM, Jone Zhang wrote: > *I have submited a application many times.* > *Most of applications running correctly.See attach 1.* > *But one of the them breaks as expecte

HiveException: Unexpected exception: org.apache.hadoop.io.Text cannot be cast to org.apache.hadoop.io.IntWritable

2016-01-11 Thread @Sanjiv Singh
I am frequently facing casting error with Hive query. One sample error logs given below. Error contains following details : - *complete row data * HiveException: Hive Runtime Error while processing row {"company_id":"3M","oper_carrier":"3M","flt_num":"4062","equip_id":"0331","equip_t

Re:Re: Unable to start container using hive on spark

2016-01-11 Thread Todd
Thank you, Sofia. From the log, looks it is java.lang.AbstractMethodError that leads to the job failure. I am using Hive 1.2.1+Spark 1.5.2, is this a compatibility issue? 16/01/11 17:42:06 [stderr-redir-1]: INFO client.SparkClientImpl: 16/01/11 17:42:06 INFO log.PerfLogger: 16/01/11

Re: Unable to start container using hive on spark

2016-01-11 Thread Sofia
Check log files to see the exact error. Alternatively run hive like this, to get the exact error hive --hiveconf hive.root.logger=INFO,console There is a good chance that you are encountering problems between the Hive and Spark versions and installation. See https://cwiki.apache.org/confluenc

Re: beeline and kerberos

2016-01-11 Thread Loïc Chanel
As I had the same problem a few months ago, I think your solution is in this thread : http://mail-archives.apache.org/mod_mbox/hive-user/201509.mbox/%3CCAPsi++Zsgvro4JTJPRXNyjzCTtSv7=4zjsipml51kvbforo...@mail.gmail.com%3E Regards, Loïc Loïc CHANEL System & virtualization engineer TO - XaaS Ind