Re: HiveServer2 slowly increaseing background CPU usage until restated

Hello! In addition to the CPU, did you see if the heap usage of the HS2 was increasing, please ? Le mer. 7 sept. 2022 à 11:48, Deepak Goel a écrit : > Can you please post the utilisation graph of r5.24xlarge too? > > > Deepak > "The greatness of a nation can be judged by the way its animals are

Re: HiveServer2 slowly increaseing background CPU usage until restated

Can you please post the utilisation graph of r5.24xlarge too? Deepak "The greatness of a nation can be judged by the way its animals are treated - Mahatma Gandhi" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Plant a Tree, G

Re: HiveServer2 slowly increaseing background CPU usage until restated

Hi Laurence, It's hard to say just by seeing the graphs. Moreover Hive 2.3.1 is a quite old version so there are many things that may go wrong. I would suggest checking the logs and taking jstacks overtime and/or use a profiler (such as async-profiler[1]) to see what HS2 is actually doing while C

Re: HiveServer2 via a proxy

What proxy are you using and can you share the proxy config and beeline url your trying. Thanks Shawn Sent from my iPhone > On Apr 3, 2019, at 2:39 AM, Andy Srine wrote: > > Team, > > Any ideas on how to connect to HiveServer2 from Beeline via a proxy server. > > I have tried everything I

Re: HiveServer2 performance references?

: *Prasanth Jayachandran > *Reply-To: *"user@hive.apache.org" > *Date: *Monday, October 15, 2018 at 12:34 PM > *To: *"user@hive.apache.org" , "user@hive.apache.org" > > *Subject: *Re: HiveServer2 performance references? > > > > One perform

Re: HiveServer2 performance references?

orward the Accept-Encoding headers. https://issues.apache.org/jira/browse/HIVE-17194 Cheers, Gopal From: Prasanth Jayachandran Reply-To: "user@hive.apache.org" Date: Monday, October 15, 2018 at 12:34 PM To: "user@hive.apache.org" , "user@hive.apache.org"

Re: HiveServer2 performance references?

One performance fix that is fixed recently and is related is HIVE-20621 Thanks Prasanth On Mon, Oct 15, 2018 at 12:11 PM -0700, "Kevin Risden" mailto:kris...@apache.org>> wrote: Are there any resources on HiveServer2 performance - specifically binary vs HTTP mode? I would also be interested

Re: HiveServer2 requests distribution

You should be able to see this when enabling metrics, these are to my knowledge per instance metrics. See also https://cwiki.apache.org/confluence/display/Hive/Hive+Metrics Sent from my iPhone > On May 21, 2018, at 2:53 AM, Greenhorn Techie > wrote: > > Hi, > > Any thoughts on this please?

Re: HiveServer2 requests distribution

Hi, Any thoughts on this please? Thanks On 18 May 2018 at 12:24:57, Greenhorn Techie (greenhorntec...@gmail.com) wrote: Hi, We have our hive setup in a HA mode i.e. multiple HiveServer2 instances. However, we believe the performance is not tuned properly and thinking whether the requests are

Re: Hiveserver2 - Beeline How to enable progress bar (Tez)

Do you have other configurations enabled? https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.tez.exec.inplace.progress https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Clients#HiveServer2Clients-Beeline%E2%80%93CommandLineShell On

Re: Hiveserver2 - Beeline How to enable progress bar (Tez)

Does anyone has this is working. I am still looking for response here. On Fri 2 Feb, 2018, 3:03 PM Shankar Mane, wrote: > I have set Tez as a default execution engine. > > On 02-Feb-2018 2:59 PM, "Margusja" wrote: > > Does it depends what kind of engine you are using - tez versus mr? > > Br mar

Re: Hiveserver2 - Beeline How to enable progress bar (Tez)

I have set Tez as a default execution engine. On 02-Feb-2018 2:59 PM, "Margusja" wrote: Does it depends what kind of engine you are using - tez versus mr? Br margus On 1 Feb 2018, at 17:57, Shankar Mane wrote: Any update? I m not getting progress bar with beeline client. tried both embedde

Re: Hiveserver2 - Beeline How to enable progress bar (Tez)

Does it depends what kind of engine you are using - tez versus mr? Br margus > On 1 Feb 2018, at 17:57, Shankar Mane wrote: > > Any update? > > I m not getting progress bar with beeline client. tried both embedded and > remote connection. > > It's working properly with Hive CLI. > > > On

Re: Hiveserver2 - Beeline How to enable progress bar (Tez)

Any update? I m not getting progress bar with beeline client. tried both embedded and remote connection. It's working properly with Hive CLI. On 30-Jan-2018 6:01 PM, "Shankar Mane" wrote: May i know, how to enable Tez progress bar in beeline ? I am using Tez has a execution engine. I have fo

Re: hiveserver2 java heap space

It works on Hive cli Patcharee On 10/24/2016 11:51 AM, Mich Talebzadeh wrote: does this work ok through Hive cli? Dr Mich Talebzadeh LinkedIn /https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw/ http://talebzadehmich.wordpress.com *Disclaimer:* Use it at you

Re: hiveserver2 java heap space

does this work ok through Hive cli? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use it a

Re: hiveserver2 GC overhead limit exceeded

ok. i'll bite. lets see the output of this command where Hiveserver2 is running. $ ps -ef | grep -i hiveserver2 this'll show us all the command line parameters HS2 was (ultimately) invoked with. Cheers, Stephen On Sun, Oct 23, 2016 at 6:46 AM, patcharee wrote: > Hi, > > I use beeline to conn

Re: hiveserver2 oom

Hey Sanjeev. Can you put the /tmp/hive/hive.log (on the hvevserver2 host) when you launch the query ? Best regards. Tale On Thu, Sep 22, 2016 at 5:03 AM, Sanjeev Verma wrote: > lowered 1073741824 to half of it but still getting the same issue. > > On Wed, Sep 21, 2016 at 6:44 PM, Sanjeev Verm

Re: hiveserver2 oom

lowered 1073741824 to half of it but still getting the same issue. On Wed, Sep 21, 2016 at 6:44 PM, Sanjeev Verma wrote: > its 1073741824 now but I cant see anything running on client side, the job > which kicked up by the query got completed but HS2 is crashing > > On Wed, Sep 21, 2016 at 6:40

Re: hiveserver2 oom

its 1073741824 now but I cant see anything running on client side, the job which kicked up by the query got completed but HS2 is crashing On Wed, Sep 21, 2016 at 6:40 PM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > FetchOperator will run client side. What is the value for > hi

Re: hiveserver2 oom

FetchOperator will run client side. What is the value for hive.fetch.task.conversion.threshold? Thanks Prasanth > On Sep 21, 2016, at 6:37 PM, Sanjeev Verma wrote: > > I am getting hiveserver2 memory even after increasing the heap size from 8G > to 24G, in clue why it still going to OOM with e

Re: HiveServer2 thrift service thread pool error

It means that TThreadpoolServer in the HS2 does not have enough worker threads to execute the client request. I see that pool size = 1 in the error message below. What is the value of configuration variables hive.server2.thrift.min.worker.threads and hive.server2.thrift.max.worker.threads in yo

Re: hiveserver2 start hang

what command did you use to start hiveserver2? $HIVE_HOME/bin/hiveserver2 & is the port 1 used? netstat -alnp|egrep 'Local|10010' HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Re: HiveServer2 load data inpath fails

but due to concurrency and >>> gc issue I am moving to HS2 but if its just dependent on load local then >>> its really strange. >>> >>> Thanks! >>> On Oct 21, 2015 6:22 AM, "r7raul1...@163.com" >>> wrote: >>> >>>>

Re: Re: HiveServer2 load data inpath fails

on the hiveserver2 host local filesystem . Then try >>> load data local inpath >>> >>> -- >>> r7raul1...@163.com >>> >>> >>> *From:* Vineet Mishra >>> *Date:* 2015-10-21 03:05 >>> *To:* u

Re: Re: HiveServer2 load data inpath fails

e file on the hiveserver2 host local filesystem . Then try > load data local inpath > > -- > r7raul1...@163.com > > > *From:* Vineet Mishra > *Date:* 2015-10-21 03:05 > *To:* user > *CC:* cdh-user > *Subject:* Re: HiveServer2 load dat

Re: Re: HiveServer2 load data inpath fails

Place the file on the hiveserver2 host local filesystem . Then try load data local inpath r7raul1...@163.com From: Vineet Mishra Date: 2015-10-21 03:05 To: user CC: cdh-user Subject: Re: HiveServer2 load data inpath fails Any update around this? 0: jdbc:hive2://hadoop-hs2:1> l

Re: HiveServer2 load data inpath fails

Any update around this? 0: jdbc:hive2://hadoop-hs2:1> load data inpath '/data/my_table/' overwrite into table mydb.mytable; Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask (state=08S01,code=1) I couldn't get any poss

RE: HiveServer2 load data inpath fails

My data files resides on hdfs and for the given command I guess it will point to local filesystem instead of hdfs. On Oct 20, 2015 10:25 PM, "Vikas Srivastava" wrote: > You Need to use “load data local inpath” > > > > > > *From:* Vineet Mishra [mailto:clearmido...@gmail.com] > *Sent:* Tuesday, Oc

RE: HiveServer2 load data inpath fails

You Need to use “load data local inpath” From: Vineet Mishra [mailto:clearmido...@gmail.com] Sent: Tuesday, October 20, 2015 6:08 PM To: user@hive.apache.org; cdh-u...@cloudera.or to Subject: HiveServer2 load data inpath fails Hi All, I am trying to run load data inpath to update/refr

Re: Re: Hiveserver2 client stdout

sted errors. Default is false. >>> >>> Usage: beeline --showNestedErrs=true >>> >>> -- >>> r7raul1...@163.com >>> >>> >>> *From:* Jerrick Hoang >>> *Date:* 2015-10-20 11:55 >>> *To

Re: Re: Hiveserver2 client stdout

alse. >> >> Usage: beeline --showNestedErrs=true >> >> ---------- >> r7raul1...@163.com >> >> >> *From:* Jerrick Hoang >> *Date:* 2015-10-20 11:55 >> *To:* user >> *Subject:* Re: Hiveserver2 client stdout &g

Re: Re: Hiveserver2 client stdout

[true/false] > > Display nested errors. Default is false. > > Usage: beeline --showNestedErrs=true > > -- > r7raul1...@163.com > > > *From:* Jerrick Hoang > *Date:* 2015-10-20 11:55 > *To:* user > *Subject:* Re: Hiveserver2 clien

Re: Re: Hiveserver2 client stdout

/false] Display nested errors. Default is false. Usage: beeline --showNestedErrs=true r7raul1...@163.com From: Jerrick Hoang Date: 2015-10-20 11:55 To: user Subject: Re: Hiveserver2 client stdout That would just increase the log level on the server side right? I want the stdout log sent to the

Re: Re: Hiveserver2 client stdout

: Hiveserver2 client stdout That would just increase the log level on the server side right? YES You can check the log in detail. r7raul1...@163.com From: Jerrick Hoang Date: 2015-10-20 11:55 To: user Subject: Re: Hiveserver2 client stdout That would just increase the log level on the server

Re: Re: Hiveserver2 client stdout

That would just increase the log level on the server side right? YES You can check the log in detail. r7raul1...@163.com From: Jerrick Hoang Date: 2015-10-20 11:55 To: user Subject: Re: Hiveserver2 client stdout That would just increase the log level on the server side right? I want

Re: Hiveserver2 client stdout

That would just increase the log level on the server side right? I want the stdout log sent to the jdbc client. On Mon, Oct 19, 2015 at 6:49 PM, r7raul1...@163.com wrote: > start hiveserver2 with --hiveconf hive.root.logger=DEBUG,console. > Then check hiveserver2 log. > > --

Re: Hiveserver2 client stdout

start hiveserver2 with --hiveconf hive.root.logger=DEBUG,console. Then check hiveserver2 log. r7raul1...@163.com From: Jerrick Hoang Date: 2015-10-20 09:03 To: user Subject: Hiveserver2 client stdout Hi all, I have a hiveserver2 client running on a remote server. I'm able to connect to

Re: HiveServer2 OOM

In my experience having looked at way to many heap dumps from hiveserver2 it always end up being a seriously over partitioned table and a user who decided to do a full table scan basically requesting all partitions. This often is by accident for example when using unix_timestamp to convert date

Re: HiveServer2 Goes down while parallel Query execution

What about the case when even the HS2 Service restart is also not working. So my bad is that after restarting HS2 the health is good(green) but still I cannot query the data. Any quick thoughts/input? Thanks! On Sun, Oct 11, 2015 at 9:58 PM, Edward Capriolo < edward.capri...@huffingtonpost.com>

Re: HiveServer2 Goes down while parallel Query execution

Hi Edward, I am not sure whether you meant HiverServer2 or HS1 as I could see that HS2 is preferable over HS1 https://cwiki.apache.org/confluence/display/Hive/HiveServer and didn't heard about any such reliability issue of HS2. Moreover I am making multiple JDBC Connection to fire parallel query

Re: HiveServer2 Goes down while parallel Query execution

Any update on this? URGENT CALL! On Oct 10, 2015 9:25 AM, "Vineet Mishra" wrote: > Hi Jimmy, > > Any prominent reason for it run out of worker thread when maximum query > fired at a time fired are only 8. > > I am trying to open multiple session on different connection, so each > thread correspo

Re: HiveServer2 Goes down while parallel Query execution

Hi Jimmy, Any prominent reason for it run out of worker thread when maximum query fired at a time fired are only 8. I am trying to open multiple session on different connection, so each thread corresponds to one connection. Thanks! On Sat, Oct 10, 2015 at 1:22 AM, Jimmy Xiang wrote: > Could i

Re: HiveServer2 Goes down while parallel Query execution

Could it be because HS2 runs out of worker threads? Are you trying to open multiple sessions on the same connection? Thanks, Jimmy On Fri, Oct 9, 2015 at 12:34 PM, Vineet Mishra wrote: > Any idea about this? > > Frequent Connectivity issue to HiveServer2 > > 2015-10-10 00:23:11,070 [main] ERR

Re: HiveServer2 Goes down while parallel Query execution

Any idea about this? Frequent Connectivity issue to HiveServer2 2015-10-10 00:23:11,070 [main] ERROR (HiveConnection.java:439) - Error opening session org.apache.thrift.transport.TTransportException at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) at org.apa

Re: HiveServer2 Goes down while parallel Query execution

This looks out to be the issue https://issues.apache.org/jira/browse/HIVE-2314 Any workaround or resolution to the same. Thanks! On Fri, Oct 9, 2015 at 1:24 PM, Vineet Mishra wrote: > Hi All, > > I am trying to connect to HiveServer2 to query some data in parallel and > landing up into some w

Re: hiveserver2 hangs

Thanks sanjeev for your help. BTW I try to increase the Heap Size of HS2 but seeing the same exception.from where this exception has originated, it looks like originated from the thrift client.any idea what operation it is doing with the given stack. Local Variable: org.apache.thrift.TByteArrayOu

Re: HiveServer2 & Kerberos

>>>>> The only good reason I can think of to ask for a password is so that >>>>> it doesn't appear in a shell/beeline history and/or on screen. I'm sure >>>>> there are others? >>>>> The username can be safely provided in the UR

Re: HiveServer2 & Kerberos

gt; doesn't appear in a shell/beeline history and/or on screen. I'm sure there >>>> are others? >>>> The username can be safely provided in the URL if needed so I don't >>>> think asking for that every time is reasonable either. >>>&g

Re: HiveServer2 & Kerberos

to just rip out >>> those prompts. The other option would be to parse the connection URL and >>> check whether it's the Kerberos mode. >>> >>>> >>>> [1] >>>> https://github.com/apache/hive/blob/3991dba30c5068cac296f32e24e97cf87efa266c/beeline/

Re: hiveserver2 hangs

Sanjeev, I am going off this exception in the stacktrace that you posted. "at java.lang.OutOfMemoryError.(OutOfMemoryError.java:48)" which def. indicates that it's not very happy memory wise. I would def. recommend to bump up the memory and see if it helps. If not, we can debug further from ther

Re: hiveserver2 hangs

What this exception implies here? how to identify the problem here. Thanks On Tue, Sep 8, 2015 at 10:44 PM, Sanjeev Verma wrote: > We have 8GB HS2 java heap, we have not tried any bumping. > > On Tue, Sep 8, 2015 at 8:14 PM, kulkarni.swar...@gmail.com < > kulkarni.swar...@gmail.com> wrote: > >>

Re: hiveserver2 hangs

We have 8GB HS2 java heap, we have not tried any bumping. On Tue, Sep 8, 2015 at 8:14 PM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > How much memory have you currently provided to HS2? Have you tried bumping > that up? > > On Mon, Sep 7, 2015 at 1:09 AM, Sanjeev Verma > wr

Re: hiveserver2 hangs

How much memory have you currently provided to HS2? Have you tried bumping that up? On Mon, Sep 7, 2015 at 1:09 AM, Sanjeev Verma wrote: > *I am getting the following exception when the HS2 is crashing, any idea > why it has happening* > > "pool-1-thread-121" prio=4 tid=19283 RUNNABLE > at java.

Re: hiveserver2 hangs

*I am getting the following exception when the HS2 is crashing, any idea why it has happening* "pool-1-thread-121" prio=4 tid=19283 RUNNABLE at java.lang.OutOfMemoryError.(OutOfMemoryError.java:48) at java.util.Arrays.copyOf(Arrays.java:2271) Local Variable: byte[]#1 at java.io.ByteArrayOutputStre

Re: HiveServer2 & Kerberos

:13 AM, Loïc Chanel < >> loic.cha...@telecomnancy.net> wrote: >> >>> Here it is : https://issues.apache.org/jira/browse/HIVE-11653 >>> >>> Loïc CHANEL >>> Engineering student at TELECOM Nancy >>> Trainee at Worldline - Villeurbanne &g

Re: HiveServer2 & Kerberos

is : https://issues.apache.org/jira/browse/HIVE-11653 >>> >>> Loïc CHANEL >>> Engineering student at TELECOM Nancy >>> Trainee at Worldline - Villeurbanne >>> >>> 2015-08-25 23:10 GMT+02:00 Sergey Shelukhin : >>> >>>>

Re: HiveServer2 & Kerberos

.org/jira/browse/HIVE-11653 >> >> Loïc CHANEL >> Engineering student at TELECOM Nancy >> Trainee at Worldline - Villeurbanne >> >> 2015-08-25 23:10 GMT+02:00 Sergey Shelukhin : >> >>> Sure! >>> >>> From: Loïc Chanel >>> Rep

RE: HiveServer2 & Kerberos

From: Rahul Sharma<mailto:kippy@gmail.com> Sent: ‎26/‎08/‎2015 17:53 To: user@hive.apache.org<mailto:user@hive.apache.org> Subject: Re: HiveServer2 & Kerberos Even I (and a few others I know in different orgs) have been confused by the password prompts. So looking at the multi

Re: HiveServer2 & Kerberos

> >>> On Wed, Aug 26, 2015 at 10:13 AM, Loïc Chanel < >>> loic.cha...@telecomnancy.net> wrote: >>> >>>> Here it is : https://issues.apache.org/jira/browse/HIVE-11653 >>>> >>>> Loïc CHANEL >>>> Engineering student at T

Re: HiveServer2 & Kerberos

lecomnancy.net> wrote: >> >>> Here it is : https://issues.apache.org/jira/browse/HIVE-11653 >>> >>> Loïc CHANEL >>> Engineering student at TELECOM Nancy >>> Trainee at Worldline - Villeurbanne >>> >>> 2015-08-25 23:10 GMT+02:00 Sergey She

Re: HiveServer2 & Kerberos

t;> >> Loïc CHANEL >> Engineering student at TELECOM Nancy >> Trainee at Worldline - Villeurbanne >> >> 2015-08-25 23:10 GMT+02:00 Sergey Shelukhin : >> >>> Sure! >>> >>> From: Loïc Chanel >>> Reply-To: "user@hive.apach

Re: HiveServer2 & Kerberos

> 2015-08-25 23:10 GMT+02:00 Sergey Shelukhin : > >> Sure! >> >> From: Loïc Chanel >> Reply-To: "user@hive.apache.org" >> Date: Tuesday, August 25, 2015 at 00:23 >> >> To: "user@hive.apache.org" >> Subject: Re: HiveServer2 &am

Re: HiveServer2 & Kerberos

esday, August 25, 2015 at 00:23 > > To: "user@hive.apache.org" > Subject: Re: HiveServer2 & Kerberos > > It is the case. > Would you like me to fill a JIRA about it ? > > Loïc CHANEL > Engineering student at TELECOM Nancy > Trainee at Worldline - Villeu

Re: HiveServer2 & Kerberos

com>>: If that is the case it sounds like a bug… From: Jary Du mailto:jary...@gmail.com>> Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Date: Thursday, August 20, 2015 at 08:56 To: "user@hive.apache.org<mail

Re: HiveServer2 & Kerberos

r@hive.apache.org" > Date: Thursday, August 20, 2015 at 08:56 > To: "user@hive.apache.org" > Subject: Re: HiveServer2 & Kerberos > > My understanding is that it will always ask you user/password even though > you don’t need them. It is just the way how hive is setup.

Re: HiveServer2 & Kerberos

:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Re: HiveServer2 & Kerberos My understanding is that it will always ask you user/password even though you don’t need them. It is just the way how hive is setup. On Aug 20, 2015, at 8:28 AM, Loïc Chanel mailto:loic.

Re: hiveserver2 hangs

Sanjeev, One possibility is that you are running into[1] which affects hive 0.13. Is it possible for you to apply the patch on [1] and see if it fixes your problem? [1] https://issues.apache.org/jira/browse/HIVE-10410 On Thu, Aug 20, 2015 at 6:12 PM, Sanjeev Verma wrote: > We are using hive-0.

Re: hiveserver2 hangs

We are using hive-0.13 with hadoop1. On Thu, Aug 20, 2015 at 11:49 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > Sanjeev, > > Can you tell me more details about your hive version/hadoop version etc. > > On Wed, Aug 19, 2015 at 1:35 PM, Sanjeev Verma > wrote: > >> Can some

Re: hiveserver2 hangs

Sanjeev, Can you tell me more details about your hive version/hadoop version etc. On Wed, Aug 19, 2015 at 1:35 PM, Sanjeev Verma wrote: > Can somebody gives me some pointer to looked upon? > > On Wed, Aug 19, 2015 at 9:26 AM, Sanjeev Verma > wrote: > >> Hi >> We are experiencing a strange prob

Re: HiveServer2 & Kerberos

My understanding is that it will always ask you user/password even though you don’t need them. It is just the way how hive is setup. > On Aug 20, 2015, at 8:28 AM, Loïc Chanel wrote: > > !connect > jdbc:hive2://192.168.6.210:1/db;principal=hive/hiveh...@westeros.wl >

Re: HiveServer2 & Kerberos

!connect jdbc:hive2:// 192.168.6.210:1/db;principal=hive/hiveh...@westeros.wl org.apache.hive.jdbc.HiveDriver scan complete in 13ms Connecting to jdbc:hive2:// 192.168.6.210:1/db;principal=hive/hiveh...@westeros.wl Enter password for jdbc:hive2:// 192.168.6.210:1/chaneldb;principal=hive

Re: HiveServer2 & Kerberos

How does Beeline ask you? What happens if you just press enter? > On Aug 20, 2015, at 12:15 AM, Loïc Chanel > wrote: > > Indeed, I don't need the password, but why is Beeline asking me for one ? To > what does it correspond ? > > Thanks again, > > > Loïc > > Loïc CHANEL > Engineering stu

Re: hiveserver2 hangs

We had a case of retrieving a record which is bigger than the GC limit, for example a column with Array or Map type that has 1M cells. On Wed, Aug 19, 2015 at 9:35 PM, Sanjeev Verma wrote: > Can somebody gives me some pointer to looked upon? > > On Wed, Aug 19, 2015 at 9:26 AM, Sanjeev Verma >

Re: HiveServer2 & Kerberos

Indeed, I don't need the password, but why is Beeline asking me for one ? To what does it correspond ? Thanks again, Loïc Loïc CHANEL Engineering student at TELECOM Nancy Trainee at Worldline - Villeurbanne 2015-08-19 18:22 GMT+02:00 Jary Du : > Correct me if I am wrong, my understanding is t

Re: hiveserver2 hangs

Can somebody gives me some pointer to looked upon? On Wed, Aug 19, 2015 at 9:26 AM, Sanjeev Verma wrote: > Hi > We are experiencing a strange problem with the hiveserver2, in one of the > job it gets the GC limit exceed from mapred task and hangs even having > enough heap available.we are not ab

Re: HiveServer2 & Kerberos

Correct me if I am wrong, my understanding is that after using kerberos authentication, you probably don’t need the password. Hope it helps Thanks, Jary > On Aug 19, 2015, at 9:09 AM, Loïc Chanel wrote: > > By the way, thanks a lot for your help, because your solution works, but I'm > still

Re: HiveServer2 & Kerberos

By the way, thanks a lot for your help, because your solution works, but I'm still interested in knowing what is the password I did not enter. Thanks again, Loïc Loïc CHANEL Engineering student at TELECOM Nancy Trainee at Worldline - Villeurbanne 2015-08-19 18:07 GMT+02:00 Loïc Chanel : > All

Re: HiveServer2 & Kerberos

All right, but then, what is the password hive asks for ? Hive's one ? How do I know its value ? Loïc CHANEL Engineering student at TELECOM Nancy Trainee at Worldline - Villeurbanne 2015-08-19 17:51 GMT+02:00 Jary Du : > For Beeline connection string, it should be "!connect > jdbc:hive2://:/;pri

Re: HiveServer2 & Kerberos

For Beeline connection string, it should be "!connect jdbc:hive2://:/;principal=”. Please make sure it is the hive’s principal, not the user’s. And when you kinit, it should be kinit user’s keytab, not the hive’s keytab. > On Aug 19, 2015, at 8:46 AM, Loïc Chanel wrote: > > Yeah, I forgo

Re: HiveServer2 & Kerberos

Yeah, I forgot to mention it, but each time I did a kinit user/hive before launching beeline, as I read somewhere that Beeline does not handle Kerberos connection. So, as I can make klist before launching beeline and having a good result, the problem does not come from this. Thanks a lot for your

Re: HiveServer2 & Kerberos

"The Beeline client must have a valid Kerberos ticket in the ticket cache before attempting to connect." (http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.3/bk_dataintegration/content/ch_using-hive-clients-examples.html) So you need kinit first to have the valid Kerberos ticket int the tick

Re: HiveServer2 & Kerberos

Hi again, As I searched another way to make some requests with Kerberos enabled for security on HiveServer, I found that this request should do the same : !connect jdbc:hive2:// 192.168.6.210:1/default;principal=user/h...@westeros.wl org.apache.hive.jdbc.HiveDriver But now I've got another err

RE: Hiveserver2 stops logging

: Palani, MuthuKumar A [mailto:muthu.ku...@firstdata.com] Sent: 07 June 2015 21:07 To: user@hive.apache.org Subject: RE: Hiveserver2 stops logging Hi, We are running Cloudera Hadoop , Version CDH 5.2.1 Regards, MuthuKumar From: Chinna Rao Lalam [mailto:lalamchinnara...@gmail.

RE: Hiveserver2 stops logging

Hi, We are running Cloudera Hadoop , Version CDH 5.2.1 Regards, MuthuKumar From: Chinna Rao Lalam [mailto:lalamchinnara...@gmail.com] Sent: Thursday, June 04, 2015 4:46 AM To: user@hive.apache.org Subject: Re: Hiveserver2 stops logging Hi, What version you are using and what is the environment

Re: Hiveserver2 stops logging

Hi, What version you are using and what is the environment.. On Thu, Jun 4, 2015 at 2:35 PM, Palani, MuthuKumar A < muthu.ku...@firstdata.com> wrote: > Hi Folks, > > > > We are experiencing an issue with Hive that we have not been able to > solve for few weeks. > > > > Hiveserver2 stops loggin

Re: Hiveserver2 memory / thread leak v 0.13.1 (hdp-2.1.5)

Is HIVE-7353 relates to embedded MetaStore only? We use MySQL for metadata. HS2 OOM yesterday Current HS2 instance uses just 77MB for now (39 live threads). I found another issue fixes HS2 leaks https://issues.apache.org/jira/browse/HIVE-9234 JVM Arguments: -Xmx1024m -Djava.net.preferIPv4Stack=

Re: Hiveserver2 memory / thread leak v 0.13.1 (hdp-2.1.5)

Alexander, Can you share the jmap histo (or even better, a heapdump)? What are the top consumers? What are the heap+permgen sizes that the JVM is configured to use? FYI, we fixed this memory leak in Hive-14: https://issues.apache.org/jira/browse/HIVE-7353. Thanks, -Vaibhav From: Alexander Pi

Re: HiveServer2 multiple instances

Arali, You can use this feature from Hive 14 onwards for your use case: https://issues.apache.org/jira/browse/HIVE-8376 Thanks, -Vaibhav From: arali tech mailto:aralitec...@gmail.com>> Reply-To: user mailto:user@hive.apache.org>> Date: Monday, December 15, 2014 at 1:35 AM To: user mailto:user@h

RE: Hiveserver2 crash with RStudio (using RJDBC)

From: Nathalie Blais Sent: 6 octobre 2014 13:49 To: 'user@hive.apache.org' Subject: RE: Hiveserver2 crash with RStudio (using RJDBC) Hello Vaibhav, Sorry for the delay in getting back to you on this. We now have an up and running test cluster with a hive server I can “crash at will”. I

RE: Hiveserver2 crash with RStudio (using RJDBC)

;user@hive.apache.org' Subject: RE: Hiveserver2 crash with RStudio (using RJDBC) Hello Vaibhav, Thanks a lot for your quick response! I will grab a heapdump as soon as I have “the ok to crash the server” and attach it to this thread. In the meantime, regarding our metastore, it looks like it is remot

RE: Hiveserver2 crash with RStudio (using RJDBC)

trouble sending it and I retried a few times; please disregard any dupes of this request. Thanks! -- Nathalie From: Vaibhav Gumashta [mailto:vgumas...@hortonworks.com] Sent: 25 septembre 2014 03:52 To: user@hive.apache.org Subject: Re: Hiveserver2 crash with RStudio (using RJDBC) Nathalie, Can you

Re: Hiveserver2 crash with RStudio (using RJDBC)

Nathalie, Can you grab a heapdump at the time the server crashes (export this to your environment: HADOOP_CLIENT_OPTS="-XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath= $HADOOP_CLIENT_OPTS".)? What type of metastore are you using with HiveServer2 - embedded (if you specify -hiveconf hive.metastore

Re: HiveServer2 Availability

Check this: https://issues.apache.org/jira/browse/HIVE-7935 This enables dynamic service discovery, but in future the plan is to use this feature to achieve HA. Thanks, --Vaibhav On Fri, Jul 25, 2014 at 7:32 PM, Edward Capriolo wrote: > I have put stAndard load balancers infront before and wro

Re: HiveServer2 Availability

I have put stAndard load balancers infront before and wrote a thrift show tables as a test. On Friday, July 25, 2014, Raymond Lau wrote: > Has anyone had any experience with a multiple-machine HiveServer2 setup? Hive needs to be available at all times for our use-case, so if for some reason, one

Re: hiveserver2 0.12 and 0.13 incompatible?

Yeah. It's expected that 13 client is not able to talk to the older sever. However, the other direction is fine. That is, old 12 client should be able to talk to 13 server. --Xuefu On Thu, Jul 10, 2014 at 3:09 PM, Edward Capriolo wrote: > 2014-07-10 22:00:03 ERROR HiveConnection:425 - Error op

Re: HiveServer2 with Hive CLI

You can try running derby in multi session mode. I did that , now I can use Hive web interface and hive CLI simultaneously On Wednesday, May 28, 2014, Amjad ALSHABANI wrote: > OOps, I forgot about that :) > > Thanks Dima to mention that. > > Actually where I m doing the test using Derby but on

Re: HiveServer2 with Hive CLI

OOps, I forgot about that :) Thanks Dima to mention that. Actually where I m doing the test using Derby but on the production machine we are using Postgres, so I hope that everything will go well when moving to production Thanx On Wed, May 28, 2014 at 10:52 AM, Dima Machlin wrote: > You are

RE: HiveServer2 with Hive CLI

You are using the default Derby metastore? There shouldn’t be any problem opening multiple connections to MySQL, Oracle or Postgres. From: Amjad ALSHABANI [mailto:ashshab...@gmail.com] Sent: Wednesday, May 28, 2014 11:42 AM To: user@hive.apache.org Subject: HiveServer2 with Hive CLI Hello every

RE: HiveServer2 VS HiveServer1 Logging

I’ve made some progress in investigating this. It seems that this behavior happens on certain conditions. As long as i’m running any query that isn’t “set” or “add” command the logging is fine. For example “show table” : 14/05/25 13:47:17 INFO cli.CLIService: SessionHandle [2db07453-2235-4f22-a

  1   2   >