, 2017 at 10:37 AM
To: "user@hive.apache.org<mailto:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Subject: Re: Tez query failed with OutOfMemoryError: Java heap space
Here're the version information:
Hive: 1.2.1
Tez: 0.8.5
Hadoop 2.6.0-cdh5.8.3
Please let me know i
ive.apache.org>"
mailto:user@hive.apache.org>>
Subject: Tez query failed with OutOfMemoryError: Java heap space
Hi,
We ran a Tez query and it failed with OOM. Then, we computed stats, it still
failed with the OOM.
Settings:
set hive.tez.container.size=4096;
set tez.am.reso
Try --hiveconf hive.session.id=session_id_name.
Then, the job name will be HIVE-session_id_name.
AFAK, this is the best option for your request.
If there is a better way, please share here.
Hope it helps.
Thank you.
On Sat, Jan 21, 2017 at 6:56 AM, Gopal Vijayaraghavan wrote:
>
>> So no one has a
> So no one has a solution?
…
> “mapreduce.job.name” works for M/R queries, not Tez.
Depends on the Hive version you're talking about.
https://issues.apache.org/jira/browse/HIVE-12357
That doesn't help you with YARN, but only with the TezUI (since each YARN AM
runs > 1 queries).
For somethin
: how to customize tez query app name When running tez query, the
“Applications” page shows the job as “HIVE-9c5a8bf1-911b-427a-8d16” for
example, which is not helpful, especially when a ton of jobs running at the
same time. So is there any way to customize the app name
So no one has a solution?
From: Frank Luo
Sent: Thursday, January 19, 2017 6:14 PM
To: user@hive.apache.org
Cc: Shylaja H. Nagenhalli
Subject: how to customize tez query app name
When running tez query, the “Applications” page shows the job as
“HIVE-9c5a8bf1-911b-427a-8d16” for example, which
When running tez query, the “Applications” page shows the job as
“HIVE-9c5a8bf1-911b-427a-8d16” for example, which is not helpful, especially
when a ton of jobs running at the same time.
So is there any way to customize the app name?
“mapreduce.job.name” works for M/R queries, not Tez.
Thx
...@hortonworks.com] On Behalf Of Gopal
Vijayaraghavan
Sent: Monday, July 27, 2015 9:20 PM
To: u...@tez.apache.org; user@hive.apache.org
Cc: Jim Green
Subject: Re: Hive on Tez query failed with ³wrong key class"
> From the java code which creates the sequence file, it has set the key
&
> From the java code which creates the sequence file, it has set the key
>class to NullWritable.class:
> job.setOutputKeyClass(org.apache.hadoop.io.NullWritable.class);
...
> I think that caused the mismatch:
> wrong key class: org.apache.hadoop.io.BytesWritable is not class
>org.apache.hadoop.i
Next(HiveContextAwareRecordReader.java:358)
> ... 21 more
> ],
>
>
>
> On Tue, Jul 21, 2015 at 11:26 AM, Bikas Saha
> wrote:
>
>> A full stack trace would help determine is this is a Tez issue or hive
>> issue.
>>
>>
>>
>> *
uly 21, 2015 11:12 AM
> *To:* u...@tez.apache.org; user@hive.apache.org
> *Subject:* Hive on Tez query failed with “wrong key class"
>
>
>
> Hi Team,
>
>
>
> Env: Hive 1.0 on Tez 0.5.3
>
> Query is a simple group-by on top of sequence table.
>
>
>
&
> Query is a simple group-by on top of sequence table.
...
> java.io.IOException: java.io.IOException: wrong key class:
>org.apache.hadoop.io.BytesWritable is not class
>org.apache.hadoop.io.NullWritable
I have seen this issue when mixing Sequence files written by PIG with
Sequence files written
A full stack trace would help determine is this is a Tez issue or hive issue.
From: Jim Green [mailto:openkbi...@gmail.com]
Sent: Tuesday, July 21, 2015 11:12 AM
To: u...@tez.apache.org; user@hive.apache.org
Subject: Hive on Tez query failed with “wrong key class"
Hi Team,
Env: Hive 1.0 o
Hi Team,
Env: Hive 1.0 on Tez 0.5.3
Query is a simple group-by on top of sequence table.
It fails with below error on tez mode:
*java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException: *
*java.io.IOException: java.io.IOException: wrong key class:
org.apache.hadoop.io.BytesWr
BTW , my hadoop version is 2.3.0-cdh5.0.2
r7raul1...@163.com
From: Jeff Zhang
Date: 2015-06-29 13:23
To: user
Subject: Re: hive -e run tez query error
> But keeping that client cache disabled when running against trunk generally
> kills queries all the time with occasional errors like
> But keeping that client cache disabled when running against trunk generally
kills queries all the time with occasional errors like these.
I think tez staging directory is supposed to be deleted when JVM exit
(deleteOnExit), why killing query will cause the path deleted ?
On Sat, Jun 27, 2015
> perhaps deleteOnExit() is set somewhere
fs.cache.disable settings from hdfs-site.xml are usually to blame for that.
Till hive-1.0, HiveServer2 used to leak filesystem objects, so the cache
was disabled.
> 2015-06-25 15:54:33,673 INFO FSNamesystem.audit: allowed=true
>ugi=lujian (auth:SIMPLE)
perhaps deleteOnExit() is set somewhere
From: Jeff Zhang mailto:zjf...@gmail.com>>
Reply-To: User mailto:user@hive.apache.org>>
Date: Thursday, June 25, 2015 at 2:09 AM
To: User mailto:user@hive.apache.org>>
Subject: Re: hive -e run tez query error
The drop table command bet
5-06-23 13:53
> *To:* user
> *Subject:* hive -e run tez query error
> When I use hive 1.1.0 on tez 0.53 in hadoop 2.3.0:
>
> *hive -v -e "set hive.execution.engine=tez;set mapred.job.queue.name
> <http://mapred.job.queue.name>=bi_etl;drop table TESTTMP.a_sta
Sorry , I made a mistake,
use hivecli to execute same query on tez ,throw the same exception.
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-06-23 13:53
To: user
Subject: hive -e run tez query error
When I use hive 1.1.0 on tez 0.53 in hadoop 2.3.0:
hive -v -e &quo
When I use hive 1.1.0 on tez 0.53 in hadoop 2.3.0:
hive -v -e "set hive.execution.engine=tez;set mapred.job.queue.name=bi_etl;drop
table TESTTMP.a_start;create table TESTTMP.a_start(id bigint);insert overwrite
table TESTTMP.a_start select id from tandem.p_city;drop table
TESTTMP.a_end;create ta
2015-03-03 1:03 GMT+08:00 P lva :
> Hello Everyone,
>
> I was able to look up the query of hive using hive.query.name from job
> history server. I wasn't able to find a similar parameter for tez.
>
> Is there a way where you could find out all the queries that ran in a tez
> session ?
>
> Thanks
>
Hello Everyone,
I was able to look up the query of hive using hive.query.name from job
history server. I wasn't able to find a similar parameter for tez.
Is there a way where you could find out all the queries that ran in a tez
session ?
Thanks
23 matches
Mail list logo
