/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
r7raul1...@163.com
applog_hivetez.txt
Description: Binary data
Hello,
How to query data by page in Hive?
hive> select * from u_data a limit 1,2;
FAILED: ParseException line 1:31 missing EOF at ',' near '1'
r7raul1...@163.com
Thank you Devopam! Could you show me a example?
r7raul1...@163.com
From: Devopam Mittra
Date: 2015-02-05 18:05
To: user@hive.apache.org
Subject: Re: How to query data by page in Hive?
You may want to use a ROW_NUMBER OR RANK / DENSE RANK in the inner query and
then select only a subset of
IgnoreKeyTextOutputFormat'
LOCATION
'hdfs://localhost:8020/user/hive/warehouse/u_data'
TBLPROPERTIES (
'COLUMN_STATS_ACCURATE'='true',
'numFiles'='1',
'numRows'='0',
'rawDataSize'='0',
'totalS
Thank you ~
r7raul1...@163.com
From: Devopam Mittra
Date: 2015-02-24 20:15
To: user@hive.apache.org
Subject: Re: Re: How to query data by page in Hive?
Apologies for the extended delay in providing response. I totally forgot about
this one and got stuck in other things.
Please find below a
image object. It would be wasteful to actually invoke
thumbnail on each reference to an image.
Question:
1 Hive support udf cache ?
2 How hive implement udf cache?
r7raul1...@163.com
Try select * from table limit 1;
r7raul1...@163.com
From: Jadhav Shweta
Date: 2015-02-25 17:38
To: user
Subject: Re: ERROR OutOfMemoryError: Java heap space
Hi
I have installed apache hive 0.13.0.
I have configured metastore as postgres db.
Query is working fine in beeline command line
Use yarn logs -applicationId to see detail log.
r7raul1...@163.com
From: Jadhav Shweta
Date: 2015-02-26 15:00
To: user
Subject: Re: ERROR OutOfMemoryError: Java heap space
Hi,
I tried running same query from Simple JDBC Client instead of Spring Batch
framework its was working fine.
But
I type plhql --version but meet error bash: /usr/plhql/plhql:
/bin/bash^M: bad interpreter: No such file or directory
r7raul1...@163.com
From: Dmitry Tolpeko
Date: 2015-02-28 04:36
To: user
Subject: PL/HQL - Procedural SQL-on-Hadoop
Let me introduce PL/HQL, an open source tool that
read this article
http://www.philippeadjiman.com/blog/2009/12/20/hadoop-tutorial-series-issue-2-getting-started-with-customized-partitioning/
then read
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+SortBy
r7raul1...@163.com
From: max scalf
Date: 2015-03-08 07:02
To
ource)
at org.apache.hadoop.hive.ql.metadata.Hive.showCompactions(Hive.java:2848)
... 20 more
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask.
org.apache.thrift.transport.TTransportException
but run sql the job is ok.
r7raul1...@163.com
My hive version is hive 0.14.0 , type SHOW COMPACTIONS in cli return exception.
But I type sql in the cli ,the sql run successful on mr.
r7raul1...@163.com
From: Alan Gates
Date: 2015-03-19 00:17
To: user
Subject: Re: SHOW COMPACTIONS fail with remote metastore
When you say "but ru
va:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
r7raul1...@163.com
I fix it . Need also replace the Hadoop23Shims.class in hive-exe.jar
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-03-19 10:34
To: user
Subject: Hive 1.1.0 not compatible with Hadoop 2.3.0
I follow this jira https://issues.apache.org/jira/browse/HIVE-9957 ,then build
a new hive
115883224 2015-01-19 14:26:28
Why ? I attach my log. Also in my log I found 2015-04-01 09:55:38,409 WARN
[main] org.apache.hadoop.hive.serde2.lazy.LazyStruct: Extra bytes detected at
the end of the row! Ignoring similar problems.
r7raul1...@163.com
log.TXT
Description: Binary data
try set mapreduce.job.reduces
r7raul1...@163.com
发件人： 郭帅
发送时间： 2015-03-27 18:17
收件人： hiveMailing
主题： change Reduce_Number Of Order_By
I have some problems when I insert data with order by .
The data is non-uniform ， I changed the configuration below
1. set
14837289 NULL
Y49EY895ACABHS95DRQEE8DVFEB8JSE12360853052224 111501191426280023
115883224 NULL
r7raul1...@163.com
SELECT
FROM A LEFT SEMI JOIN B
ON (A.col1 = B.col2)
WHERE ...
"
If A.col1 is of DOUBLE type, but B.col2 is of BIGINT, will print WARNING:
Comparing a bigint and a double may result in a loss of precision. Why can't
cast col2 to double automatically?
r7raul1...@163.com
Thank you!
r7raul1...@163.com
From: Gopal Vijayaraghavan
Date: 2015-05-04 16:10
To: user
CC: r7raul1...@163.com
Subject: Re: join on different data type
> If A.col1 is of DOUBLE type,
> but B.col2 is of BIGINT,
The automatic conversion is not acceptable according to the java la
IF join on A.col1 == B.col2
col1 is string
col2 is bigint
The automatic conversion is support? All cast to string?
r7raul1...@163.com
From: Gopal Vijayaraghavan
Date: 2015-05-04 16:10
To: user
CC: r7raul1...@163.com
Subject: Re: join on different data type
> If A.col1 is of DOUBLE t
I want to turn my single namenode to namenode HA. How to config hive ?
r7raul1...@163.com
Reducer 8 .. SUCCEEDED 203 203 0 0 0 0
VERTICES: 11/13 [==>>] 55% ELAPSED TIME: 307.54 s
What is the root cause ?
r7raul1...@163.com
sql.txt
Description: Binary data
queryplan.TXT
Description: Binary data
Thank you!
r7raul1...@163.com
From: Gerald-G
Date: 2015-05-06 10:35
To: user
Subject: Re: How to config hive when using namenode HA
Upgrading the Hive Metastore to Use HDFS HA Using the Command Line
To configure the Hive metastore to use HDFS HA, change the records to reflect
the location
crease....
r7raul1...@163.com
=true;
Thanks
Jitendra
On Mon, May 11, 2015 at 12:35 PM, r7raul1...@163.com wrote:
Status: Running (Executing on YARN cluster with App id
application_1419300485749_1493279)
VERTICES STATUS TOTAL COM
I see only 1 reduce run forerver. Skew join?
r7raul1...@163.com
From: Eugene Koifman
Date: 2015-05-12 01:43
To: user
CC: r7raul1...@163.com
Subject: Re: hive sql on tez run forever
This isn’t a valid rewrite.
if a(x,y) has 1 row (1,2) and b(x,z) has 1 row (1,1) then the 1st query
will
string), comb_prod_id (type: bigint)
r7raul1...@163.com
I want to pring lineage info of sql. I found this jira
https://issues.apache.org/jira/browse/HIVE-1131 . How to use it?
r7raul1...@163.com
config hdfs acl
http://zh.hortonworks.com/blog/hdfs-acls-fine-grained-permissions-hdfs-files-hadoop/
r7raul1...@163.com
From: Anupam sinha
Date: 2015-05-21 12:44
To: user
Subject: Re: upgrade of Hadoop cluster from 5.1.2 to 5.2.1.
Hello everyone,
i am a member of nested group which has
If you use hadoop2.4+ ,try tez ui.
r7raul1...@163.com
From: Jagat Singh
Date: 2015-05-26 06:41
To: user
Subject: Monitoring Hive Tez jobs
Hi,
How to monitor logs for the Hive Tez jobs.
In the shell i can see the progress of the Hive job.
If i click the application master on RM i get
You can refer to the cursor columns using cur_name.col_name syntax
Great job!
r7raul1...@163.com
From: Dmitry Tolpeko
Date: 2015-05-01 03:43
To: user
Subject: Re: PL/HQL - Procedural SQL-on-Hadoop
Hi everyone,
PL/HQL 0.3.1 released today. There are some features I hope you find
I use hive1.1.0 beeline remote connect to hiveserver2. When I submit query ,
only query result return. No log return. Where can I find the execution log?
r7raul1...@163.com
:hive2://10.4.11.4:1,the query
log disappear
jdbc:hive2://10.4.11.4:1> select count(*) from p_city;
+--+--+
| _c0 |
+--+--+
| 531 |
+------+--+
r7raul1...@163.com
From: Chinna Rao Lalam
Date: 2015-05-27 12:35
To: user
Subject: Re: Beeline connect to hiveserver2 didn&#x
bAlias.equals("")){
lhs = new ASTNode(new CommonToken(DOT,"."));
ASTNode dotlhs = new ASTNode(new
CommonToken(TOK_TABLE_OR_COL,"TOK_TABLE_OR_COL"));
dotlhs.addChild(new ASTNode(new CommonToken(string,tabAlias)));
lhs.addChild(dotlhs);
}else{
lhs = new ASTNode(ne
http://stackoverflow.com/questions/17461932/hive-execution-hook
r7raul1...@163.com
From: Amitosh Anand, IDD M Tech, Computer Sci. & Engg., IIT (BHU) Varanasi
Date: 2015-06-02 17:45
To: user
Subject: Tables affected by a query
Hi,
I have been trying to build a hook for hive. I require to
hive -hiveconf hive.root.logger=DEBUG,consoleTo See some debug log
r7raul1...@163.com
From: Sateesh Karuturi
Date: 2015-06-08 16:15
To: user
Subject: hive tez error
getting FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.tez.TezTask
error... when iam trying
r.initiator.on
true
hive.compactor.worker.threads
4
r7raul1...@163.com
SHOW COMPACTIONS;
I can see some info
Database Table Partition Type State Worker Start Time
default u_data_txn NULL MAJOR initiated NULL 0
Time taken: 0.024 seconds, Fetched: 2 row(s)
But after that I still see many delta file.
r7raul1...@163.com
From: Elliot West
Date: 2015-06-11 15:25
Any help?
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-06-11 15:53
To: user
Subject: Re: Re: delta file compact take no effect
SHOW COMPACTIONS;
I can see some info
Database Table Partition Type State Worker Start Time
default u_data_txn NULL MAJOR initiated NULL 0
Time taken
My config is on my client. What is metastore config?
r7raul1...@163.com
From: Alan Gates
Date: 2015-06-17 13:42
To: user
Subject: Re: delta file compact take no effect
Is the config you give on your metastore or your client? The worker thread and
initiator must be started on the metastore
Thank you! I will try
r7raul1...@163.com
From: Alan Gates
Date: 2015-06-18 08:33
To: user
Subject: Re: delta file compact take no effect
See
https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration
Compaction is initiated by the thrift metastore
s: 30
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-06-18 08:37
To: user
Subject: Re: Re: delta file compact take no effect
Thank you! I will try
r7raul1...@163.com
From: Alan Gates
Date: 2015-06-18 08:33
To: user
Subject: Re: delta file compact take no effect
See
https://cwiki.apach
My hive version is 1.1.0
r7raul1...@163.com
From: Alan Gates
Date: 2015-06-18 23:25
To: user
Subject: Re: delta file compact take no effect
Which version of Hive are you running? A number of deadlock issues were
resolved in HIVE-10500 which was released in Hive 1.2. Based on your log it
exception throw.
use hive -e to execute same query on mr ,no exeception throw
r7raul1...@163.com
Sorry , I made a mistake,
use hivecli to execute same query on tez ,throw the same exception.
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-06-23 13:53
To: user
Subject: hive -e run tez query error
When I use hive 1.1.0 on tez 0.53 in hadoop 2.3.0:
hive -v -e &quo
BTW , my hadoop version is 2.3.0-cdh5.0.2
r7raul1...@163.com
From: Jeff Zhang
Date: 2015-06-29 13:23
To: user
Subject: Re: hive -e run tez query error
> But keeping that client cache disabled when running against trunk generally
> kills queries all the time with occasional errors like
I use MR.
My mapjoin config as showed in follow picture:
r7raul1...@163.com
From: Sergey Shelukhin
Date: 2015-08-28 09:21
To: user
Subject: Re: sql mapjoin very slow
Are you using MR and Tez? You could try optimized hash table in case of Tez,
although it’s supposed to improve memory, not
I increase hive.hashtable.initialCapacity to 100 and decrease
hive.hashtable.loadfactor to 0.5 . The query run faster.
r7raul1...@163.com
From: Sergey Shelukhin
Date: 2015-08-28 09:56
To: user
Subject: Re: sql mapjoin very slow
Is the small-side table large, does it have a lot of rows
lass default value is fs.
Mean store statistics in local filesystem. Any one can tell what is the file
path to store statistics ?
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-08-28 13:03
To: user
Subject: Re: Re: sql mapjoin very slow
I increase hive.hashtable.initialC
)
4 UDFToDouble(attr_detl_id) (type: double)
r7raul1...@163.com
From: Gopal Vijayaraghavan
Date: 2015-08-29 01:45
To: user
Subject: Re: sql mapjoin very slow
> I have a question. I use hive 1.1.0 ,so hive.stats.dbclass default value
>is fs. Mean store statistics
>
start hiveserver2 with --hiveconf hive.root.logger=DEBUG,console. Then
check hiveserver2 log.
r7raul1...@163.com
From: Jerrick Hoang
Date: 2015-10-20 09:03
To: user
Subject: Hiveserver2 client stdout
Hi all,
I have a hiveserver2 client running on a remote server. I'm able to co
That would just increase the log level on the server side right? YES You
can check the log in detail.
r7raul1...@163.com
From: Jerrick Hoang
Date: 2015-10-20 11:55
To: user
Subject: Re: Hiveserver2 client stdout
That would just increase the log level on the server side right? I want
Or you can use --verbose=[true/false] when use jdbc client.
Show verbose error messages and debug information (true) or do not show
(false). Default is false.
Usage: beeline --verbose=true
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-10-20 13:07
To: user
Subject: Re: Re
/false]
Display nested errors. Default is false.
Usage: beeline --showNestedErrs=true
r7raul1...@163.com
From: Jerrick Hoang
Date: 2015-10-20 11:55
To: user
Subject: Re: Hiveserver2 client stdout
That would just increase the log level on the server side right? I want the
stdout log sent to the
Place the file on the hiveserver2 host local filesystem . Then try load
data local inpath
r7raul1...@163.com
From: Vineet Mishra
Date: 2015-10-21 03:05
To: user
CC: cdh-user
Subject: Re: HiveServer2 load data inpath fails
Any update around this?
0: jdbc:hive2://hadoop-hs2:1> l
decrease the number of output files.
r7raul1...@163.com
From: Jagat Singh
Date: 2015-10-21 08:49
To: user
Subject: Hive ORC file execption serious problem
We are using Hive 0.14
Our input file size is around 100 GB uncompressed
We are using insering this data to hive which is ORC based table , ZLIB
.log.PerfLogger -
65957 [uber-SubtaskRunner] INFO org.apache.hadoop.hive.ql.log.PerfLogger -
66040 [uber-SubtaskRunner] INFO org.apache.hadoop.hive.ql.log.PerfLogger -
66041 [uber-SubtaskRunner] INFO org.apache.hadoop.hive.ql.log.PerfLogger -
r7raul1...@163.com
57 matches
Mail list logo
