I checked my setting, all are with the default value.So per the book of "Hadoop
the definitive guide", the split size should be 64M. And the file size is about
500M, so that's about 8 splits. And from the map job information (after the map
job is done), I can see it gets 8 split from one node. B
If you actually have splittable files you can set the following setting to
create more splits:
mapred.max.split.size appropriately.
Thanks
Vaibhav
From: Daniel,Wu [mailto:hadoop...@163.com]
Sent: Tuesday, August 23, 2011 6:51 AM
To: hive
Subject: Why a sql only use one map task?
I run the fo
Hi Amit,
Pls check this issue HIVE-1405 it will help u .This issue targeting same
scenario.
Thanks
Chinna Rao Lalam
> Hi Chinna,
> That worked, Thanks a lot. So once the jar is picked up, is
> there a way
> to create a temporary function, that is retained even if i quit the
> interactive
Hi Chinna,
That worked, Thanks a lot. So once the jar is picked up, is there a way
to create a temporary function, that is retained even if i quit the
interactive shell and start it again? Or do i have to use the create
command to register the function everytime?
Thanks.
Amit
On Mon, Aug 22,
Have you created the metastore mysql tables for authorization? Can u
do a show grant?
thanks
yongqiang
On Tue, Aug 16, 2011 at 2:55 PM, Alex Holmes wrote:
> Hi all,
>
> I've been struggling with getting Hive authorization to work for a few
> hours, and I really hope someone can help me. I instal
No, I didn't use zip, it's just simple csv file, and then use the command
load data local inpath '/home/oracle/sales.csv' into table test;
to load into hive. I am not sure whether this command alone can distribute the
file evenly into the cluster (on 3 nodes). So I used the following com
hey did u storing data in zipped format
if yes becoz of that its only split in single map.
2011/8/23 Daniel,Wu
> I run the following simple sql
> select count(*) from sales;
> And the job information shows it only uses one map task.
>
> The underlying hadoop has 3 data/data nodes. So I expect
HI team,
i m facing this problem.
show tables is running fine but when i run below query.
hive> select * from aircel_obd;
FAILED: Hive Internal Error: java.lang.NullPointerException(null)
java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java
I run the following simple sql
select count(*) from sales;
And the job information shows it only uses one map task.
The underlying hadoop has 3 data/data nodes. So I expect hive should kick off 3
map tasks, one on each task nodes. What can make hive only run one map task? Do
I need to set some
10 matches
Mail list logo
