Can you also check your hive site XML ?
Is it properly formatted and connection strings correct ?
Sent from my iPhone
On Jun 19, 2013, at 6:30 PM, Mohammad Tariq wrote:
> Hello Anurag,
>
>Thank you for the quick response. Log files is full of such lines along
> with a trace that says it i
Try:
Export HADOOP_HEAPSIZE=1000 ( 1gb) Before running your hive query
And keep keep increasing the size to needed value
Another option is setting Xmx in hive-env.sh
Sent from my iPhone
On Oct 27, 2012, at 12:21 PM, Peter Marron
wrote:
> Hi,
>
> I have a fairly low-end machine running Ubu
Hi,
We have datasets which are about 10-15 TB in size.
We want to run hive queries on top of this input data.
What are ways to reduce stress on our cluster for running many such big
queries( include joins too) in parallel ?
How to enable compression etc for intermediate hive output ?
How to make
Hi Vinod,
Do you use remote server configuration ?
What version of hive do you use ?
We are using 0.7.1 where we see this issue.
Sent from my iPhone
On Aug 11, 2012, at 12:39 AM, Vinod Singh wrote:
> We run Hive jobs on 20+ TB data without any issues.
>
> Thanks,
> Vinod
>
> On Sat, Aug 11,
Sqoop is a nice tool to get dAta to/from DB2 to hive and then you can run hive
queries on top of it.
Lot of people are using this for traditional DBs and hadoop connectivity.
Sent from my iPhone
On Jul 26, 2012, at 11:32 AM, Siddharth Tiwari
wrote:
> Hey Team,
>
> We have huge tables in Mai
You can create an external table to make your Data visible in hive.
Sent from my iPhone
On Jul 11, 2012, at 7:39 AM, shaik ahamed wrote:
> Hi All,
>
>As i have a data of 100GB in HDFS as i want this 100 gb file to
> move or copy to the hive directory or path how can i achieve th
y fix is to define a table with one
> field and create a view split function on top . I dont want this additional
> overheard, if I can make the input format work with the ctrl char as the
> delimiter.
>
> Mapred Learn,
>
> Yes I did have the word 'external' in
Did you add the word external in create table I.e.
Create external table(...blah...blah...)
Sent from my iPhone
On Jun 19, 2012, at 4:15 PM, Sam William wrote:
> Hi,
> I have a data file that is exactly equivalent to a CSV , except that the
> field delimiter is a control character specifi
Hi,
Does anyone know how to set up apache hive on MAC to contribute and fix JIRAs ?
Thanks,
JJ
Sent from my iPhone
Try setting this value to your block
Size, for 128 mb block size,
> set mapred.min.split.size=128000
Sent from my iPhone
On May 7, 2012, at 10:11 PM, Bhavesh Shah wrote:
> Thanks Nitin for your reply.
>
> In short my Task is
> 1) Initially I want to import the data from MS SQL Server into HD
Hive 0.8.0 has row_sequence UDF but it generates unique seq ids only per
mapper, not across the job.
Sent from my iPhone
On Jan 27, 2012, at 8:37 AM, Anson Abraham wrote:
> Does Hive support automated sequence Id generation, or does a "udf" have to
> be created per each object that is created
Try changing one of following property in file listed before them :
hive-exec-log4j.properties:hive.log.dir=/tmp/${user.name}
hive-log4j.properties:hive.log.dir=/tmp/${user.name}
On Thu, Jan 26, 2012 at 3:40 PM, Tucker, Matt wrote:
> We’ve started noticing that some of the hive job logs
> (hi
> SELECT * FROM temp_view_1 GROUP BY A,B,C;
>
> DROP VIEW temp_view_1;
>
> The creation and usage of views won't create much significant overhead on
> your query execution as well.
>
> Hope it helps !...
>
> Regards
> Bejoy.K.S
>
> From: Mapred Le
Hi,
I have a following smaple query:
select
A,
CASE
WHEN B IN(1,2) THEN 'Type A'
ELSE 'Type B'
END AS B,
C
from table_a
groupby
A, B, C;
But when i run this query, it gives error:
FAILED: Error in semantic analysis: Line 95:0 Invalid table alias or column
reference entity
This error is from B
You could write your query to a file and do something like:
hive -f &
hive -f &
etc. to invoke many instances in parallel.
On Tue, Nov 15, 2011 at 3:24 AM, Chinna Rao Lalam wrote:
> Hi,
>
>
>
> Hive calls are blocking calls because once the query is executed it will
> return the ResultSet
Yes it does
Sent from my iPhone
On Oct 5, 2011, at 4:21 PM, "Navin Gupta" wrote:
> Do you know if partition work for external tables ?
>
>
>
> Thanks
>
>
>
> From: Mapred Learn [mailto:mapred.le...@gmail.com]
> Sent: Wednesday, October 05,
Hive external table is your solution
Sent from my iPhone
On Oct 5, 2011, at 11:29 AM, "Navin Gupta" wrote:
> Hi,
>
>The loading of data into hive table currently moves the data if the
> location is hdfs (NON LOCAL). Is there an option that would allow to copy the
> data instead ?
>
>
U shud create partitions by date and add partitions by alter table cmnd daily
U can then query data by date partition
Sent from my iPhone
On Aug 12, 2011, at 1:16 PM, Sam William wrote:
>
> I have a case where I want to dump data daily under
>
> /user/sampd/test/{date}.
>
>
> I thought
Hi,
Could somebody point me to some wiki abt how to create a UDF In hive ?
My problem is how to include hive code in my build path to import exec.UDAF.
I downloaded hive code from cloudera's distribution.
Any help is appreciated !
-JJ
Sent from my iPhone
w wiki here:
> https://cwiki.apache.org/confluence/pages/listpages-dirview.action?key=Hive
>
> Tim
>
>
>
>
>
> On Tue, Jun 28, 2011 at 9:54 AM, Mapred Learn wrote:
>
>> Hi,
>> Looks the documentation link you guys provided earlier is moved to some
>> other location:
&
rement to support data from the SequenceFile "KEY" (not the
> > "VALUE") to be used by Hive table. How can I do this. From the code, it
> > looks like the "VALUE" part is available for Hive. Please help.
> >
> > Regards.
> >
>
Hi,
I have seq files with key as line number and value is ctrl B delimited text.
a sample value is:
45454^B567^Brtrt^B-7.8
56577^B345^Bdrtd^B-0.9
when I create a table like:
create table temp_seq (no. int, code string, rank string, amt string)
row format delimited fields terminated by '\002' lines
te command ?
On Fri, Jun 24, 2011 at 5:12 PM, Steven Wong wrote:
> Not sure if this is what you’re asking for: Hive has a LOAD DATA command.
> There is no decimal data type.
>
> ** **
>
> ** **
>
> *From:* Mapred Learn [mailto:mapred.le...@gmail.com]
> *Sent:* Thursda
> Hi,
> I have a sequence file where The value is text with delimited data and some
> fields are decimal fields.
> For eg: decimal(16,6). Sample value : 123.456735.
> How do I upload such a sequence file in hive and what shud I give in table
> definition for decimal values as above ?
>
> Thanks
Hi,
I have a sequence file where I have delimited data and some data is decimal
fields.
For eg: decimal(16,6). Sample value : 123.456735.
How do I upload such a sequence file and what shud I give in table definition
for decimal values as above ?
Thanks in advance !
Sent from my iPhone
Oops I meant nulls.
Sent from my iPhone
On Feb 22, 2011, at 8:22 PM, Mapred Learn wrote:
> Check if you can filter non-nulls. That might help.
>
> Sent from my iPhone
>
> On Feb 22, 2011, at 12:46 AM, Bennie Schut wrote:
>
>> I've just set the "hive.exec
Check if you can filter non-nulls. That might help.
Sent from my iPhone
On Feb 22, 2011, at 12:46 AM, Bennie Schut wrote:
> I've just set the "hive.exec.reducers.bytes.per.reducer" to as low as 100k
> which caused this job to run with 999 reducers. I still have 5 tasks failing
> with an outof
Thanks Ted !
Just found it few minutes ago.
On Feb 17, 2011, at 1:46 PM, Ted Yu wrote:
> Look under http://wiki.apache.org/hadoop/Hive/LanguageManual/DDL#Create_Table
>
> On Thu, Feb 17, 2011 at 12:00 PM, Mapred Learn wrote:
> Hi,
> I was wondering if hive supports Sequence
Hi,
I was wondering if hive supports Sequence File format. If yes, could me
point me to some documentation about how to use Seq files in hive.
Thanks,
-JJ
29 matches
Mail list logo
