Re: hive client OutOfMemoryError

2014-09-28 Thread Oliver Keyes
Bah. *similar error. On 28 September 2014 12:39, Oliver Keyes wrote: > I run into that error, or a simpler error, rather a lot; I consider it > pretty normal (although experiences may differ). > > A more direct way of increasing the heapsize would be export > HADOOP_HEAPSIZ

Re: hive client OutOfMemoryError

2014-09-28 Thread Oliver Keyes
ent > heapsize, then the sql is ok. > I saw CommonJoinResolver line 589: > InputStream in = new ByteArrayInputStream(xml.getBytes("UTF-8")); > > hive client need so many heapsize, is this normal > And where Can I find this large xml > > > Thanks > -- Oliver Keyes Research Analyst Wikimedia Foundation

Re: Permission denied creating external table

2014-03-24 Thread Oliver
Hi Rahman, On 24 March 2014 16:45, Abdelrahman Shettia wrote: > Hi Oliver, > > Can you perform a simple test of hadoop fs -cat > hdfs:///logs/2014/03-24/actual_log_file_name.seq by the same user? Also > what are the configurations setting for the following? > Yes, I can acc

Permission denied creating external table

2014-03-24 Thread Oliver
e_name.seq'; However I get this error back when doing so: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:Got exception: org.apache.hadoop.security.AccessControlException Permission denied: user=oliver, access=WRITE, inode=&q

Sampling from a single column

2014-02-11 Thread Oliver Keyes
Hey all So, what I'm looking to do is get N randomly-sampled distinct values from a column in a table. I'm kind of flummoxed by how to do this without using TABLESAMPLE, which would require me to add Yet Another Subquery (it'd be 'select these values, from this sample, from these distinct values')

Re: Joins between databases

2014-02-06 Thread Oliver Keyes
Noted for future queries, and thanks for the help! Works like a charm :). Best, -- Oliver Keyes Product Analyst Wikimedia Foundation On 6 February 2014 17:09, Stephen Sprague wrote: > ahh. we got ourselves a bona-fide head banger. Welcome to the club!! :) > > select > a

Joins between databases

2014-02-06 Thread Oliver Keyes
with, say, retrieving the entire dataset in a subquery and then selecting from that, but each time I run into the same sort of problem. Can anybody help point out where I'm going wrong? Thanks! -Oliver

RE: custom UDF throws "No matching method for class"

2012-12-23 Thread Oliver Krohne
(float) _FUNC_(string) _FUNC_(timestamp) I don't need null support. Can you explain the issue? Thanks,Oliver Date: Sun, 23 Dec 2012 10:44:26 -0500 Subject: Re: custom UDF throws "No matching method for class" From: edlinuxg...@gmail.com To: user@hive.apache.org Unless you need spec

custom UDF throws "No matching method for class"

2012-12-23 Thread Oliver Krohne
.hive.udf.UDFCurrencyConverter with (double, string, string). Possible choices: _FUNC_(org.apache.hadoop.io.DoubleWritable, string, string) That is with Hive version 0.8.1.6 Has anybody a hint what is going wrong? Thanks,Oliver

Selecting nulls returns nothing

2012-04-25 Thread Oliver Meyn (GBIF)
throws NPE because it gets no result back from Hive. Anyone else seen this behaviour? Thanks, Oliver -- Oliver Meyn Software Developer Global Biodiversity Information Facility (GBIF) +45 35 32 15 12 http://www.gbif.org