problems with beeline and "add file"

I misconfigured something. Regards, -- Rohan Monga

Re: casting complex data types for outputs of custom scripts

sorry for the delayed response. yes the python script follows that. -- Rohan Monga On Tue, Jan 14, 2014 at 4:31 PM, Stephen Sprague wrote: > @OP - first thing i'd ask is does your python script obey the ^A,^B,^C,^D > etc. nesting delimiter pattern. give that your create tab

casting complex data types for outputs of custom scripts

ter by g1 ) m insert overwrite table t1 reduce m.g1, m.g2, m.g3 using 'python customScript.py' as ( f1 , f2 ); however f2 is not being loaded properly into t1, it comes up broken or null. What should I do so that f2 is loaded as an array of structs. Thanks, -- Rohan Monga

Re: Invoke a UDAF inside another UDAF

thanks Mark, I ended up going the custom reducer way. I will try out the query you have sent. Regards, -- Rohan Monga On Wed, Feb 1, 2012 at 11:06 AM, Mark Grover wrote: > Rohan, > You could do it one of the following ways: > 1) Write a UDAF that does the avg(f2 - avg_f2) computa

Re: Invoke a UDAF inside another UDAF

and the information being lost ] :) But why the nullpointer exception? Regards, -- Rohan Monga On Fri, Jan 20, 2012 at 2:32 PM, Edward Capriolo wrote: > IMHO You can not possibly nest the percentile calculation because the > results would be meaningless. percentile has to aggregate a s

Re: Invoke a UDAF inside another UDAF

this to work? Thanks, -- Rohan Monga On Fri, Jan 20, 2012 at 12:51 PM, Edward Capriolo wrote: > I think if you are grouping by b, b has to be in your select list. Try > this. > FROM ( > select b,count(a) as theCount from table one group by b > ) a select mean(theCount); > >

Invoke a UDAF inside another UDAF

39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:197) Is there a workaround ? I have tried with hive 0.7.1 and 0.8 Thanks -- Rohan Monga

Re: Confusion about IN clause

Yup, sub-queries don't work in the where clause. Is there another document and/or JIRA that i can look at for the implementation of IN clause? Regards, -- Rohan Monga On Mon, Dec 12, 2011 at 10:19 PM, Igor Tatarinov wrote: > I think the doc refers to an IN subquery > WHERE x IN (

Re: New to hive

i would also recommend cloudera tutorials. -- Rohan Monga On Tue, Dec 13, 2011 at 3:50 AM, Mohammad Tariq wrote: > Hi Praveenesh, > > If you want something other than the wiki, you can use books > like "Hadoop definitive guide" or "Hadoop in action"

Confusion about IN clause

able where row in (1,2,3); work. and I found this JIRA https://issues.apache.org/jira/browse/HIVE-801which kinda shows that it should work. Was this feature deprecated in the later version ( 0.7.1) or is the documentation out of sync? Thanks, -- Rohan Monga

Re: Severely hit by "curse of last reducer"

i. Thanks, -- Rohan Monga On Thu, Nov 17, 2011 at 2:02 PM, Mark Grover wrote: > Rohan, > The short answer is: I don't know:-) If you could paste the log, I or someone > else of the mailing list could be able to help. > > BTW, What version of Hive were you using? Did you set t

Re: Severely hit by "curse of last reducer"

Hi Mark, I have tried setting hive.optimize.skewjoin=true, but it get a NullPointerException after the first stage of the query completes. Why does that happen? Thanks, -- Rohan Monga On Thu, Nov 17, 2011 at 1:37 PM, Mark Grover wrote: > Ayon, > I see. From what you explained, skew join

Re: problems with indices

Hi Prajakta, I get it now. But are there plans to support groupbys of that format, or would I be able to write a UDF of sorts to do that? Also, could you please give me an example of accelerating equi-joins with indices, I haven't been able to get that to work either :( Regards, -- Rohan

Re: problems with indices

s to speed up joins? And for the semantic analysis thing, I sent the error in my first email, here are the lines that I modified to get it to work. Basically changed "_count_Of" to "_count_of" Regards, -- Rohan Monga On Wed, Sep 21, 2011 at 4:22 AM, Prajakta Kalmegh wrote: &

problems with indices

mes were almost the same. Also 'explain' on the queries show identical query plans. I am using hive revision 1172989 from trunk Could someone help me with this? Regards, -- Rohan Monga

Re: CREATE INDEX

yup, I'd be interested in this too. I'd like to know how the indices are applied/used and which queries can they be useful. Thanks, -- Rohan Monga On Mon, Sep 12, 2011 at 6:16 PM, Adriaan Tijsseling wrote: > Does anyone know the proper documentation for using the "CREATE IN

Problem with custom map-reduce scripts

o insert overwrite table mytable2 reduce mo.c1, mo.c2, mo.c3 using 'python convert.py' as x1, x2; Say, the missing record was for c1=1, then with this query, the record shows up in mytable2. Is there something I am missing ? Regards, -- Rohan Monga

Comments in hive scripts

before removing comments? or am I missing something? Thanks, -- Rohan Monga