Re: Run hive queries, and collect job information

2013-01-30 Thread Mathieu Despriee
il.java > > Regard, > Qiang > > > 2013/1/30 Mathieu Despriee > >> Hi folks, >> >> I would like to run a list of generated HIVE queries. For each, I would >> like to retrieve the MR job_id (or ids, in case of multiple stages). And >> then, with this

Run hive queries, and collect job information

2013-01-30 Thread Mathieu Despriee
Hi folks, I would like to run a list of generated HIVE queries. For each, I would like to retrieve the MR job_id (or ids, in case of multiple stages). And then, with this job_id, collect statistics from job tracker (cumulative CPU, read bytes...) How can I send HIVE queries from a bash or python

Re: Real-life experience of forcing smaller input splits?

2013-01-24 Thread Mathieu Despriee
Hi David, What file format and compression type are you using ? Mathieu Le 25 janv. 2013 à 07:16, David Morel a écrit : > Hello, > > I have seen many posts on various sites and MLs, but didn't find a firm > answer anywhere: is it possible yes or no to force a smaller split size > than a block

specification of SERDE in RCFile

2013-01-22 Thread Mathieu Despriee
Hi folks, Through samples here and there, I've seen tables definitions using RCFile storage specifying a SERDE in somecase, and sometimes not. ie : sometimes ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe' STORED AS RCFILE some other times, only : STORED AS RCFILE My qu

Re: Stack function in Hive : how to specify multiple aliases?

2013-01-11 Thread Mathieu Despriee
013/1/10 Dean Wampler > Try "as (alias1, alias2, ...)" > > > On Thu, Jan 10, 2013 at 3:42 AM, Mathieu Despriee wrote: > >> Not working either : >> >> SELECT stack(2,AppWeb, ByteWeb, PacketWeb, AppP2P, ByteP2P, PacketP2P) AS >> App,Byte,Packet FRO

Re: Stack function in Hive : how to specify multiple aliases?

2013-01-10 Thread Mathieu Despriee
kind of problem but can you try select as A,B,C > > > On Thu, Jan 10, 2013 at 12:58 AM, Mathieu Despriee wrote: > >> SELECT stack(2,AppWeb, ByteWeb, PacketWeb, AppP2P, ByteP2P, PacketP2P) AS >> A FROM testApp2; >> >> >> 2013/1/10 Nitin Pawar >> >>

Re: Stack function in Hive : how to specify multiple aliases?

2013-01-10 Thread Mathieu Despriee
SELECT stack(2,AppWeb, ByteWeb, PacketWeb, AppP2P, ByteP2P, PacketP2P) AS A FROM testApp2; 2013/1/10 Nitin Pawar > can you provide your query ? > > > On Thu, Jan 10, 2013 at 12:39 AM, Mathieu Despriee wrote: > >> Hi folks, >> >> I want to use the stack fu

Stack function in Hive : how to specify multiple aliases?

2013-01-10 Thread Mathieu Despriee
Hi folks, I want to use the stack function, described here : https://cwiki.apache.org/Hive/languagemanual-udf.html#LanguageManualUDF-BuiltinTableGeneratingFunctions%2528UDTF%2529 Hive asks me to provide the multiple aliases for the resulting columns ("The number of aliases in the AS clause does n