Does that mean you would like to read the pojo objects using hive? Is your
pojo a custom writable?
LazyBinarySerDe in my opinion is a SerDe that converts bytewritable to
columns. Your recordreader would return a bytewritable and serde along with
objectinspector would convert it to typed columns. So
Hi Aniket,
I am looking to run some data through a mapreduce and I want the output
sequence files to be compatible with Block Compressed Partitioned
LazyBinarySerDe so I can map external tables to it. The current job uses a
pojo that extends writable to serialize to disk, this is easy to read back
Hi Hans,
Can you please elaborate on the use case more? Is your data already in
Binary format readable to LazyBinarySerDe (if you mount a table with that
serde with hive)?
OR
are you trying to write data using mapreduce (java) into a location that
can be further read by a table that is declared to
auxpath is not going to solve this problem. You have to set your
HADOOP_CLASSPATH for it. From the error it seems that your job client is
not able to load the class from classpath.
Try -
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/reports/hive/ddc_jars/jwnl.jar
$ hive
hive> add jar ...
hive> crea
I'm running a bunch of hive queries (20+ and adding more) through Oozie and
they are all in one file :-( Is there a way I can tell oozie to run them
all simultaneously without writing a separate oozie action for each one of
them.
Thanks!
hive --auxpath /reports/hive/ddc_jars/jwnl.jar
Hive history
file=/tmp/thavens/hive_job_log_thavens_20120105_2003418921.txt
hive> create temporary function StemTermsUDF as
'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
OK
Time taken: 0.005 seconds
however:
With in .hiverc with:
add jar /reports
Unfortunately the issue appears to be something with the Jar, or my UDF.
What I can't seem to resolve is what is causing the -101 Error Code.
Tim
On Sun, Jan 22, 2012 at 3:26 PM, Aniket Mokashi wrote:
> A simplest way would be to put the jar in auxlib directory. That does the
> both for you I
A simplest way would be to put the jar in auxlib directory. That does the
both for you I guess. After that you can directly create temporary function
in hive.
~Aniket
On Sun, Jan 22, 2012 at 1:24 PM, Aniket Mokashi wrote:
> Add the jar to HADOOP_CLASSPATH when you launch hive. That should help.
Add the jar to HADOOP_CLASSPATH when you launch hive. That should help.
Thanks,
Aniket
On Sun, Jan 22, 2012 at 9:25 AM, Tim Havens wrote:
> I have a similar UDF to this one which create's just fine.
>
> I cam seem to resolve what 'return code -101' means however with this
> one.
>
> Can anyone
Hello Dalia,
Go through the below specified links.I hope it helps -
http://www.mail-archive.com/pig-user@hadoop.apache.org/msg01115.html
http://stackoverflow.com/questions/3356259/difference-between-pig-and-hive-why-have-both
http://www.larsgeorge.com/2009/10/hive-vs-pig.html
http://permalink.
I am attempting to Use LazyBinarySerDe to read Sequence files output by a
mapreduce job. Is there an example of how the data needs to be packed by
the final reduce, and how the tables are set up so they can read the output?
I have a similar UDF to this one which create's just fine.
I cam seem to resolve what 'return code -101' means however with this
one.
Can anyone tell me what 'return code -101' means?
My StemTermsUDF.jar has the proper classpath for the JWNL jars
already, I'm trying to insure they've REALLY avai
12 matches
Mail list logo
