Re: Adding custom jars for hive and map-reduce jobs dynamically from hdfs location

2016-02-01 Thread Yehuda Finkelstein
hive.aux.jars.path /var/lib/hive Try this setting On Feb 1, 2016 7:46 PM, "Chagarlamudi, Prasanth" < prasanth.chagarlam...@epsilon.com> wrote: > Hello, > > We currently have custom jars(util, serde etc) that needs to deployed > into /hive/lib folder and mapreduce folders whenever they are

RE: Error: java.lang.IllegalArgumentE:Column has wrong number of index entries found - when trying to insert from JSON external table to ORC table

2015-09-08 Thread Yehuda Finkelstein
doesn’t use this parameter and still can load hundreds of files. Any clue why it not consistent ? It may be a matter of some limit ? Thanks Yehuda *From:* Yehuda Finkelstein [mailto:yeh...@veracity-group.com] *Sent:* Tuesday, September 08, 2015 6:12 PM *To:* 'Prasanth Jayacha

RE: Error: java.lang.IllegalArgumentE:Column has wrong number of index entries found - when trying to insert from JSON external table to ORC table

2015-09-08 Thread Yehuda Finkelstein
. Also set hive.merge.mapfiles to false and hive.merge.mapredfiles to false so that slow merging is also disabled. On Tue, Sep 8, 2015 at 5:29 AM -0700, "Yehuda Finkelstein" < yeh...@veracity-group.com> wrote: Hi all, We have a process that load data from folder that have

Error: java.lang.IllegalArgumentE:Column has wrong number of index entries found - when trying to insert from JSON external table to ORC table

2015-09-08 Thread Yehuda Finkelstein
Hi all, We have a process that load data from folder that have json files. We use external table on top of the json folder and then insert into ORC table. We get the error below during the load “Column has wrong number of index entries found: 0 expected: 20” I validate the JSON data an