btw, this issue happens only with classes needed for the inputFormat. if
the input format is org.apache.hadoop.mapred.TextInputFormat and the serde
is from an additional jar it works just fine.
I don't want to upgrade cdh for this. also, if it should work on cdh5.5 why
is that. what patch fixes th
Upgrade to CDH 5.5 for spark. It should work
On Sat, Jan 9, 2016 at 12:17 AM, Ophir Etzion wrote:
> It didn't work. assuming I did the right thing.
> in the properties you could see
>
> {"key":"hive.aux.jars.path","value":"file:///data/loko/foursquare.web-hiverc/current/hadoop-hive-serde.jar,fi
It didn't work. assuming I did the right thing.
in the properties you could see
{"key":"hive.aux.jars.path","value":"file:///data/loko/foursquare.web-hiverc/current/hadoop-hive-serde.jar,file:///data/loko/foursquare.web-hiverc/current/hadoop-hive-udf.jar","isFinal":false,"resource":"programatical
You can not 'add jar' input formats and serde's. They need to be part of
your auxlib.
On Fri, Jan 8, 2016 at 12:19 PM, Ophir Etzion wrote:
> I tried now. still getting
>
> 16/01/08 16:37:34 ERROR exec.Utilities: Failed to load plan:
> hdfs://hadoop-alidoro-nn-vip/tmp/hive/hive/c2af9882-38a9-42b
I tried now. still getting
16/01/08 16:37:34 ERROR exec.Utilities: Failed to load plan:
hdfs://hadoop-alidoro-nn-vip/tmp/hive/hive/c2af9882-38a9-42b0-8d17-3f56708383e8/hive_2016-01-08_16-36-41_370_3307331506800215903-3/-mr-10004/3c90a796-47fc-4541-bbec-b196c40aefab/map.xml:
org.apache.hive.com.eso
did you try -- jars property in spark submit? if your jar is of huge size,
you can pre-load the jar on all executors in a common available directory
to avoid network IO.
On Thu, Jan 7, 2016 at 4:03 PM, Ophir Etzion wrote:
> I' trying to add jars before running a query using hive on spark on cdh
