Can you use:
https://maven.apache.org/plugins/maven-shade-plugin/
to shade the dependencies unique to your project ?
On Mon, Oct 19, 2015 at 7:47 AM, YiZhi Liu wrote:
> Hi Ted,
>
> Unfortunately these two options cause following failure in my environment:
>
> (java.lang.RuntimeException: class
Hi Ted,
Unfortunately these two options cause following failure in my environment:
(java.lang.RuntimeException: class
org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback not
org.apache.hadoop.security.GroupMappingServiceProvider,java.lang.RuntimeException:
java.lang.RuntimeException:
Have you tried the following options ?
--conf spark.driver.userClassPathFirst=true --conf spark.executor.
userClassPathFirst=true
Cheers
On Mon, Oct 19, 2015 at 5:07 AM, YiZhi Liu wrote:
> I'm trying to read a Thrift object from SequenceFile, using
> elephant-bird's ThriftWritable. My code loo
I'm trying to read a Thrift object from SequenceFile, using
elephant-bird's ThriftWritable. My code looks like
val rawData = sc.sequenceFile[BooleanWritable,
ThriftWritable[TrainingSample]](input)
val samples = rawData.map { case (key, value) => {
value.setConverter(classOf[TrainingSample])
va
