ed Yu wrote:
> Jim:
> I can find the example message here:
> http://search-hadoop.com/m/JW1q5zP54J1
>
> On Fri, Mar 20, 2015 at 12:29 PM, Jim Kleckner
> wrote:
>
>> I notice that some people send messages directly to user@spark.apache.org
>> and some via nabble
I notice that some people send messages directly to user@spark.apache.org
and some via nabble, either using email or the web client.
There are two index sites, one directly at apache.org and one at nabble.
But messages sent directly to user@spark.apache.org only show up in the
apache list. Furthe
Do people have a reliable/repeatable method for solving dependency issues
or tips?
The current world of spark-hadoop-hbase-parquet-... is very challenging
given the huge footprint of dependent packages and we may be pushing
against the limits of how many packages can be combined into one
environme
.
On Thu, Feb 26, 2015 at 9:54 AM, Marcelo Vanzin wrote:
> On Wed, Feb 25, 2015 at 8:42 PM, Jim Kleckner
> wrote:
> > So, should the userClassPathFirst flag work and there is a bug?
>
> Sorry for jumping in the middle of conversation (and probably missing
> some of it), but
I created an issue and pull request.
Discussion can continue there:
https://issues.apache.org/jira/browse/SPARK-6029
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Fwd-Spark-excludes-fastutil-dependencies-we-need-tp21812p21814.html
Sent from the Apache Spa
Forwarding conversation below that didn't make it to the list.
-- Forwarded message --
From: Jim Kleckner
Date: Wed, Feb 25, 2015 at 8:42 PM
Subject: Re: Spark excludes "fastutil" dependencies we need
To: Ted Yu
Cc: Sean Owen , user
Inline
On Wed, Feb 25,
ld the userClassPathFirst flag work and there is a bug?
Or is it reasonable to put in a pull request for the elimination of the
exclusion?
>
>> On Wed, Feb 25, 2015 at 5:34 AM, Ted Yu wrote:
>> > bq. depend on missing fastutil classes like Long2LongOpenHashMap
>> >
>
Spark includes the clearspring analytics package but intentionally excludes
the dependencies of the fastutil package (see below).
Spark includes parquet-column which includes fastutil and relocates it under
parquet/
but creates a shaded jar file which is incomplete because it shades out some
of
t
