Hi, all
I found the same situation in Spark Streaming + Kafka of 1.4.0.
Are there any progress about this discussion?
(I cannot find JIRA issue about this.)
By the way, I can avoid this kind of error by using "exclude" in SBT
configuration of my application
like the following.
::
libraryDepend
I'm building with
mvn -Phadoop-2.4 -DskipTests install
Yeah, commenting out the unused dependency in the root pom.xml resolves
it. I'm a little surprised that it cropped up now as well, I had built
against multiple different snapshots of 1.3 over the past couple weeks with
no problems.
Is it
This has been around for multiple versions of Spark, so I am a bit
surprised to see it not working in your build.
- Patrick
On Wed, Feb 25, 2015 at 9:41 AM, Patrick Wendell wrote:
> Hey Cody,
>
> What build command are you using? In any case, we can actually comment
> out the "unused" thing now
Hey Cody,
What build command are you using? In any case, we can actually comment
out the "unused" thing now in the root pom.xml. It existed just to
ensure that at least one dependency was listed in the shade plugin
configuration (otherwise, some work we do that requires the shade
plugin does not h
So when building 1.3.0-rc1 I see the following warning:
[WARNING] spark-streaming-kafka_2.10-1.3.0.jar, unused-1.0.0.jar define 1
overlappping classes:
[WARNING] - org.apache.spark.unused.UnusedStubClass
and when trying to build an assembly of a project that was previously using
1.3 snapshots
