Hi Furkan,
A few examples of libraries that we include are joda time, hbase libraries
and spark-kafka (for streaming). We use the maven-assembly-plugin to build
our assembly jar, btw.
Thanks,
Deng
On Wed, Oct 28, 2015 at 9:10 PM, Furkan KAMACI
wrote:
> Hi Deng,
>
> Could you give an example of
Hi Deng,
Could you give an example of which libraries you include for your purpose?
Kind Regards,
Furkan KAMACI
On Wed, Oct 28, 2015 at 4:07 AM, Deng Ching-Mallete
wrote:
> Hi,
>
> The spark assembly jar already includes the spark core libraries plus
> their transitive dependencies, so you don
Hi,
The spark assembly jar already includes the spark core libraries plus their
transitive dependencies, so you don't need to include them in your jar. I
found it easier to use inclusions instead of exclusions when creating an
assembly jar of my spark job so I would recommend going with that.
HTH
