On 23 May 2016, at 06:32, Todd <[email protected]<mailto:[email protected]>> wrote:
Can someone please take alook at my question?I am spark-shell local mode and yarn-client mode.Spark code uses guava library,spark should have guava in place during run time. Thanks. At 2016-05-23 11:48:58, "Todd" <[email protected]<mailto:[email protected]>> wrote: Hi, In the spark code, guava maven dependency scope is provided, my question is, how spark depends on guava during runtime? I looked into the spark-assembly-1.6.1-hadoop2.6.1.jar,and didn't find class entries like com.google.common.base.Preconditions etc... Spark "shades" guava on import into the assembly; the libaries are moved to a new package and all internal references with it. This is because guava is a nightmare of backwards compatibility. if you want guava, decide which version you want and ask for it explicitly
