On Thu, Nov 5, 2015 at 3:41 PM, Joey Paskhay <joey.pask...@gmail.com> wrote: > We verified the Guava libraries are in the huge list of the included jars, > but we saw that in the > org.apache.spark.sql.hive.client.IsolatedClientLoader.isSharedClass method > it seems to assume that *all* "com.google" (excluding "com.google.cloud") > classes should be loaded from the base class loader. The Spark libraries > seem to have *some* "com.google.common.base" classes shaded in but not all.
Yeah, seems to me like HiveContext should not be trying to include guava in the shared list at all; the goal is to not have any Guava classes show up in Spark's classpath, unfortunately that's currently not possible because some types are exposed in the Java API (the ones that are not shaded). Could you file a bug to track this? -- Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
