Hi,
I'm trying to install Spark along with Shark.
Here's configuration details:
Spark 0.9.1
Shark 0.9.1
Scala 2.10.3
Spark assembly was successful but running "sbt/sbt publish-local" failed.
Please refer attached log for more details and advise.
Thanks,
Abhishek
Sparkhome>SPARK_HADOOP_VERSION=2.0.0-mr1-cdh4.4.0
Successfully build.
Sparkhome>sbt/sbt publish local ( It failed)
/home/cloudera/.m2/repository/org/apache/spark/spark-repl_2.10/0.9.1/spark-repl_2.10-0.9.1.pom
[info] published spark-repl_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-repl_2.10/0.9.1/spark-repl_2.10-0.9.1.jar
[info] published spark-repl_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-repl_2.10/0.9.1/spark-repl_2.10-0.9.1-sources.jar
[info] published spark-repl_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-repl_2.10/0.9.1/spark-repl_2.10-0.9.1-javadoc.jar
[info] published spark-repl_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-repl_2.10/0.9.1/poms/spark-repl_2.10.pom
[info] published spark-repl_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-repl_2.10/0.9.1/jars/spark-repl_2.10.jar
[info] published spark-repl_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-repl_2.10/0.9.1/srcs/spark-repl_2.10-sources.jar
[info] published spark-repl_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-repl_2.10/0.9.1/docs/spark-repl_2.10-javadoc.jar
[info] published ivy to
/home/cloudera/.ivy2/local/org.apache.spark/spark-repl_2.10/0.9.1/ivys/ivy.xml
[error] (streaming/compile:compile) Compilation failed
[error] Total time: 419 s, completed May 25, 2014 7:28:27 PM
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:285:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, V)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,V]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.reduceByKeyAndWindow(reduceFunc, windowDuration,
slideDuration)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:306:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, V)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,V]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.reduceByKeyAndWindow(reduceFunc, windowDuration,
slideDuration, numPartitions)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:326:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, V)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,V]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.reduceByKeyAndWindow(reduceFunc, windowDuration,
slideDuration, partitioner)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:351:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, V)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,V]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.reduceByKeyAndWindow(reduceFunc, invReduceFunc,
windowDuration, slideDuration)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:382:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, V)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,V]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.reduceByKeyAndWindow(
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:419:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, V)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,V]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.reduceByKeyAndWindow(
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:455:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, S)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,S]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.updateStateByKey(convertUpdateStateFunction(updateFunc))
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:473:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, S)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,S]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.updateStateByKey(convertUpdateStateFunction(updateFunc),
numPartitions)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:491:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, S)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,S]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.updateStateByKey(convertUpdateStateFunction(updateFunc),
partitioner)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:502:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, U)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,U]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.mapValues(f)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:514:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, U)]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,U]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.flatMapValues(fn)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:525:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K,
(java.util.List[V], java.util.List[W]))]
[error] required:
org.apache.spark.streaming.api.java.JavaPairDStream[K,(java.util.List[V],
java.util.List[W])]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.cogroup(other.dstream).mapValues(t => (seqAsJavaList(t._1),
seqAsJavaList((t._2))))
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:539:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K,
(java.util.List[V], java.util.List[W]))]
[error] required:
org.apache.spark.streaming.api.java.JavaPairDStream[K,(java.util.List[V],
java.util.List[W])]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] .mapValues(t => (seqAsJavaList(t._1), seqAsJavaList((t._2))))
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:553:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K,
(java.util.List[V], java.util.List[W]))]
[error] required:
org.apache.spark.streaming.api.java.JavaPairDStream[K,(java.util.List[V],
java.util.List[W])]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] .mapValues(t => (seqAsJavaList(t._1), seqAsJavaList((t._2))))
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:563:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, (V, W))]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,(V, W)]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.join(other.dstream)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:573:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, (V, W))]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,(V, W)]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.join(other.dstream, numPartitions)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:586:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, (V, W))]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,(V, W)]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] dstream.join(other.dstream, partitioner)
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:598:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, (V,
com.google.common.base.Optional[W]))]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,(V,
com.google.common.base.Optional[W])]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] joinResult.mapValues{case (v, w) => (v,
JavaUtils.optionToOptional(w))}
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:613:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, (V,
com.google.common.base.Optional[W]))]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,(V,
com.google.common.base.Optional[W])]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] joinResult.mapValues{case (v, w) => (v,
JavaUtils.optionToOptional(w))}
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:627:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K, (V,
com.google.common.base.Optional[W]))]
[error] required: org.apache.spark.streaming.api.java.JavaPairDStream[K,(V,
com.google.common.base.Optional[W])]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] joinResult.mapValues{case (v, w) => (v,
JavaUtils.optionToOptional(w))}
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:639:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K,
(com.google.common.base.Optional[V], W))]
[error] required:
org.apache.spark.streaming.api.java.JavaPairDStream[K,(com.google.common.base.Optional[V],
W)]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] joinResult.mapValues{case (v, w) => (JavaUtils.optionToOptional(v),
w)}
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:654:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K,
(com.google.common.base.Optional[V], W))]
[error] required:
org.apache.spark.streaming.api.java.JavaPairDStream[K,(com.google.common.base.Optional[V],
W)]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] joinResult.mapValues{case (v, w) => (JavaUtils.optionToOptional(v),
w)}
[error] ^
[error]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:669:
type mismatch;
[error] found : org.apache.spark.streaming.dstream.DStream[(K,
(com.google.common.base.Optional[V], W))]
[error] required:
org.apache.spark.streaming.api.java.JavaPairDStream[K,(com.google.common.base.Optional[V],
W)]
[error] Note: implicit method fromPairDStream is not applicable here because
it comes after the application point and it lacks an explicit result type
[error] joinResult.mapValues{case (v, w) => (JavaUtils.optionToOptional(v),
w)}
[error] ^
[error] 44 errors found
[info] Generating Scala API documentation for main sources to
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/graphx/target/scala-2.10/api...
[warn] there were 11 feature warning(s); re-run with -feature for details
model contains 38 documentable templates
[warn] one warning found
[info] Scala API documentation generation successful.
[info] Generating Scala API documentation for main sources to
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/target/scala-2.10/api...
[warn] there were 6 feature warning(s); re-run with -feature for details
model contains 43 documentable templates
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala:445:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala:65:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala:475:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala:510:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala:95:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala:546:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala:389:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala:370:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala:425:
Could not find any member to link for "org.apache.spark.api.java.JavaPairRDD".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala:402:
Could not find any member to link for "org.apache.spark.api.java.JavaPairRDD".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:176:
Could not find any member to link for "org.apache.spark.rdd.PairRDDFunctions".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:161:
Could not find any member to link for "org.apache.spark.rdd.PairRDDFunctions".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:127:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:576:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:616:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:152:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:657:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaPairDStream.scala:476:
Could not find any member to link for "org.apache.spark.Partitioner".
[warn] /**
[warn] ^
[warn] 19 warnings found
[info] Scala API documentation generation successful.
[info] :: delivering :: org.apache.spark#spark-examples_2.10;0.9.1 :: 0.9.1 ::
release :: Sun May 25 19:27:46 PDT 2014
[info] delivering ivy file to
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/examples/target/scala-2.10/ivy-0.9.1.xml
[info] published root_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/root_2.10/0.9.1/poms/root_2.10.pom
[info] published root_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/root_2.10/0.9.1/jars/root_2.10.jar
[info] published root_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/root_2.10/0.9.1/srcs/root_2.10-sources.jar
[info] published root_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/root_2.10/0.9.1/docs/root_2.10-javadoc.jar
[info] published ivy to
/home/cloudera/.ivy2/local/org.apache.spark/root_2.10/0.9.1/ivys/ivy.xml
[info] published root_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/root_2.10/0.9.1/root_2.10-0.9.1.pom
[info] published root_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/root_2.10/0.9.1/root_2.10-0.9.1.jar
[info] published root_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/root_2.10/0.9.1/root_2.10-0.9.1-sources.jar
[info] published root_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/root_2.10/0.9.1/root_2.10-0.9.1-javadoc.jar
[info] published spark-core_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-core_2.10/0.9.1/poms/spark-core_2.10.pom
[info] published spark-core_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-core_2.10/0.9.1/jars/spark-core_2.10.jar
[info] published spark-core_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-core_2.10/0.9.1/srcs/spark-core_2.10-sources.jar
[info] published spark-core_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-core_2.10/0.9.1/docs/spark-core_2.10-javadoc.jar
[info] published ivy to
/home/cloudera/.ivy2/local/org.apache.spark/spark-core_2.10/0.9.1/ivys/ivy.xml
[info] published spark-core_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-core_2.10/0.9.1/spark-core_2.10-0.9.1.pom
[info] published spark-core_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-core_2.10/0.9.1/spark-core_2.10-0.9.1.jar
[info] published spark-core_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-core_2.10/0.9.1/spark-core_2.10-0.9.1-sources.jar
[info] published spark-core_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-core_2.10/0.9.1/spark-core_2.10-0.9.1-javadoc.jar
[info] Packaging
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/bagel/target/scala-2.10/spark-bagel_2.10-0.9.1-javadoc.jar
...
[info] Done packaging.
[info] Packaging
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/mllib/target/scala-2.10/spark-mllib_2.10-0.9.1-javadoc.jar
...
[info] Done packaging.
[info] Packaging
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/graphx/target/scala-2.10/spark-graphx_2.10-0.9.1-javadoc.jar
...
[info] Done packaging.
[info] Packaging
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/streaming/target/scala-2.10/spark-streaming_2.10-0.9.1-javadoc.jar
...
[info] Done packaging.
[info] Packaging
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/bagel/target/scala-2.10/spark-bagel_2.10-0.9.1.jar
...
[info] Done packaging.
[info] Packaging
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/mllib/target/scala-2.10/spark-mllib_2.10-0.9.1.jar
...
[info] Done packaging.
[info] Packaging
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/graphx/target/scala-2.10/spark-graphx_2.10-0.9.1.jar
...
[info] Done packaging.
[info] Generating Scala API documentation for main sources to
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/repl/target/scala-2.10/api...
model contains 69 documentable templates
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/repl/src/main/scala/org/apache/spark/repl/SparkIMain.scala:84:
Variable eval undefined in comment for class SparkIMain in class SparkIMain
[warn] class SparkIMain(initialSettings: Settings, val out: JPrintWriter)
extends SparkImports with Logging {
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/repl/src/main/scala/org/apache/spark/repl/SparkIMain.scala:1332:
Variable iw undefined in comment for method unwrapStrings in class
SparkISettings
[warn] var unwrapStrings = true
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/repl/src/main/scala/org/apache/spark/repl/SparkIMain.scala:367:
Variable line19 undefined in comment for method generatedName in class
SparkIMain
[warn] def generatedName(simpleName: String): Option[String] = {
[warn] ^
[warn]
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/repl/src/main/scala/org/apache/spark/repl/SparkIMain.scala:894:
Variable line5 undefined in comment for method fullFlatName in class Request
[warn] def fullFlatName(name: String) =
[warn] ^
[warn] four warnings found
[info] Scala API documentation generation successful.
[info] Compiling 1 Scala source to
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/repl/target/scala-2.10/classes...
[info] published spark-bagel_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-bagel_2.10/0.9.1/poms/spark-bagel_2.10.pom
[info] published spark-bagel_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-bagel_2.10/0.9.1/jars/spark-bagel_2.10.jar
[info] published spark-bagel_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-bagel_2.10/0.9.1/srcs/spark-bagel_2.10-sources.jar
[info] published spark-bagel_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-bagel_2.10/0.9.1/docs/spark-bagel_2.10-javadoc.jar
[info] published ivy to
/home/cloudera/.ivy2/local/org.apache.spark/spark-bagel_2.10/0.9.1/ivys/ivy.xml
[info] published spark-bagel_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-bagel_2.10/0.9.1/spark-bagel_2.10-0.9.1.pom
[info] published spark-bagel_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-bagel_2.10/0.9.1/spark-bagel_2.10-0.9.1.jar
[info] published spark-bagel_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-bagel_2.10/0.9.1/spark-bagel_2.10-0.9.1-sources.jar
[info] published spark-bagel_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-bagel_2.10/0.9.1/spark-bagel_2.10-0.9.1-javadoc.jar
[info] published spark-mllib_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-mllib_2.10/0.9.1/spark-mllib_2.10-0.9.1.pom
[info] published spark-mllib_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-mllib_2.10/0.9.1/spark-mllib_2.10-0.9.1.jar
[info] published spark-mllib_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-mllib_2.10/0.9.1/spark-mllib_2.10-0.9.1-sources.jar
[info] published spark-mllib_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-mllib_2.10/0.9.1/spark-mllib_2.10-0.9.1-javadoc.jar
[info] published spark-mllib_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-mllib_2.10/0.9.1/poms/spark-mllib_2.10.pom
[info] published spark-mllib_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-mllib_2.10/0.9.1/jars/spark-mllib_2.10.jar
[info] published spark-mllib_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-mllib_2.10/0.9.1/srcs/spark-mllib_2.10-sources.jar
[info] published spark-mllib_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-mllib_2.10/0.9.1/docs/spark-mllib_2.10-javadoc.jar
[info] published ivy to
/home/cloudera/.ivy2/local/org.apache.spark/spark-mllib_2.10/0.9.1/ivys/ivy.xml
[info] Packaging
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/repl/target/scala-2.10/spark-repl_2.10-0.9.1-javadoc.jar
...
[info] Done packaging.
[info] published spark-graphx_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-graphx_2.10/0.9.1/poms/spark-graphx_2.10.pom
[info] published spark-graphx_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-graphx_2.10/0.9.1/jars/spark-graphx_2.10.jar
[info] published spark-graphx_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-graphx_2.10/0.9.1/srcs/spark-graphx_2.10-sources.jar
[info] published spark-graphx_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-graphx_2.10/0.9.1/docs/spark-graphx_2.10-javadoc.jar
[info] published ivy to
/home/cloudera/.ivy2/local/org.apache.spark/spark-graphx_2.10/0.9.1/ivys/ivy.xml
[info] published spark-graphx_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-graphx_2.10/0.9.1/spark-graphx_2.10-0.9.1.pom
[info] published spark-graphx_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-graphx_2.10/0.9.1/spark-graphx_2.10-0.9.1.jar
[info] published spark-graphx_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-graphx_2.10/0.9.1/spark-graphx_2.10-0.9.1-sources.jar
[info] published spark-graphx_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-graphx_2.10/0.9.1/spark-graphx_2.10-0.9.1-javadoc.jar
[info] Packaging
/home/cloudera/at_Installation/spark-0.9.1-bin-cdh4/repl/target/scala-2.10/spark-repl_2.10-0.9.1.jar
...
[info] Done packaging.
[info] published spark-repl_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-repl_2.10/0.9.1/spark-repl_2.10-0.9.1.pom
[info] published spark-repl_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-repl_2.10/0.9.1/spark-repl_2.10-0.9.1.jar
[info] published spark-repl_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-repl_2.10/0.9.1/spark-repl_2.10-0.9.1-sources.jar
[info] published spark-repl_2.10 to
/home/cloudera/.m2/repository/org/apache/spark/spark-repl_2.10/0.9.1/spark-repl_2.10-0.9.1-javadoc.jar
[info] published spark-repl_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-repl_2.10/0.9.1/poms/spark-repl_2.10.pom
[info] published spark-repl_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-repl_2.10/0.9.1/jars/spark-repl_2.10.jar
[info] published spark-repl_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-repl_2.10/0.9.1/srcs/spark-repl_2.10-sources.jar
[info] published spark-repl_2.10 to
/home/cloudera/.ivy2/local/org.apache.spark/spark-repl_2.10/0.9.1/docs/spark-repl_2.10-javadoc.jar
[info] published ivy to
/home/cloudera/.ivy2/local/org.apache.spark/spark-repl_2.10/0.9.1/ivys/ivy.xml
[error] (streaming/compile:compile) Compilation failed
[error] Total time: 419 s, completed May 25, 2014 7:28:27 PM
[cloudera@localhost spark-0.9.1-bin-cdh4]$
