Hi,
I use Hadoop 2.4.1, HBase 0.98.5, Zookeeper 3.4.6 and Hive 0.13.1.
I just tried to compile Spark 1.0.2, but got error on "Spark Project Hive", can
you please advise which repository has
"org.spark-project.hive:hive-metastore:jar:0.13.1"?
FYI, below is my repository setting in maven which would be old:
<repository>
<id>nexus</id>
<name>local private nexus</name>
<url>http://maven.oschina.net/content/groups/public/</url>
<releases>
<enabled>true</enabled>
</releases>
<snapshots>
<enabled>false</enabled>
</snapshots>
</repository>
export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m"
mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.1 -DskipTests clean package
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [1.892s]
[INFO] Spark Project Core ................................ SUCCESS [1:33.698s]
[INFO] Spark Project Bagel ............................... SUCCESS [12.270s]
[INFO] Spark Project GraphX .............................. SUCCESS [2:16.343s]
[INFO] Spark Project ML Library .......................... SUCCESS [4:18.495s]
[INFO] Spark Project Streaming ........................... SUCCESS [39.765s]
[INFO] Spark Project Tools ............................... SUCCESS [9.173s]
[INFO] Spark Project Catalyst ............................ SUCCESS [35.462s]
[INFO] Spark Project SQL ................................. SUCCESS [1:16.118s]
[INFO] Spark Project Hive ................................ FAILURE [1:36.816s]
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project YARN Parent POM ..................... SKIPPED
[INFO] Spark Project YARN Stable API ..................... SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 12:40.616s
[INFO] Finished at: Thu Aug 28 11:41:07 HKT 2014
[INFO] Final Memory: 37M/826M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project spark-hive_2.10: Could not resolve
dependencies for project org.apache.spark:spark-hive_2.10:jar:1.0.2: The
following artifacts could not be resolved:
org.spark-project.hive:hive-metastore:jar:0.13.1,
org.spark-project.hive:hive-exec:jar:0.13.1,
org.spark-project.hive:hive-serde:jar:0.13.1: Could not find artifact
org.spark-project.hive:hive-metastore:jar:0.13.1 in nexus-osc
(http://maven.oschina.net/content/groups/public/) -> [Help 1]
Regards
Arthur