*Getting the following error:* [INFO]
[INFO] ------------------------------------------------------------------------ [INFO] Building example 0.0.1 [INFO] ------------------------------------------------------------------------ Downloading: http://repo.maven.apache.org/maven2/org/apache/spark/spark-mllib_2.10/1.4.0/spark-mllib_2.10-1.4.0.pom [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 41.561s [INFO] Finished at: Mon Jun 15 08:17:43 PKT 2015 [INFO] Final Memory: 6M/16M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project learning-spark-mini-example: Could not resolve dependencies for project com.oreilly.learningsparkexamples.mini:learning-spark-mini-example:jar:0.0.1: Failed to collect dependencies for [org.apache.spark:spark-core_2.10:jar:1.3.0 (provided), org.apache.spark:spark-mllib_2.10:jar:1.4.0 (compile)]: Failed to read artifact descriptor for org.apache.spark:spark-mllib_2.10:jar:1.4.0: Could not transfer artifact org.apache.spark:spark-mllib_2.10:pom:1.4.0 from/to central (http://repo.maven.apache.org/maven2): repo.maven.apache.org: Unknown host repo.maven.apache.org -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException _____________________________________________________________________________________________ *My POM file is as follows:-* <?xml version="1.0" encoding="UTF-8"?> <!--<project xmlns="http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> <modelVersion>4.0.0</modelVersion> <groupId>com.oreilly.learningsparkexamples.mini</groupId> <artifactId>learning-spark-mini-example</artifactId> <version>1.0-SNAPSHOT</version> </project> --> <project> <groupId>com.oreilly.learningsparkexamples.mini</groupId> <artifactId>learning-spark-mini-example</artifactId> <modelVersion>4.0.0</modelVersion> <name>example</name> <packaging>jar</packaging> <version>0.0.1</version> <dependencies> <dependency> <!-- Spark dependency --> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.10</artifactId> <version>1.3.0</version> <scope>provided</scope> </dependency> <dependency> <!-- Spark dependency --> <groupId>org.apache.spark</groupId> <artifactId>spark-mllib_2.10</artifactId> <version>1.4.0</version> <scope>provided</scope> </dependency> </dependencies> <properties> <java.version>1.7</java.version> </properties> <build> <pluginManagement> <plugins> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <version>3.1</version> <configuration> <source>${java.version}</source> <target>${java.version}</target> </configuration> </plugin> </plugins> </pluginManagement> </build> </project> ___________________________________________________________________________________________________ *I have noticed that it tries to download the following file*: http://repo.maven.apache.org/maven2/org/apache/spark/spark-mllib_2.10/1.4.0/spark-mllib_2.10-1.4.0.pom *which is available* Any pointers? Thanks for the help. On Sun, Jun 14, 2015 at 5:24 AM, masoom alam <masoom.a...@wanclouds.net> wrote: > Thanks a lot. Will try in a while n update > > Thanks again > On Jun 14, 2015 5:13 PM, "Sonal Goyal" <sonalgoy...@gmail.com> wrote: > >> Try with spark-mllib_2.10 as the artifactid >> On Jun 14, 2015 12:02 AM, "masoom alam" <masoom.a...@wanclouds.net> >> wrote: >> >>> This is not working: >>> >>> <dependency> <!-- Spark dependency --> >>> <groupId>org.apache.spark.mlib</groupId> >>> <artifactId>spark-mlib</artifactId> >>> <!--<version>1.3.0</version> --> >>> <scope>provided</scope> >>> </dependency> >>> >>> >>> >>> On Sat, Jun 13, 2015 at 11:56 PM, masoom alam <masoom.a...@wanclouds.net >>> > wrote: >>> >>>> These two imports are missing and thus FP-growth is not compiling... >>>> >>>> import org.apache.spark.*mllib.fpm.FPGrowth*; >>>> import org.apache.spark.*mllib.fpm.FPGrowthModel*; >>>> >>>> How to include the dependency in the POM file? >>>> >>>> On Sat, Jun 13, 2015 at 4:26 AM, masoom alam <masoom.a...@wanclouds.net >>>> > wrote: >>>> >>>>> Thanks for the answer. Any example? >>>>> On Jun 13, 2015 2:13 PM, "Sonal Goyal" <sonalgoy...@gmail.com> wrote: >>>>> >>>>>> I think you need to add dependency to spark mllib too. >>>>>> On Jun 13, 2015 11:10 AM, "masoom alam" <masoom.a...@wanclouds.net> >>>>>> wrote: >>>>>> >>>>>>> Hi every one, >>>>>>> >>>>>>> I am trying to run the FP growth example. I have tried to compile >>>>>>> the following POM file: >>>>>>> >>>>>>> <project> >>>>>>> <groupId>com.oreilly.learningsparkexamples.mini</groupId> >>>>>>> <artifactId>learning-spark-mini-example</artifactId> >>>>>>> <modelVersion>4.0.0</modelVersion> >>>>>>> <name>example</name> >>>>>>> <packaging>jar</packaging> >>>>>>> <version>0.0.1</version> >>>>>>> <dependencies> >>>>>>> <dependency> <!-- Spark dependency --> >>>>>>> <groupId>org.apache.spark</groupId> >>>>>>> <artifactId>spark-core_2.10</artifactId> >>>>>>> <version>1.3.0</version> >>>>>>> <scope>provided</scope> >>>>>>> </dependency> >>>>>>> </dependencies> >>>>>>> <properties> >>>>>>> <java.version>1.7</java.version> >>>>>>> </properties> >>>>>>> <build> >>>>>>> <pluginManagement> >>>>>>> <plugins> >>>>>>> <plugin> <groupId>org.apache.maven.plugins</groupId> >>>>>>> <artifactId>maven-compiler-plugin</artifactId> >>>>>>> <version>3.1</version> >>>>>>> <configuration> >>>>>>> <source>${java.version}</source> >>>>>>> <target>${java.version}</target> >>>>>>> </configuration> >>>>>>> </plugin> >>>>>>> </plugins> >>>>>>> </pluginManagement> >>>>>>> </build> >>>>>>> </project> >>>>>>> >>>>>>> It successfully builds the project, but IDE is complaining >>>>>>> that: Error:(29, 34) java: package org.apache.spark.mllib.fpm does not >>>>>>> exist >>>>>>> >>>>>>> Just as a side note, I downloaded Version 1.3 of Spark so FP-growth >>>>>>> algorithm should be part of it? >>>>>>> >>>>>>> Thanks. >>>>>>> >>>>>> >>>> >>>
