even if the following POM is also not working:
<project xmlns="http://maven.apache.org/POM/4.0.0"; xmlns:xsi="
http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation="
http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd";>
<parent>
<artifactId>spark-parent_2.10</artifactId>
<groupId>org.apache.spark</groupId>
<version>1.4.0</version>
</parent>
<modelVersion>4.0.0</modelVersion>
<groupId>org.apache.spark</groupId>
<artifactId>spark-mllib_2.10</artifactId>
<name>Spark Project ML Library</name>
<url>http://spark.apache.org/</url>
<build>
<outputDirectory>target/scala-${scala.binary.version}/classes</outputDirectory>
<testOutputDirectory>target/scala-${scala.binary.version}/test-classes</testOutputDirectory>
</build>
<profiles>
<profile>
<id>netlib-lgpl</id>
<dependencies>
<dependency>
<groupId>com.github.fommil.netlib</groupId>
<artifactId>all</artifactId>
<version>${netlib.java.version}</version>
<type>pom</type>
</dependency>
</dependencies>
</profile>
</profiles>
<dependencies>
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-core_2.10</artifactId>
<version>1.4.0</version>
<scope>compile</scope>
</dependency>
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-streaming_2.10</artifactId>
<version>1.4.0</version>
<scope>compile</scope>
</dependency>
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-sql_2.10</artifactId>
<version>1.4.0</version>
<scope>compile</scope>
</dependency>
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-graphx_2.10</artifactId>
<version>1.4.0</version>
<scope>compile</scope>
</dependency>
<dependency>
<groupId>org.jblas</groupId>
<artifactId>jblas</artifactId>
<version>1.2.4</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.scalanlp</groupId>
<artifactId>breeze_2.10</artifactId>
<version>0.11.2</version>
<scope>compile</scope>
<exclusions>
<exclusion>
<artifactId>junit</artifactId>
<groupId>junit</groupId>
</exclusion>
<exclusion>
<artifactId>commons-math3</artifactId>
<groupId>org.apache.commons</groupId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.apache.commons</groupId>
<artifactId>commons-math3</artifactId>
<version>3.4.1</version>
<scope>compile</scope>
</dependency>
<dependency>
<groupId>org.scalacheck</groupId>
<artifactId>scalacheck_2.10</artifactId>
<version>1.11.3</version>
<scope>test</scope>
<exclusions>
<exclusion>
<artifactId>test-interface</artifactId>
<groupId>org.scala-sbt</groupId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>junit</groupId>
<artifactId>junit</artifactId>
<version>4.10</version>
<scope>test</scope>
<exclusions>
<exclusion>
<artifactId>hamcrest-core</artifactId>
<groupId>org.hamcrest</groupId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>com.novocode</groupId>
<artifactId>junit-interface</artifactId>
<version>0.10</version>
<scope>test</scope>
<exclusions>
<exclusion>
<artifactId>junit-dep</artifactId>
<groupId>junit</groupId>
</exclusion>
<exclusion>
<artifactId>test-interface</artifactId>
<groupId>org.scala-tools.testing</groupId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.mockito</groupId>
<artifactId>mockito-all</artifactId>
<version>1.9.5</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-streaming_2.10</artifactId>
<version>1.4.0</version>
<type>test-jar</type>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.jpmml</groupId>
<artifactId>pmml-model</artifactId>
<version>1.1.15</version>
<scope>compile</scope>
<exclusions>
<exclusion>
<artifactId>FastInfoset</artifactId>
<groupId>com.sun.xml.fastinfoset</groupId>
</exclusion>
<exclusion>
<artifactId>istack-commons-runtime</artifactId>
<groupId>com.sun.istack</groupId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.codehaus.groovy</groupId>
<artifactId>groovy-all</artifactId>
<version>2.3.7</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.scalatest</groupId>
<artifactId>scalatest_2.10</artifactId>
<version>2.2.1</version>
<scope>test</scope>
</dependency>
</dependencies>
<properties>
<sbt.project.name>mllib</sbt.project.name>
</properties>
</project>
Any clues?
On Sun, Jun 14, 2015 at 8:20 PM, masoom alam <[email protected]>
wrote:
> *Getting the following error:*
>
> [INFO]
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building example 0.0.1
> [INFO]
> ------------------------------------------------------------------------
> Downloading:
> http://repo.maven.apache.org/maven2/org/apache/spark/spark-mllib_2.10/1.4.0/spark-mllib_2.10-1.4.0.pom
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 41.561s
> [INFO] Finished at: Mon Jun 15 08:17:43 PKT 2015
> [INFO] Final Memory: 6M/16M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project learning-spark-mini-example:
> Could not resolve dependencies for project
> com.oreilly.learningsparkexamples.mini:learning-spark-mini-example:jar:0.0.1:
> Failed to collect dependencies for
> [org.apache.spark:spark-core_2.10:jar:1.3.0 (provided),
> org.apache.spark:spark-mllib_2.10:jar:1.4.0 (compile)]: Failed to read
> artifact descriptor for org.apache.spark:spark-mllib_2.10:jar:1.4.0: Could
> not transfer artifact org.apache.spark:spark-mllib_2.10:pom:1.4.0 from/to
> central (http://repo.maven.apache.org/maven2): repo.maven.apache.org:
> Unknown host repo.maven.apache.org -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
>
>
>
>
> _____________________________________________________________________________________________
>
> *My POM file is as follows:-*
>
> <?xml version="1.0" encoding="UTF-8"?>
> <!--<project xmlns="http://maven.apache.org/POM/4.0.0";
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
> xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
> http://maven.apache.org/xsd/maven-4.0.0.xsd";>
> <modelVersion>4.0.0</modelVersion>
>
> <groupId>com.oreilly.learningsparkexamples.mini</groupId>
> <artifactId>learning-spark-mini-example</artifactId>
> <version>1.0-SNAPSHOT</version>
>
>
> </project>
> -->
>
> <project>
> <groupId>com.oreilly.learningsparkexamples.mini</groupId>
> <artifactId>learning-spark-mini-example</artifactId>
> <modelVersion>4.0.0</modelVersion>
> <name>example</name>
> <packaging>jar</packaging>
> <version>0.0.1</version>
> <dependencies>
> <dependency> <!-- Spark dependency -->
> <groupId>org.apache.spark</groupId>
> <artifactId>spark-core_2.10</artifactId>
> <version>1.3.0</version>
> <scope>provided</scope>
> </dependency>
> <dependency> <!-- Spark dependency -->
> <groupId>org.apache.spark</groupId>
> <artifactId>spark-mllib_2.10</artifactId>
> <version>1.4.0</version>
> <scope>provided</scope>
> </dependency>
> </dependencies>
> <properties>
> <java.version>1.7</java.version>
> </properties>
> <build>
> <pluginManagement>
> <plugins>
> <plugin> <groupId>org.apache.maven.plugins</groupId>
> <artifactId>maven-compiler-plugin</artifactId>
> <version>3.1</version>
> <configuration>
> <source>${java.version}</source>
> <target>${java.version}</target>
> </configuration>
> </plugin>
> </plugins>
> </pluginManagement>
> </build>
> </project>
>
> ___________________________________________________________________________________________________
>
> *I have noticed that it tries to download the following file*:
> http://repo.maven.apache.org/maven2/org/apache/spark/spark-mllib_2.10/1.4.0/spark-mllib_2.10-1.4.0.pom
> *which
> is available*
>
> Any pointers?
>
> Thanks for the help.
>
>
>
>
> On Sun, Jun 14, 2015 at 5:24 AM, masoom alam <[email protected]>
> wrote:
>
>> Thanks a lot. Will try in a while n update
>>
>> Thanks again
>> On Jun 14, 2015 5:13 PM, "Sonal Goyal" <[email protected]> wrote:
>>
>>> Try with spark-mllib_2.10 as the artifactid
>>> On Jun 14, 2015 12:02 AM, "masoom alam" <[email protected]>
>>> wrote:
>>>
>>>> This is not working:
>>>>
>>>> <dependency> <!-- Spark dependency -->
>>>> <groupId>org.apache.spark.mlib</groupId>
>>>> <artifactId>spark-mlib</artifactId>
>>>> <!--<version>1.3.0</version> -->
>>>> <scope>provided</scope>
>>>> </dependency>
>>>>
>>>>
>>>>
>>>> On Sat, Jun 13, 2015 at 11:56 PM, masoom alam <
>>>> [email protected]> wrote:
>>>>
>>>>> These two imports are missing and thus FP-growth is not compiling...
>>>>>
>>>>> import org.apache.spark.*mllib.fpm.FPGrowth*;
>>>>> import org.apache.spark.*mllib.fpm.FPGrowthModel*;
>>>>>
>>>>> How to include the dependency in the POM file?
>>>>>
>>>>> On Sat, Jun 13, 2015 at 4:26 AM, masoom alam <
>>>>> [email protected]> wrote:
>>>>>
>>>>>> Thanks for the answer. Any example?
>>>>>> On Jun 13, 2015 2:13 PM, "Sonal Goyal" <[email protected]> wrote:
>>>>>>
>>>>>>> I think you need to add dependency to spark mllib too.
>>>>>>> On Jun 13, 2015 11:10 AM, "masoom alam" <[email protected]>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi every one,
>>>>>>>>
>>>>>>>> I am trying to run the FP growth example. I have tried to compile
>>>>>>>> the following POM file:
>>>>>>>>
>>>>>>>> <project>
>>>>>>>> <groupId>com.oreilly.learningsparkexamples.mini</groupId>
>>>>>>>> <artifactId>learning-spark-mini-example</artifactId>
>>>>>>>> <modelVersion>4.0.0</modelVersion>
>>>>>>>> <name>example</name>
>>>>>>>> <packaging>jar</packaging>
>>>>>>>> <version>0.0.1</version>
>>>>>>>> <dependencies>
>>>>>>>> <dependency> <!-- Spark dependency -->
>>>>>>>> <groupId>org.apache.spark</groupId>
>>>>>>>> <artifactId>spark-core_2.10</artifactId>
>>>>>>>> <version>1.3.0</version>
>>>>>>>> <scope>provided</scope>
>>>>>>>> </dependency>
>>>>>>>> </dependencies>
>>>>>>>> <properties>
>>>>>>>> <java.version>1.7</java.version>
>>>>>>>> </properties>
>>>>>>>> <build>
>>>>>>>> <pluginManagement>
>>>>>>>> <plugins>
>>>>>>>> <plugin> <groupId>org.apache.maven.plugins</groupId>
>>>>>>>> <artifactId>maven-compiler-plugin</artifactId>
>>>>>>>> <version>3.1</version>
>>>>>>>> <configuration>
>>>>>>>> <source>${java.version}</source>
>>>>>>>> <target>${java.version}</target>
>>>>>>>> </configuration>
>>>>>>>> </plugin>
>>>>>>>> </plugins>
>>>>>>>> </pluginManagement>
>>>>>>>> </build>
>>>>>>>> </project>
>>>>>>>>
>>>>>>>> It successfully builds the project, but IDE is complaining
>>>>>>>> that: Error:(29, 34) java: package org.apache.spark.mllib.fpm does not
>>>>>>>> exist
>>>>>>>>
>>>>>>>> Just as a side note, I downloaded Version 1.3 of Spark so FP-growth
>>>>>>>> algorithm should be part of it?
>>>>>>>>
>>>>>>>> Thanks.
>>>>>>>>
>>>>>>>
>>>>>
>>>>
>
