i think what changed is that core now has dependencies on other sub
projects. ok... so i am forced to install stuff because maven cannot
compile "what is needed". i will install
On Fri, Dec 5, 2014 at 7:12 PM, Koert Kuipers <ko...@tresata.com> wrote:
> i suddenly also run into the issue that maven is trying to download
> snapshots that dont exists for other sub projects.
>
> did something change in the maven build?
>
> does maven not have capability to smartly compile the other sub-projects
> that a sub-project depends on?
>
> i rather avoid "mvn install" since this creates a local maven repo. i have
> been stung by that before (spend a day trying to do something and got weird
> errors because some toy version i once build was stuck in my local maven
> repo and it somehow got priority over a real maven repo).
>
> On Fri, Dec 5, 2014 at 5:28 PM, Marcelo Vanzin <van...@cloudera.com>
> wrote:
>
>> You can set SPARK_PREPEND_CLASSES=1 and it should pick your new mllib
>> classes whenever you compile them.
>>
>> I don't see anything similar for examples/, so if you modify example
>> code you need to re-build the examples module ("package" or "install"
>> - just "compile" won't work, since you need to build the new jar).
>>
>> On Thu, Dec 4, 2014 at 10:23 PM, MEETHU MATHEW <meethu2...@yahoo.co.in>
>> wrote:
>> > Hi all,
>> >
>> > I made some code changes in mllib project and as mentioned in the
>> previous
>> > mails I did
>> >
>> > mvn install -pl mllib
>> >
>> > Now I run a program in examples using run-example, the new code is not
>> > executing.Instead the previous code itself is running.
>> >
>> > But if I do an "mvn install" in the entire spark project , I can see
>> the
>> > new code running.But installing the entire spark takes a lot of time
>> and so
>> > its difficult to do this each time I make some changes.
>> >
>> > Can someone tell me how to compile mllib alone and get the changes
>> working?
>> >
>> > Thanks & Regards,
>> > Meethu M
>> >
>> >
>> > On Friday, 28 November 2014 2:39 PM, MEETHU MATHEW <
>> meethu2...@yahoo.co.in>
>> > wrote:
>> >
>> >
>> > Hi,
>> > I have a similar problem.I modified the code in mllib and examples.
>> > I did
>> > mvn install -pl mllib
>> > mvn install -pl examples
>> >
>> > But when I run the program in examples using run-example,the older
>> version
>> > of mllib (before the changes were made) is getting executed.
>> > How to get the changes made in mllib while calling it from examples
>> > project?
>> >
>> > Thanks & Regards,
>> > Meethu M
>> >
>> >
>> > On Monday, 24 November 2014 3:33 PM, Yiming (John) Zhang <
>> sdi...@gmail.com>
>> > wrote:
>> >
>> >
>> > Thank you, Marcelo and Sean, "mvn install" is a good answer for my
>> demands.
>> >
>> > -----邮件原件-----
>> > 发件人: Marcelo Vanzin [mailto:van...@cloudera.com]
>> > 发送时间: 2014年11月21日 1:47
>> > 收件人: yiming zhang
>> > 抄送: Sean Owen; user@spark.apache.org
>> > 主题: Re: How to incrementally compile spark examples using mvn
>> >
>> > Hi Yiming,
>> >
>> > On Wed, Nov 19, 2014 at 5:35 PM, Yiming (John) Zhang <sdi...@gmail.com>
>> > wrote:
>> >> Thank you for your reply. I was wondering whether there is a method of
>> >> reusing locally-built components without installing them? That is, if
>> I have
>> >> successfully built the spark project as a whole, how should I
>> configure it
>> >> so that I can incrementally build (only) the "spark-examples" sub
>> project
>> >> without the need of downloading or installation?
>> >
>> > As Sean suggest, you shouldn't need to install anything. After "mvn
>> > install", your local repo is a working Spark installation, and you can
>> use
>> > spark-submit and other tool directly within it.
>> >
>> > You just need to remember to rebuild the assembly/ project when
>> modifying
>> > Spark code (or the examples/ project when modifying examples).
>> >
>> >
>> > --
>> > Marcelo
>> >
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>> > For additional commands, e-mail: user-h...@spark.apache.org
>> >
>> >
>> >
>> >
>>
>>
>>
>> --
>> Marcelo
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>> For additional commands, e-mail: user-h...@spark.apache.org
>>
>>
>
