@Sean Owen, Thanks for your advice.
There are still some failing tests on my laptop. I will work on this
issue(file move) as soon as I figure out other test related issues.
--
Ye Xianjin
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Tuesday, April 15, 2014 at 2:41 PM, Sean Owen w
Good call -- indeed that same Files class has a move() method that
will try to use renameTo() and then fall back to copy() and delete()
if needed for this very reason.
On Tue, Apr 15, 2014 at 6:34 AM, Ye Xianjin wrote:
> Hi, I think I have found the cause of the tests failing.
>
> I have two dis
By all means, it would be greatly appreciated!
On Mon, Apr 14, 2014 at 10:34 PM, Ye Xianjin wrote:
> Hi, I think I have found the cause of the tests failing.
>
> I have two disks on my laptop. The spark project dir is on an HDD disk
> while the tempdir created by google.io.Files.createTempDir i
Hi, I think I have found the cause of the tests failing.
I have two disks on my laptop. The spark project dir is on an HDD disk while
the tempdir created by google.io.Files.createTempDir is the
/var/folders/5q/ ,which is on the system disk, an SSD.
The ExecutorLoaderSuite test uses
org.apa
well. This is very strange.
I looked into ExecutorClassLoaderSuite.scala and ReplSuite.scala and made small
changes to ExecutorClassLoaderSuite.scala (mostly output some internal
variables). After that, when running repl test, I noticed the ReplSuite
was tested first and the test result is ok.
This may have something to do with running the tests on a Mac, as there is
a lot of File/URI/URL stuff going on in that test which may just have
happened to work if run on a Linux system (like Jenkins). Note that this
suite was added relatively recently:
https://github.com/apache/spark/pull/217
O
Thank you for your reply.
After building the assembly jar, the repl test still failed. The error output
is same as I post before.
--
Ye Xianjin
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Tuesday, April 15, 2014 at 1:39 AM, Michael Armbrust wrote:
> I believe you may need an
I believe you may need an assembly jar to run the ReplSuite. "sbt/sbt
assembly/assembly".
Michael
On Mon, Apr 14, 2014 at 3:14 AM, Ye Xianjin wrote:
> Hi, everyone:
> I am new to Spark development. I download spark's latest code from github.
> After running sbt/sbt assembly,
> I began running
Hi, everyone:
I am new to Spark development. I download spark's latest code from github.
After running sbt/sbt assembly,
I began running sbt/sbt test in the spark source code dir. But it failed
running the repl module test.
Here are some output details.
command:
sbt/sbt "test-only org.apache.
