Re: spark crashes on second or third call first() on file

2015-01-15 Thread Davies Liu
What's the version of Spark you are using? On Wed, Jan 14, 2015 at 12:00 AM, Linda Terlouw wrote: > I'm new to Spark. When I use the Movie Lens dataset 100k > (http://grouplens.org/datasets/movielens/), Spark crashes when I run the > following code. The first call to movieData.first() gives the c

spark crashes on second or third call first() on file

2015-01-14 Thread Linda Terlouw
I'm new to Spark. When I use the Movie Lens dataset 100k (http://grouplens.org/datasets/movielens/), Spark crashes when I run the following code. The first call to movieData.first() gives the correct result. Depending on which machine I use, it crashed the second or third time. Does anybody kno