Re: takeSample() results in two stages

2015-06-12 Thread Imran Rashid
esting behavior in Spark 1.3.1, the reason for which is > not clear. > > Doing something as simple as sc.textFile("...").takeSample(...) always > results in two stages:Spark's takeSample() results in two stages > > < > http://apache-spark-user-list.1001560.n3

takeSample() results in two stages

2015-06-11 Thread barmaley
I've observed interesting behavior in Spark 1.3.1, the reason for which is not clear. Doing something as simple as sc.textFile("...").takeSample(...) always results in two stages:Spark's takeSample() results in two stages <http://apache-spark-user-list.1001560.n3