Re: choose the number of partition according to the number of nodes

2014-04-16 Thread Joe L
Thank you Nicholas -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/choose-the-number-of-partition-according-to-the-number-of-nodes-tp4362p4364.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: choose the number of partition according to the number of nodes

2014-04-16 Thread Nicholas Chammas
, Apr 16, 2014 at 7:50 PM, Joe L wrote: > Is it true that it is better to choose the number of partition according to > the number of nodes in the cluster? > > partitionBy(numNodes) > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.na

choose the number of partition according to the number of nodes

2014-04-16 Thread Joe L
Is it true that it is better to choose the number of partition according to the number of nodes in the cluster? partitionBy(numNodes) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/choose-the-number-of-partition-according-to-the-number-of-nodes-tp4362