I think you will need to use the partitionBy method
.partitionBy(no of partitions, lambda that returns a partitioner)
Thanks,
PK
From: 张志强(旺轩) [mailto:zzq98...@alibaba-inc.com]
Sent: Tuesday, October 13, 2015 4:17 AM
To: dev@spark.apache.org
Subject: How to split one RDD to small ones
Hi everyone,
I am facing a requirement that I want to split one RDD into some small ones:
but I want to split it according to its Key element value , e.g: for those
its key is X, they gonna be in RDD1; for those its key is Y, they gonna be
in RDD2 , and so on.
I know it has a routine ca
