Many Thanks Yong.
Your solution rocks. If you could paste your answer on stack overflow then
I can mark it as correct answer.
Also, can you tell me how to achieve same using companion object.
Cheers
Pari
On 29 March 2017 at 21:37, Yong Zhang wrote:
> The error message indeed is not very clear
The error message indeed is not very clear.
What you did wrong is that the repartitionAndSortWithinPartitions not only
requires PairRDD, but also OrderedRDD. Your case class as key is NOT Ordered.
Either you extends it from Ordered, or provide a companion object to do the
implicit Ordering.
https://issues.apache.org/jira/browse/SPARK-3655
On Mon, Sep 22, 2014 at 3:11 PM, Daniil Osipov
wrote:
> Adding an issue in JIRA would help keep track of the feature request:
>
> https://issues.apache.org/jira/browse/SPARK
>
> On Sat, Sep 20, 2014 at 7:39 AM, Koert Kuipers wrote:
>
>> now that
Adding an issue in JIRA would help keep track of the feature request:
https://issues.apache.org/jira/browse/SPARK
On Sat, Sep 20, 2014 at 7:39 AM, Koert Kuipers wrote:
> now that spark has a sort based shuffle, can we expect a secondary sort
> soon? there are some use cases where getting a sort
