Re: Secondary Sorting in Spark

2015-10-26 Thread swetha kasireddy
ce. > > Used correctly it should improve performance as you can better control > placement of data and avoid shuffling… > > -adrian > > From: swetha kasireddy > Date: Monday, October 26, 2015 at 6:56 AM > To: Adrian Tanase > Cc: Bill Bejeck, "user@spark.apache.org&qu

Re: Secondary Sorting in Spark

2015-10-26 Thread Adrian Tanase
shuffling… -adrian From: swetha kasireddy Date: Monday, October 26, 2015 at 6:56 AM To: Adrian Tanase Cc: Bill Bejeck, "user@spark.apache.org<mailto:user@spark.apache.org>" Subject: Re: Secondary Sorting in Spark Hi, Does the use of custom partitioner in Streaming affect performance

Re: Secondary Sorting in Spark

2015-10-25 Thread swetha kasireddy
miss, Scala feature. > > Sent from my iPhone > > On 04 Oct 2015, at 21:41, Bill Bejeck wrote: > > I've written blog post on secondary sorting in Spark and I'd thought I'd > share it with the group > > http://codingjunkie.net/spark-secondary-sort/ > > Thanks, > Bill > >

Re: Secondary Sorting in Spark

2015-10-05 Thread Adrian Tanase
log post on secondary sorting in Spark and I'd thought I'd share it with the group http://codingjunkie.net/spark-secondary-sort/ Thanks, Bill

Re: Secondary Sorting in Spark

2015-10-04 Thread Koert Kuipers
See also https://github.com/tresata/spark-sorted On Oct 5, 2015 3:41 AM, "Bill Bejeck" wrote: > I've written blog post on secondary sorting in Spark and I'd thought I'd > share it with the group > > http://codingjunkie.net/spark-secondary-sort/ > > Thanks, > Bill >

Secondary Sorting in Spark

2015-10-04 Thread Bill Bejeck
I've written blog post on secondary sorting in Spark and I'd thought I'd share it with the group http://codingjunkie.net/spark-secondary-sort/ Thanks, Bill