Could you explain why this would work?
Assaf.
From: Haviv, Daniel [mailto:dha...@amazon.com]
Sent: Sunday, January 29, 2017 7:09 PM
To: Mendelson, Assaf
Cc: user@spark.apache.org
Subject: Re: forcing dataframe groupby partitioning
If there's no built in local groupBy, You could do something
If there's no built in local groupBy, You could do something like that:
df.groupby(C1,C2).agg(...).flatmap(x=>x.groupBy(C1)).agg
Thank you.
Daniel
On 29 Jan 2017, at 18:33, Mendelson, Assaf
mailto:assaf.mendel...@rsa.com>> wrote:
Hi,
Consider the following example:
df.groupby(C1,C2).agg(s
