I looked at the updated SPIP and I think the reduced scope sounds better.
>From the Spark Summit, it seemed like there was a lot of interest in
columnar processing and this would be a good starting point to enable that.
It would be great to hear some other peoples input too.
Bryan
On Tue, Apr 30,
Andrew,
Here's an umbrella issue that is a good starting point for looking at the
project to add Hive bucketing support:
https://issues.apache.org/jira/browse/SPARK-19256
rb
On Thu, May 2, 2019 at 11:40 AM Long, Andrew
wrote:
> Hey Friends,
>
>
>
> How aware of bucketing is Catalyst? I’ve been
Hey Friends,
How aware of bucketing is Catalyst? I’ve been trying to piece together how
Catalyst knows that it can remove a sort and shuffle given that both tables are
bucketed and sorted the same way. Is there any classes in particular I should
look at?
Cheers Andrew
