Thanks for that. Strangely enough I was actually using 1.1.1 where it did
seem to be enabled by default. Since upgrading to 1.2.0 and setting that
flag, I do get the expected result! Looks good!
On Tue, Jan 6, 2015 at 12:17 PM, Michael Armbrust
wrote:
> Predicate push down into the input form
Predicate push down into the input format is turned off by default because
there is a bug in the current parquet library that null pointers when there
are full row groups that are null.
https://issues.apache.org/jira/browse/SPARK-4258
You can turn it on if you want:
http://spark.apache.org/docs/l
