Re: Performance regression for partitioned parquet data

2017-06-15 Thread Bertrand Bossy
ease add me as a listener, and I'll try to contribute/review. >> >> Michael >> >> On Jun 6, 2017, at 5:18 AM, Bertrand Bossy >> wrote: >> >> Hi, >> >> since moving to spark 2.1 from 2.0, we experience a performance >> regression when r

Performance regression for partitioned parquet data

2017-06-06 Thread Bertrand Bossy
https://issues.apache.org/jira/browse/SPARK-18679 ) as the most closely related ticket. Unless there is a reason for the current behaviour, I will create a ticket on this soon. I might have some time in the coming days to work on this. Regards, Bertrand -- Bertrand Bossy | TERALYTICS *sof