Re: [VOTE] Release Apache Spark 1.1.1 (RC1)

2014-11-14 Thread Zach Fry
+0 I expect to start testing on Monday but won't have enough results to change my vote from +0 until Monday night or Tuesday morning. Thanks, Zach -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-1-1-1-RC1-tp9311p9370.html S

Re: Spark shuffle consolidateFiles performance degradation numbers

2014-11-03 Thread Zach Fry
s the number of Tasks and M is the number of Reducers. Does this sound about right? Are there any other considerations we should be aware of when setting consolidateFiles to True? Thanks, Zach Fry Palantir | Developer Support Engineer z...@palantir.com <mailto:em...@palantir.com> | 650.2