Re: Shuffle Write Size

2015-12-24 Thread Xingchi Wang
I think shuffle write size not dependency on the your data, but on the join operation, maybe your join action, don't need to shuffle more data, because the table data has already on its partition, so it not need shuffle write, is it possible? 2015-12-25 0:53 GMT+08:00 gsvic : > Is t

Shuffle Write Size

2015-12-24 Thread gsvic
message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Shuffle-Write-Size-tp15779.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. - To unsubscribe, e-mail: dev-unsubscr