RE: [DISCUSS] Adaptive execution in Spark SQL

2018-07-31 Thread Wang, Carson
sql-adaptive-execution-at-100-tb>. Thanks, Carson From: Marco Gaido [mailto:marcogaid...@gmail.com] Sent: Tuesday, July 31, 2018 3:00 PM To: Wenchen Fan Cc: xyliyuanj...@gmail.com; Wang, Carson ; Spark dev list Subject: Re: [DISCUSS] Adaptive execution in Spark SQL Hi all, I also like thi

[DISCUSS] Adaptive execution in Spark SQL

2018-07-27 Thread Wang, Carson
Dear all, The initial support of adaptive execution[SPARK-9850] in Spark SQL has been there since Spark 1.6, but there is no more update since then. One of the key features in adaptive execution is to determine the number of reducer automatical

RE: Welcoming Saisai (Jerry) Shao as a committer

2017-08-29 Thread Wang, Carson
Congratulations, Saisai! -Original Message- From: Matei Zaharia [mailto:matei.zaha...@gmail.com] Sent: Tuesday, August 29, 2017 9:29 AM To: dev Cc: Saisai Shao Subject: Welcoming Saisai (Jerry) Shao as a committer Hi everyone, The PMC recently voted to add Saisai (Jerry) Shao as a co