RE: barrier execution mode with DataFrame and dynamic allocation

2018-12-28 Thread Ilya Matiach
ark dev email list does by default to email senders, I’ve seen it added to other emails on the mailing list before. Thank you and Happy Holidays, Ilya From: Xiangrui Meng Sent: Wednesday, December 19, 2018 12:16 PM To: Ilya Matiach Cc: dev@spark.apache.org Subject: Re: barrier execution mode wi

Re: barrier execution mode with DataFrame and dynamic allocation

2018-12-19 Thread Xiangrui Meng
(don't know why your email ends with ".invalid") On Wed, Dec 19, 2018 at 9:13 AM Xiangrui Meng wrote: > > > On Wed, Dec 19, 2018 at 7:34 AM Ilya Matiach > wrote: > > > > [Note: I sent this earlier but it looks like the email was blocked > because I had another email group on the CC line] > > >

Re: barrier execution mode with DataFrame and dynamic allocation

2018-12-19 Thread Xiangrui Meng
On Wed, Dec 19, 2018 at 7:34 AM Ilya Matiach wrote: > > [Note: I sent this earlier but it looks like the email was blocked because I had another email group on the CC line] > > Hi Spark Dev, > > I would like to use the new barrier execution mode introduced in spark 2.4 with LightGBM in the spark p