Re: broadcast hang out

2015-03-16 Thread Reynold Xin
dharan : > > > >> Cross region as in different data centers ? > >> > >> - Mridul > >> > >> On Sun, Mar 15, 2015 at 8:08 PM, lonely Feb > wrote: > >> > Hi all, i meet up with a problem that torrent broadcast hang out in my > >

Re: broadcast hang out

2015-03-15 Thread lonely Feb
>> > Hi all, i meet up with a problem that torrent broadcast hang out in my >> > spark cluster (1.2, standalone) , particularly serious when driver and >> > executors are cross-region. when i read the code of broadcast i found >> that >> > a sync block read h

Re: broadcast hang out

2015-03-15 Thread lonely Feb
yes 2015-03-16 11:43 GMT+08:00 Mridul Muralidharan : > Cross region as in different data centers ? > > - Mridul > > On Sun, Mar 15, 2015 at 8:08 PM, lonely Feb wrote: > > Hi all, i meet up with a problem that torrent broadcast hang out in my > > spark cluster (1.2,

Re: broadcast hang out

2015-03-15 Thread Mridul Muralidharan
Cross region as in different data centers ? - Mridul On Sun, Mar 15, 2015 at 8:08 PM, lonely Feb wrote: > Hi all, i meet up with a problem that torrent broadcast hang out in my > spark cluster (1.2, standalone) , particularly serious when driver and > executors are cross-region. when i

Re: broadcast hang out

2015-03-15 Thread lonely Feb
eout) > > or simply > import scala.concurrent.duration._ > Await.result(result.future, 10 seconds) > > > > On Sun, Mar 15, 2015 at 8:08 PM, lonely Feb wrote: > >> Hi all, i meet up with a problem that torrent broadcast hang out in my >> spark cluster

Re: broadcast hang out

2015-03-15 Thread Chester Chen
it.SECONDS) Await.result(result.future, timeout) or simply import scala.concurrent.duration._ Await.result(result.future, 10 seconds) On Sun, Mar 15, 2015 at 8:08 PM, lonely Feb wrote: > Hi all, i meet up with a problem that torrent broadcast hang out in my > spark cluster

broadcast hang out

2015-03-15 Thread lonely Feb
Hi all, i meet up with a problem that torrent broadcast hang out in my spark cluster (1.2, standalone) , particularly serious when driver and executors are cross-region. when i read the code of broadcast i found that a sync block read here: def fetchBlockSync(host: String, port: Int, execId