Are you using checkpointing/WAL etc? If yes, then it could be blocking on disk IO.
Thanks Best Regards On Mon, May 11, 2015 at 10:33 PM, Seyed Majid Zahedi <[email protected]> wrote: > Hi, > > I'm running TwitterPopularTags.scala on a single node. > Everything works fine for a while (about 30min), > but after a while I see a long processing delay for tasks, and it keeps > increasing. > Has anyone experienced the same issue? > > Here is my configurations: > > spark.driver.memory 5g > spark.executor.memory 5g > > > Thanks, > Seyed > > -- > Seyed Majid Zahedi > https://www.cs.duke.edu/~zahedi/ > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
