Re: Increase Stack Size Workers

2014-05-05 Thread Matei Zaharia
Add export SPARK_JAVA_OPTS=“-Xss16m” to conf/spark-env.sh. Then it should apply to the executor. Matei On May 5, 2014, at 2:20 PM, Andrea Esposito wrote: > Hi there, > > i'm doing an iterative algorithm and sometimes i ended up with > StackOverflowError, doesn't matter if i do checkpoints o

Increase Stack Size Workers

2014-05-05 Thread Andrea Esposito
Hi there, i'm doing an iterative algorithm and sometimes i ended up with StackOverflowError, doesn't matter if i do checkpoints or not. Remaining i don't understand why this is happening, i figure out that increasing the stack size is a workaround. Developing using "local[n]" so the local mode i