Re: Running multiple threads with same Spark Context

2015-02-25 Thread Yana Kadiyska
r using >>> spark-submit, only 3 threads were running in parallel. I have repeated >>> the >>> test on different EC2 clusters (containing different number of cores) and >>> found out that only 3 threads are running in parallel on every cluster. >>> >>

Re: Running multiple threads with same Spark Context

2015-02-25 Thread Harika Matha
taining different number of cores) and >> found out that only 3 threads are running in parallel on every cluster. >> >> Why is this behaviour seen? What does this number 3 specify? >> Is there any configuration parameter that I have to set if I want to run >> more threads concu

Re: Running multiple threads with same Spark Context

2015-02-24 Thread Yana Kadiyska
haviour seen? What does this number 3 specify? > Is there any configuration parameter that I have to set if I want to run > more threads concurrently? > > Thanks > Harika > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Runni

Running multiple threads with same Spark Context

2015-02-24 Thread Harika
concurrently? Thanks Harika -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Running-multiple-threads-with-same-Spark-Context-tp21784.html Sent from the Apache Spark User List mailing list archive at Nabble.com