Re: how to increase threads per executor

2016-06-03 Thread Mich Talebzadeh
gt;>> Thread(s) per core:1 >>> Core(s) per socket:1 >>> Socket(s): 1 >>> NUMA node(s): 1 >>> Vendor ID: GenuineIntel >>> CPU family:6 >>> Model: 58 >>

Re: how to increase threads per executor

2016-06-03 Thread Jacek Laskowski
Model name:Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz >> Stepping: 0 >> CPU MHz: 2999.999 >> BogoMIPS: 5999.99 >> Hypervisor vendor: VMware >> Virtualization type: full >> L1d cache: 32K >> L

Re: how to increase threads per executor

2016-06-02 Thread Mich Talebzadeh
> L1i cache: 32K > L2 cache: 256K > L3 cache: 25600K > NUMA node0 CPU(s): 0 > > > Thanks > > > > -- > *From:* Mich Talebzadeh > *Sent:* Thursday, June 2, 2016 5:00 PM > *To:* Andres M Jimenez T

Re: how to increase threads per executor

2016-06-02 Thread Andres M Jimenez T
ache: 25600K NUMA node0 CPU(s): 0 Thanks From: Mich Talebzadeh Sent: Thursday, June 2, 2016 5:00 PM To: Andres M Jimenez T Cc: user@spark.apache.org Subject: Re: how to increase threads per executor What are passing as parameters to Spark-

Re: how to increase threads per executor

2016-06-02 Thread Mich Talebzadeh
What are passing as parameters to Spark-submit? ${SPARK_HOME}/bin/spark-submit \ --executor-cores=12 \ Also check http://spark.apache.org/docs/latest/configuration.html Execution Behavior/spark.executor.cores HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/pr

how to increase threads per executor

2016-06-02 Thread Andres M Jimenez T
Hi, I am working with Spark 1.6.1, using kafka direct connect for streaming data. Using spark scheduler and 3 slaves. Kafka topic is partitioned with a value of 10. The problem i have is, there is only one thread per executor running my function (logic implementation). Can anybody tell me