How many partitions do you have in your data?
On 22/06/2018 09:46 μμ, pratik4891 wrote:
Hi Gurus, I am running a spark job and in one stage it's creating 9 tasks .So even if I have 25 executors only 9s are getting utilized. The other executors going to dead status , how can I increase the no of tasks so all my executors can be utilized.Any help/guidance is appreciated :) <http://apache-spark-user-list.1001560.n3.nabble.com/file/t8535/s1.jpg> <http://apache-spark-user-list.1001560.n3.nabble.com/file/t8535/s2.jpg> -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
-- Apostolos N. Papadopoulos, Associate Professor Department of Informatics Aristotle University of Thessaloniki Thessaloniki, GREECE tel: ++0030312310991918 email: papad...@csd.auth.gr twitter: @papadopoulos_ap web: http://delab.csd.auth.gr/~apostol --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
