RE: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

e. I suppose google translate suck on the translation. From: Taotao.Li [mailto:charles.up...@gmail.com] Sent: 21 July 2016 04:04 To: Jean Georges Perrin Cc: Sachin Mittal ; user Subject: Re: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task Hi, Sachin,

Re: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

Hi, Sachin, there is no planning on translate these into english currently, sorry for that, but you can check databrick's blog, there are lots of high-quality and easy-understanding posts. or you can check the list in this post of mine, choose the English version: - spark-resouces-blogs-paper

Re: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

Hi, Thanks for the links, is there any english translation for the same? Sachin On Thu, Jul 21, 2016 at 8:34 AM, Taotao.Li wrote: > Hi, Sachin, here are two posts about the basic concepts about spark: > > >- spark-questions-concepts >

Re: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

Hi, Sachin, here are two posts about the basic concepts about spark: - spark-questions-concepts - deep-into-spark-exection-model And, I fully recommend da

Re: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

Hey, I love when questions are numbered, it's easier :) 1) Yes (but I am not an expert) 2) You don't control... One of my process is going to 8k tasks, so... 3) Yes, if you have HT, it double. My servers have 12 cores, but HT, so it makes 24. 4) From my understanding: Slave is the logical comput

Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

Hi, I was able to build and run my spark application via spark submit. I have understood some of the concepts by going through the resources at https://spark.apache.org but few doubts still remain. I have few specific questions and would be glad if someone could share some light on it. So I submi

Re: Spark Concepts

may contain confidential or legally privileged > information and is intended only for the use of the intended recipient(s). > Any unauthorized disclosure, dissemination, distribution, copying or the > taking of any action in reliance on the information herein is prohibited. > > -

Re: Spark Concepts

Anybody with good hands on with Spark, please do reply. It would help us a lot!! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Concepts-tp16477p16536.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Spark Concepts

rence between Multiple Nodes executing Jobs & Multiple Tasks Executing Jobs ? How do these handle the partitioning & parallelism. Help in these questions would be really appreciated, to get a better sense of Apache Spark.Thanks,Nitin -- View this message in context: http://apache-spark-user-lis