I think PythonRunner is launched when executing python script.
PythonGatewayServer is entry point for python spark shell
if (args.isPython && deployMode == CLIENT) {
if (args.primaryResource == PYSPARK_SHELL) {
args.mainClass = "org.apache.spark.api.python.PythonGatewayServer"
} else {
See PythonRunner @
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala
On Tue, Oct 13, 2015 at 7:50 PM, canan chen wrote:
> I look at the source code of spark, but didn't find where python program
> is started in python.
>
> It seems spark-s
I look at the source code of spark, but didn't find where python program is
started in python.
It seems spark-submit will call PythonGatewayServer, but where is python
program started ?
Thanks
