Hi Community , 

 

When we submit a job using 'spark-submit' passing options like the 'master
url' what should be the content of the main class? 

 

For example , if I create the session myself : 

 

    val spark = SparkSession.builder.

      master("local[*]")

      .appName("Console")

      .config("spark.app.id", "spark-es")

      .getOrCreate()

 

Will spark-submit overwrite parameters like the master url , name , etc?  

 

Thank you

Reply via email to