Hi, I tried to use SPARK_JAVA_OPTS in spark-env.sh as well as conf/java-opts file to set additional java system properties. In this case I could connect to tachyon without any problem.
However when I tried setting executor and driver extraJavaOptions in spark-defaults.conf it doesn't. I suspect the root cause may be following: SparkSubmit doesn't fork additional JVM to actually run either driver or executor process and additional system properties are set after JVM is created and other classes are loaded. It may happen that Tachyon CommonConf class is already being loaded and since its Singleton it won't pick up and changes to system properties. Please let me know what do u think. Can I use conf/java-opts ? since it's not really documented anywhere? Best regards Lukasz -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/little-confused-about-SPARK-JAVA-OPTS-alternatives-tp5798p7448.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
