Re: spark java options

2015-01-16 Thread Marcelo Vanzin
Hi Kane, Here's the command line you sent me privately: ./spark-1.2.0-bin-hadoop2.4/bin/spark-submit --class SimpleApp --conf "spark.executor.extraJavaOptions=-XX:+UnlockCommercialFeatures -XX:+FlightRecorder" --master local simpleapp.jar ./test.log You're running the app in "local" mode. In tha

Re: spark java options

2015-01-16 Thread Marcelo Vanzin
Hi Kane, What's the complete command line you're using to submit the app? Where to you expect these options to appear? On Fri, Jan 16, 2015 at 11:12 AM, Kane Kim wrote: > I want to add some java options when submitting application: > --conf "spark.executor.extraJavaOptions=-XX:+UnlockCommercialF

Re: spark java options

2015-01-16 Thread Yana Kadiyska
your quotes are in the wrong place. Try --conf spark.executor.extraJavaOptions="-XX:+UnlockCommercialFeatures -XX:+FlightRecorder" On Fri, Jan 16, 2015 at 2:12 PM, Kane Kim wrote: > I want to add some java options when submitting application: > --conf "spark.executor.extraJavaOptions=-XX:+Unlock

spark java options

2015-01-16 Thread Kane Kim
I want to add some java options when submitting application: --conf "spark.executor.extraJavaOptions=-XX:+UnlockCommercialFeatures -XX:+FlightRecorder" But looks like it doesn't get set. Where I can add it to make it working? Thanks. --