Hi, Ted, it works, thanks a lot for your help!
--Jia
On Sat, Dec 12, 2015 at 3:01 PM, Ted Yu wrote:
> Have you tried adding the option below through
> spark.executor.extraJavaOptions ?
>
> Cheers
>
> > On Dec 13, 2015, at 3:36 AM, Jia Zou wrote:
> >
> > My goal is to use hprof to profile where
Have you tried adding the option below through spark.executor.extraJavaOptions ?
Cheers
> On Dec 13, 2015, at 3:36 AM, Jia Zou wrote:
>
> My goal is to use hprof to profile where the bottleneck is.
> Is there anyway to do this without modifying and rebuilding Spark source code.
>
> I've tried
My goal is to use hprof to profile where the bottleneck is.
Is there anyway to do this without modifying and rebuilding Spark source
code.
I've tried to add "
-Xrunhprof:cpu=samples,depth=100,interval=20,lineno=y,thread=y,file=/home/ubuntu/out.hprof"
to spark-class script, but it can only profile
