Try specifying executor memory.
On Tue, Mar 13, 2018 at 5:15 PM, Shiyuan wrote:
> Hi Spark-Users,
> I encountered the problem of "insufficient memory". The error is logged
> in the file with a name " hs_err_pid86252.log"(attached in the end of this
> email).
>
> I launched the spark job by " s
Hi Spark-Users,
I encountered the problem of "insufficient memory". The error is logged
in the file with a name " hs_err_pid86252.log"(attached in the end of this
email).
I launched the spark job by " spark-submit --driver-memory 40g --master
yarn --deploy-mode client". The spark session was cr
