On Tue, Jul 14, 2015 at 3:42 PM, Elkhan Dadashov <elkhan8...@gmail.com> wrote:
> I looked into Virtual memory usage (jmap+jvisualvm) does not show that > 11.5 g Virtual Memory usage - it is much less. I get 11.5 g Virtual memory > usage using top -p pid command for SparkSubmit process. > If you're looking at top you want to pay attention to the "RES" column, which is the actual paged-in memory size of the application. > P.S: "SPARK_PRINT_LAUNCH_CMD=1" did not have any effect. > If you're using the launcher library that will probably go to the child process's stdout; if you're not reading that (and you should!), it may seem like it didn't do anything. (And it's actually "SPARK_PRINT_LAUNCH_COMMAND"... my bad.) -- Marcelo
