Re: Error report file is deleted automatically after spark application finished

2016-06-30 Thread dhruve ashar
There could be multiple of them, why its not being generated even after setting the ulimit appropriately. Try out the options listed on this thread: http://stackoverflow.com/questions/7732983/core-dump-file-is-not-generated On Thu, Jun 30, 2016 at 2:25 AM, prateek arora wrote: > Thanks for the

Re: Error report file is deleted automatically after spark application finished

2016-06-30 Thread prateek arora
Thanks for the information. My problem is resolved now . I have one more issue. I am not able to save core dump file. Always shows *“# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again"* I set core dump li

Re: Error report file is deleted automatically after spark application finished

2016-06-29 Thread dhruve ashar
You can look at the yarn-default configuration file. Check your log related settings to see if log aggregation is enabled or also the log retention duration to see if its too small and files are being deleted. On Wed, Jun 29, 2016 at 4:47 PM, prateek arora wrote: > > Hi > > My Spark application