Hi,
Were you able to check the executors logs for this? If executors are
running in a separate JVMs/machines, they will have separate log files from
driver. If the OOME is due to concatenation of the large string, it may be
reported in the executors logs first.
How are you running this spark job?
Dear Apache Spark community,
My spark driver crashes and logs does not gives enough explanation of why it
happens:
INFO [2019-10-21 16:33:37,045] ({pool-6-thread-7}
SchedulerFactory.java[jobStarted]:109) - Job 20190926-163704_913596201 started
by scheduler interpreter_2100843352
DEBUG [2019-10
