Spark Memory Optimization

in Java. My code - for converting to "long" - is on [1]. Any idea about what I am missing? Thanks! [0] http://spark.apache.org/docs/latest/tuning.html#tuning-data-structures [1] https://gist.github.com/TwUxTLi51Nus/2aba16163bf01a4d6417bb65f6fe5b38 -- Tw UxTLi51Nus Email: t

OutOfMemoryError

y answers until now. Thanks! [0] https://gist.github.com/TwUxTLi51Nus/4accdb291494be9201abfad72541ce74 [1] http://stackoverflow.com/questions/43637913/apache-spark-outofmemoryerror-heapspace PS: As a workaround, I have been using "checkpoint" after every few iterations. --