GitHub user CrazyJvm opened a pull request:
https://github.com/apache/spark/pull/114
maintain arbitrary state data for each key
RT
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/CrazyJvm/spark patch-1
Alternatively you can
GitHub user CrazyJvm opened a pull request:
https://github.com/apache/spark/pull/66
update proportion of memory
The default value of "spark.storage.memoryFraction" has been change from
0.66 to 0.6 . So it should be 60% of the memory to cache while 40% used for
task execu