$BlockDataInputStream.peek(ObjectInputStream.java:2586)
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Failed-to-read-chunk-exception-tp20374p20891.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
I am running a large job using 4000 partitions - after running for four
hours on a 16 node cluster it fails with the following message.
The errors are in spark code and seem address unreliability at the level of
the disk -
Anyone seen this and know what is going on and how to fix it.
Exception in
