Re: spark 1.4.1 - LZFException

2015-09-03 Thread Yadid Ayzenberg
Also, Im seeing a new type of error: com.esotericsoftware.kryo.KryoException: com.ning.compress.lzf.LZFException: EOF in 29 byte (compressed) block: could only read 27 bytes at com.esotericsoftware.kryo.io.Input.fill(Input.java:142) at com.esotericsoftware.kryo.io.Input.require

Re: spark 1.4.1 - LZFException

2015-09-03 Thread Yadid Ayzenberg
Hi Akhil, No, it seems I have plenty of more disk space available on that node. I look at the logs and one minute before that exception I am seeing the following exception. 15/09/03 12:51:39 ERROR TransportChannelHandler: Connection to /x.y.z.w:44892 has been quiet for 12 ms while there a

Re: spark 1.4.1 - LZFException

2015-08-27 Thread Akhil Das
Is it filling up your disk space? Can you look a bit more in the executor logs to see whats going on Thanks Best Regards On Sun, Aug 23, 2015 at 1:27 AM, Yadid Ayzenberg wrote: > > > Hi All, > > We have a spark standalone cluster running 1.4.1 and we are setting > spark.io.compression.codec to